-- Logs begin at Thu 2022-07-14 11:24:17 UTC, end at Thu 2022-07-14 12:25:58 UTC. -- Jul 14 11:53:43.911114 dv-cinder-848900-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 14 11:53:43.919582 dv-cinder-848900-3-smb devstack@keystone.service[80161]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 14 11:53:43.921608 dv-cinder-848900-3-smb devstack@keystone.service[80161]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 11:53:43 2022] *** Jul 14 11:53:43.921608 dv-cinder-848900-3-smb devstack@keystone.service[80161]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 11:53:43.921608 dv-cinder-848900-3-smb devstack@keystone.service[80161]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 11:53:43.921608 dv-cinder-848900-3-smb devstack@keystone.service[80161]: nodename: dv-cinder-848900-3-smb Jul 14 11:53:43.921608 dv-cinder-848900-3-smb devstack@keystone.service[80161]: machine: x86_64 Jul 14 11:53:43.921608 dv-cinder-848900-3-smb devstack@keystone.service[80161]: clock source: unix Jul 14 11:53:43.921608 dv-cinder-848900-3-smb devstack@keystone.service[80161]: pcre jit disabled Jul 14 11:53:43.921608 dv-cinder-848900-3-smb devstack@keystone.service[80161]: detected number of CPU cores: 4 Jul 14 11:53:43.921608 dv-cinder-848900-3-smb devstack@keystone.service[80161]: current working directory: / Jul 14 11:53:43.921608 dv-cinder-848900-3-smb devstack@keystone.service[80161]: detected binary path: /usr/bin/uwsgi-core Jul 14 11:53:43.922206 dv-cinder-848900-3-smb devstack@keystone.service[80161]: your processes number limit is 47680 Jul 14 11:53:43.922206 dv-cinder-848900-3-smb devstack@keystone.service[80161]: your memory page size is 4096 bytes Jul 14 11:53:43.922206 dv-cinder-848900-3-smb devstack@keystone.service[80161]: detected max file descriptor number: 2048 Jul 14 11:53:43.922206 dv-cinder-848900-3-smb devstack@keystone.service[80161]: lock engine: pthread robust mutexes Jul 14 11:53:43.922206 dv-cinder-848900-3-smb devstack@keystone.service[80161]: thunder lock: enabled Jul 14 11:53:43.922206 dv-cinder-848900-3-smb devstack@keystone.service[80161]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 14 11:53:43.922206 dv-cinder-848900-3-smb devstack@keystone.service[80161]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 11:53:43.967301 dv-cinder-848900-3-smb devstack@keystone.service[80161]: Python main interpreter initialized at 0x55dc262399c0 Jul 14 11:53:43.967301 dv-cinder-848900-3-smb devstack@keystone.service[80161]: python threads support enabled Jul 14 11:53:43.967301 dv-cinder-848900-3-smb devstack@keystone.service[80161]: your server socket listen backlog is limited to 100 connections Jul 14 11:53:43.967301 dv-cinder-848900-3-smb devstack@keystone.service[80161]: your mercy for graceful operations on workers is 90 seconds Jul 14 11:53:43.967679 dv-cinder-848900-3-smb devstack@keystone.service[80161]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 11:53:43.967754 dv-cinder-848900-3-smb devstack@keystone.service[80161]: *** Operational MODE: preforking *** Jul 14 11:53:43.968004 dv-cinder-848900-3-smb devstack@keystone.service[80161]: *** uWSGI is running in multiple interpreter mode *** Jul 14 11:53:43.968004 dv-cinder-848900-3-smb devstack@keystone.service[80161]: spawned uWSGI master process (pid: 80161) Jul 14 11:53:43.968212 dv-cinder-848900-3-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 14 11:53:43.968788 dv-cinder-848900-3-smb devstack@keystone.service[80161]: spawned uWSGI worker 1 (pid: 80164, cores: 1) Jul 14 11:53:43.969115 dv-cinder-848900-3-smb devstack@keystone.service[80161]: spawned uWSGI worker 2 (pid: 80165, cores: 1) Jul 14 11:53:43.970542 dv-cinder-848900-3-smb devstack@keystone.service[80161]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 11:53:49.423108 dv-cinder-848900-3-smb devstack@keystone.service[80165]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:53:49.423108 dv-cinder-848900-3-smb devstack@keystone.service[80165]: from cryptography.utils import int_from_bytes Jul 14 11:53:49.423908 dv-cinder-848900-3-smb devstack@keystone.service[80164]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:53:49.423908 dv-cinder-848900-3-smb devstack@keystone.service[80164]: from cryptography.utils import int_from_bytes Jul 14 11:53:49.424320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:53:49.424320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: from cryptography.utils import int_from_bytes Jul 14 11:53:49.424426 dv-cinder-848900-3-smb devstack@keystone.service[80164]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:53:49.424426 dv-cinder-848900-3-smb devstack@keystone.service[80164]: from cryptography.utils import int_from_bytes Jul 14 11:53:49.472139 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 11:53:49.472337 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 11:53:49.472501 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] command line args: [] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 11:53:49.472606 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 11:53:49.472688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 11:53:49.472769 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 11:53:49.472889 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] command line args: [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 11:53:49.472974 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ================================================================================ {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 11:53:49.473166 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 11:53:49.473250 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] admin_token = **** {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.473353 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ================================================================================ {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 11:53:49.473439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] config_dir = [] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.473576 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.473659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] admin_token = **** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.473760 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] config_source = [] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.473855 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] config_dir = [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.473980 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] debug = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.474084 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.474179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.474376 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] config_source = [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.474376 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] debug = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.474523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.474597 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.474681 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.474826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.474943 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.475051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.475146 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.475245 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.475351 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] list_limit = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.475487 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.475595 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] log_config_append = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.475697 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.475790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] list_limit = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.475895 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] log_dir = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.475988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] log_config_append = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.476087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] log_file = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.476186 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.476295 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.476397 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] log_dir = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.476397 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] log_file = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.476591 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.476672 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.476785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.476871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.476942 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.477059 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.477133 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.477245 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.477319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.477446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.477531 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.477665 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.477745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.477910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.477997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.478139 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.478216 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.478371 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.478446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.478624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.478751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.478871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.478982 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.479100 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.479220 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.479332 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.479455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.479576 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.479813 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.479936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.79/identity {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.480056 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] publish_errors = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.480209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.480324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.79/identity {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.480443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.480568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] publish_errors = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.480681 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.480792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.480902 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.481012 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.481129 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.481258 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.481383 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] standard_threads = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.481502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.481623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.481803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.482486 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.482636 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] standard_threads = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.482751 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.482862 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.482973 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] use_journal = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.482973 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] use_json = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.483195 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.483306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] use_stderr = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.483425 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.483545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] use_syslog = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.483659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] use_journal = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.483779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.483901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] use_json = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.483901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] use_stderr = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.484112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.484223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] use_syslog = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.484335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.484454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:53:49.484574 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.484687 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.484800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.484911 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.485029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.485149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.485272 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.485391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.485509 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.485621 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.485740 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.485861 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.485980 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.486099 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.486218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.486336 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.486455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.486591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.486711 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.486825 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.486937 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.487054 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.487166 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.487291 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.487412 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.487534 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.487648 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.487760 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.487873 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.488064 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.488179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.488292 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.488403 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.488514 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.488625 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.488625 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.488849 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.488963 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.489074 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.489185 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.489296 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.489296 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.489522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.489522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.489740 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.489851 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.489964 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.490086 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.490205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.490317 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.490428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.490581 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.490712 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.490826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.490938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.491050 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.491161 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.491278 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.491402 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.491516 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.491627 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.491738 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.491848 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.491959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.492079 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.492192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.492304 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.492421 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.492533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.492649 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.492770 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.492882 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.492993 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.493105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.493216 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.493326 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.493513 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.493628 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.493740 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.493851 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.493962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.494073 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.494195 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.494314 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.494426 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.494550 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.494663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.494784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.494907 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.495020 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.495132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.495247 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.495359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.495470 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.495593 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.495713 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.495825 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.495937 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.496048 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.496159 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.496280 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.496393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.496505 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.496616 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.496727 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.496868 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.496996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.497110 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.497110 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.497287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.497380 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.497473 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.497574 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.497670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.497763 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.497856 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.497956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.498058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.498154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.498263 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.498341 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.498466 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.498622 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.498726 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.498847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.498974 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.499097 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.499212 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.499334 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.499456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.499570 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.499681 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.499794 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.499907 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.500009 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.500120 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.500232 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.500354 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.500470 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.500589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.500693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.500804 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.500916 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.501038 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.501038 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.501251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.501370 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.501492 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.501606 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.501717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.501830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.501950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.501950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.502140 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.502251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.502373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.502482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.502614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.502716 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.502827 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.502940 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.503065 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.503181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.503294 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.503407 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.503520 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.503633 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.503754 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.503876 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.503990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.504103 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.504216 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.504329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.504517 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.504634 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.504748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.504860 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.504973 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.505086 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.505211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.505339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.505466 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.505580 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.505707 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.505822 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.505822 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.506033 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.506033 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.506264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.506379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.507620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.507751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.507863 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.507962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.508057 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.508151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.508246 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.508340 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.508452 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.508550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.508664 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.508779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.508893 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] auth.external = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.509006 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.509128 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.509128 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.509128 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.509128 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] auth.password = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.509128 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] auth.token = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.509670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.509794 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.509936 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.510067 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.510183 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.510304 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.510426 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] auth.external = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.510569 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.510686 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.510813 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.510931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.511052 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.511167 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.511281 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.511395 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] auth.password = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.511518 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] credential.caching = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.511643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] auth.token = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.511759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.511873 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.511988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.512108 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.512232 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.512347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.512462 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.512575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.512689 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.512689 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.512911 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.512911 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.513127 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.513241 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.513355 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.513469 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] credential.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.513590 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.513712 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.513827 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.513941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.514056 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.514170 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.514292 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.514408 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.514548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.514666 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.514780 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.514894 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.515017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.515134 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.515255 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] federation.caching = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.515370 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.515484 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.515598 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.515720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.515835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.515955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.515955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.516175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.516290 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.516412 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.516528 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.516641 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.516755 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.516869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.516982 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.517105 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.517223 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.517342 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] federation.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.517457 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.517571 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.517686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.517808 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.517924 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.caching = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.518039 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.518153 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.518267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.518381 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.518549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.518668 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.518783 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.518897 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.519011 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.519214 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.519334 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.519448 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.519562 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.519676 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.519790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.519913 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.520029 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.520150 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.520265 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.520386 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.520501 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.520623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.520623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.520839 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.520953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.521067 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.521181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.521303 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.521420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.521620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.521620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.521839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.521960 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.522084 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.522200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.522315 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.522430 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.522557 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.522684 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.522809 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.522925 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.523039 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.523154 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.523268 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.523268 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.523496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.523613 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.523727 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.523854 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.523969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.524073 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.524194 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.524310 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.524423 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.524539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.524652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.524767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.524890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.525006 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.525120 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.525234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.525347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.525461 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.525584 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.525700 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.525814 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.525928 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.526042 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.526160 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.526283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.526399 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.526591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.526712 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.526827 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.526942 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.527065 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.527181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.527295 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.527409 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.527523 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.527637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.527760 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.527876 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.527991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.528104 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.528218 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.528332 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.528454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.528570 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.529194 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.529313 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.529427 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.529541 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.529664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.529786 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.529786 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.530001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.530115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.530229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.530351 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.530467 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.530600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.530714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.530830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.530956 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.531073 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.531187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.531187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.531401 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.531514 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.531637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.531753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.531753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.531969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.532083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.532197 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.532319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.532436 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.532550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.532664 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.532778 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.532892 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.533016 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.533133 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.533246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.533360 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.533474 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.533588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.533710 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.533825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.533939 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.534054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.534168 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.534282 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.534404 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.534549 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.534667 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.534782 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.534896 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.535010 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.535141 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.535258 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.535372 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.535486 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.535600 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.535715 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.535837 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.535953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.536068 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.536181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.536294 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.536407 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.536530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.536646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.536760 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.536874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.536874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.537087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.537214 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.537331 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.537331 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.537545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.537659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.537773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.537895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.538012 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.538125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.538240 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.538354 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.538468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.538468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.538716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.538837 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.538953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.539067 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] resource.caching = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.539181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.539304 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.539421 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.539535 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.539649 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.539763 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.539877 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.540009 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.540126 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.540241 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.540356 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.540470 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.540583 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.540705 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.540821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.540936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.541050 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.541164 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.541284 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.541409 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] role.caching = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.541525 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] resource.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.541640 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] role.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.541761 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.541878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.541998 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.542192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.542309 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.542426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.542583 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.542699 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.542814 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.542941 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.543058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.543173 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.543287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.543402 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.543525 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.543648 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.543763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.543878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.543992 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] role.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.544106 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.544229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] role.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.545003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.545122 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.545237 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.545352 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.545467 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.545593 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.545712 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.545828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.545828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.546043 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.546157 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.546284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.546401 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.546531 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.546650 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.546765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.546879 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.547007 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.547124 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.547239 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.547354 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.547467 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.547582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.547706 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.547822 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.547938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.547938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.548152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.548267 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.548389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.548506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.548621 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.548737 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.548851 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.548965 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.549087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.549204 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.549318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.549432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.549432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.549654 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.549772 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.549887 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.550003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.550117 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.550232 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] token.caching = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.550355 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.550471 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.550649 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.550766 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.550881 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.550995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.551126 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.551243 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.551358 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.551472 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.551586 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.551744 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.551871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.551988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.552103 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.552218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.552332 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.552447 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.552569 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.552943 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.553063 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.553178 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.553293 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] token.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.553407 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.553530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.553647 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.553761 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.553876 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.553991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.554105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.554212 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.554326 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.554441 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.554571 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.554686 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.554800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] database.connection = **** {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.554931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.555058 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.555183 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.555299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.555413 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.555528 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.555642 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.555757 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.555878 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.555996 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.556110 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.556229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.556344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.556466 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.556582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.556697 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.556812 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.556926 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.557040 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.557163 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.557279 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.557394 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.557394 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.557608 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] database.connection = **** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.557731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.557856 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.557972 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.558095 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.558212 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.558326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.558440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.558588 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.558687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.558813 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.558931 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.559045 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.559161 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 11:53:49.559275 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.559275 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.559275 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.559275 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.559275 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.559275 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.559275 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.559275 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.560201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.560201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.560201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.560201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:53:49.560617 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 11:53:49.587847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.588056 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.588283 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.589723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.589962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.590191 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.597356 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.599447 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.626248 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.626474 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.628065 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.628306 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.769631 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.770394 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.820175 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.820401 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.823988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.824231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.885640 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.885826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.885910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.886010 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.886088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.886160 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.886277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.886368 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.886503 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.886587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.886727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.886808 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.912946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.913176 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.913376 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.913462 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.913610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.913691 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.913832 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.913912 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.914052 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.914131 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.914270 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.914348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.914509 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.914724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.925733 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.925852 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.938875 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.939051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.939139 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.939217 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.939333 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.939417 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.939559 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.939641 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.939781 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.939863 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.940001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.940083 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.940214 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.940296 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:53:49.957724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.958008 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 11:53:49.958181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.958399 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 11:53:49.958521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.958739 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 11:53:49.959000 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.959081 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.959210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 11:53:49.959301 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.959492 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.959571 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.959753 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.959830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.960014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.960272 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.971114 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.971391 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.971657 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.971736 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.971934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.972016 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.972271 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.972554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.980172 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:49.981733 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:49.983504 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:49.983787 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.984070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.984347 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.984628 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.984892 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.985085 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:49.985167 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.985369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.985458 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.985653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.985734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.985920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.985999 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.986186 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.986274 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.986459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.986758 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.987036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.987311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.987590 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:49.987863 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.012686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.014796 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.015001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.015112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.016641 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.016927 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.020310 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.020590 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.020868 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.022229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.022528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.022810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.028238 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.028517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.030834 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.031122 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.033511 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.033796 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.034076 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.034358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.034671 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.034945 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.035210 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.035481 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.035619 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.035912 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.036200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.036485 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.036775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.037053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.037326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.037593 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.054468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.054779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.056764 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.057058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.059516 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.061751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.063187 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.063479 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.065497 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.065796 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.068613 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.071039 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.072232 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.074708 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.076419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.076718 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.077004 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.077286 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.077560 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.077833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.078914 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.079218 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.079514 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.079818 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.080120 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.080406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.097437 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.097720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.097981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.098251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.100065 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.100356 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.100632 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.100895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.106137 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.107900 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.108172 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.108872 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.110639 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.110920 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.111383 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.111664 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.111945 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.112218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.112613 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.114131 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.114414 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.114757 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.115081 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.115365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.125975 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.126256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.126557 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.126847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.127125 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.127407 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.127677 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.128735 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.129023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.129321 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.129607 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.129886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.130177 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.130453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.147556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.150739 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.150850 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.154621 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.154742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.156271 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.157949 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.158040 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.158289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.158598 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.159584 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.161376 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.161657 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.161945 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.165845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.167473 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.169261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.170746 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.170977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.171089 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.171303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.171588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.174221 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.174529 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.174822 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.175100 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.181019 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.181305 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.181581 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.184638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.185444 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.185725 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.189922 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.190199 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.190480 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.190774 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.191038 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.191314 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.191590 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.191867 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.192227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.192496 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.192766 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.193023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.193295 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.193558 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.193639 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:53:50.193909 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.194194 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.194472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.194768 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.195050 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.195335 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.195607 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.195983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.196259 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.196550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.196825 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.197094 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.197365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:53:50.231688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55dc262399c0 pid: 80165 (default app) Jul 14 11:53:50.235393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d844b-6a4a-405d-9274-bf6383dd659b None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:50.235682 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d844b-6a4a-405d-9274-bf6383dd659b None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:50.235768 dv-cinder-848900-3-smb devstack@keystone.service[80164]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55dc262399c0 pid: 80164 (default app) Jul 14 11:53:50.235968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d844b-6a4a-405d-9274-bf6383dd659b None None] PATH_INFO: `/v3` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:50.240154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1/1] 10.222.0.79 () {50 vars in 791 bytes} [Thu Jul 14 11:53:50 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:53:57.970784 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0af239-cab5-4a0f-9b0f-c20af661a34d None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:57.971344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0af239-cab5-4a0f-9b0f-c20af661a34d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:57.971344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0af239-cab5-4a0f-9b0f-c20af661a34d None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:57.975674 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1/2] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:53:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:53:57.980974 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b73db-257f-436d-86c9-e757ce2a5e1c None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:57.981379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b73db-257f-436d-86c9-e757ce2a5e1c None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:57.981529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b73db-257f-436d-86c9-e757ce2a5e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:58.054265 dv-cinder-848900-3-smb devstack@keystone.service[80165]: INFO dbcounter [None req-dc8b73db-257f-436d-86c9-e757ce2a5e1c None None] Registered counter for database keystone Jul 14 11:53:58.076188 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG oslo_db.sqlalchemy.engines [None req-dc8b73db-257f-436d-86c9-e757ce2a5e1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80165) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:53:58.082766 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writer thread running {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:53:58.260732 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG passlib.handlers.bcrypt [None req-dc8b73db-257f-436d-86c9-e757ce2a5e1c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80165) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 11:53:58.261153 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG passlib.handlers.bcrypt [None req-dc8b73db-257f-436d-86c9-e757ce2a5e1c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80165) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 11:53:58.317161 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-dc8b73db-257f-436d-86c9-e757ce2a5e1c None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:53:58.318737 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-dc8b73db-257f-436d-86c9-e757ce2a5e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:53:58.448772 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 2/3] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:53:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 14 11:53:58.652598 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0af239-cab5-4a0f-9b0f-c20af661a34d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:58.724906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: INFO dbcounter [None req-7b0af239-cab5-4a0f-9b0f-c20af661a34d None None] Registered counter for database keystone Jul 14 11:53:58.745976 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG oslo_db.sqlalchemy.engines [None req-7b0af239-cab5-4a0f-9b0f-c20af661a34d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80164) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:53:58.752578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writer thread running {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:53:58.879902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0af239-cab5-4a0f-9b0f-c20af661a34d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:58.884324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa460964-9320-4308-ab59-54b392094b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:58.885011 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa460964-9320-4308-ab59-54b392094b26 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:58.885298 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa460964-9320-4308-ab59-54b392094b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:58.885573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa460964-9320-4308-ab59-54b392094b26 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:58.894743 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa460964-9320-4308-ab59-54b392094b26 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:58.946828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fa460964-9320-4308-ab59-54b392094b26 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 11:53:58.947168 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa460964-9320-4308-ab59-54b392094b26 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:58.957945 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 2/4] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Jul 14 11:53:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 11:53:58.964173 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b73db-257f-436d-86c9-e757ce2a5e1c None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:53:58.979230 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b73db-257f-436d-86c9-e757ce2a5e1c None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:53:58.983615 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d4a1f-69f3-41a9-9c35-1e84fbc17e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:53:58.984763 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d4a1f-69f3-41a9-9c35-1e84fbc17e22 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:53:58.985052 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d4a1f-69f3-41a9-9c35-1e84fbc17e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:53:58.985327 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d4a1f-69f3-41a9-9c35-1e84fbc17e22 admin admin] PATH_INFO: `/v3/projects/3fccb5bf2b21430990bb49d29dadf01f` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:53:58.986817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d4a1f-69f3-41a9-9c35-1e84fbc17e22 admin admin] RBAC: Authorizing `identity:get_project(project_id=3fccb5bf2b21430990bb49d29dadf01f)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:53:59.039577 dv-cinder-848900-3-smb devstack@keystone.service[80165]: WARNING keystone.common.rbac_enforcer.enforcer [None req-140d4a1f-69f3-41a9-9c35-1e84fbc17e22 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 11:53:59.039919 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d4a1f-69f3-41a9-9c35-1e84fbc17e22 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:53:59.044590 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 3/5] 10.222.0.79 () {56 vars in 1207 bytes} [Thu Jul 14 11:53:58 2022] GET /identity/v3/projects/3fccb5bf2b21430990bb49d29dadf01f => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:01.029837 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ebd2d-6fed-4c0c-9ccc-11e34ec703dc None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:01.030396 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ebd2d-6fed-4c0c-9ccc-11e34ec703dc None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:01.030396 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ebd2d-6fed-4c0c-9ccc-11e34ec703dc None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:01.034450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 3/6] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:01.040044 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb54e1c-c0de-4f10-94a6-ac036d653a75 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:01.040488 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb54e1c-c0de-4f10-94a6-ac036d653a75 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:01.040613 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb54e1c-c0de-4f10-94a6-ac036d653a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:01.060440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-5eb54e1c-c0de-4f10-94a6-ac036d653a75 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:01.062011 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5eb54e1c-c0de-4f10-94a6-ac036d653a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:01.069977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 4/7] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 11:54:01.092875 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ebd2d-6fed-4c0c-9ccc-11e34ec703dc None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:01.105099 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ebd2d-6fed-4c0c-9ccc-11e34ec703dc None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:01.109836 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257f51a-3347-4aa7-a0d9-adad5c8f2a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:01.110482 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257f51a-3347-4aa7-a0d9-adad5c8f2a7b admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:01.110801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257f51a-3347-4aa7-a0d9-adad5c8f2a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:01.111084 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257f51a-3347-4aa7-a0d9-adad5c8f2a7b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:01.119481 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257f51a-3347-4aa7-a0d9-adad5c8f2a7b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:01.121272 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257f51a-3347-4aa7-a0d9-adad5c8f2a7b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:01.131427 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 4/8] 10.222.0.79 () {58 vars in 1324 bytes} [Thu Jul 14 11:54:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 11:54:01.137435 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb54e1c-c0de-4f10-94a6-ac036d653a75 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:01.147899 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb54e1c-c0de-4f10-94a6-ac036d653a75 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:01.152435 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e039bb-a8b4-4972-a053-afa9ce321867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:01.153307 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e039bb-a8b4-4972-a053-afa9ce321867 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:01.153597 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e039bb-a8b4-4972-a053-afa9ce321867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:01.153873 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e039bb-a8b4-4972-a053-afa9ce321867 admin admin] PATH_INFO: `/v3/users/4f4a8278e3e04f37a60d10d95e900321` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:01.155306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e039bb-a8b4-4972-a053-afa9ce321867 admin admin] RBAC: Authorizing `identity:get_user(user_id=4f4a8278e3e04f37a60d10d95e900321)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:01.157149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e039bb-a8b4-4972-a053-afa9ce321867 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:01.158781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 5/9] 10.222.0.79 () {56 vars in 1198 bytes} [Thu Jul 14 11:54:01 2022] GET /identity/v3/users/4f4a8278e3e04f37a60d10d95e900321 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:03.238852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd96c60-22fd-4305-bd94-ed81d067892f None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:03.239371 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd96c60-22fd-4305-bd94-ed81d067892f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:03.239469 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd96c60-22fd-4305-bd94-ed81d067892f None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:03.241058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 5/10] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:03.246726 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd18430-890c-4755-8ad8-f25f11b0a749 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:03.247222 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd18430-890c-4755-8ad8-f25f11b0a749 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:03.247308 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd18430-890c-4755-8ad8-f25f11b0a749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:03.264048 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-6fd18430-890c-4755-8ad8-f25f11b0a749 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:03.265262 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-6fd18430-890c-4755-8ad8-f25f11b0a749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:03.283765 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949c3de-0fc4-41c5-a799-2cee9970df0b None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:03.284054 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949c3de-0fc4-41c5-a799-2cee9970df0b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:03.284334 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949c3de-0fc4-41c5-a799-2cee9970df0b None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:03.285686 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 6/11] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:54:03.290948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c6ea2-23ce-476d-8c44-ed26b2c48c36 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:03.291234 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c6ea2-23ce-476d-8c44-ed26b2c48c36 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:03.291598 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c6ea2-23ce-476d-8c44-ed26b2c48c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:03.332610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG passlib.handlers.bcrypt [None req-6a2c6ea2-23ce-476d-8c44-ed26b2c48c36 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80164) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 11:54:03.333032 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG passlib.handlers.bcrypt [None req-6a2c6ea2-23ce-476d-8c44-ed26b2c48c36 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80164) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 11:54:03.349053 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 6/12] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:03.372019 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd18430-890c-4755-8ad8-f25f11b0a749 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:03.378588 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6a2c6ea2-23ce-476d-8c44-ed26b2c48c36 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:03.380199 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6a2c6ea2-23ce-476d-8c44-ed26b2c48c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:03.398756 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:03.483316 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd18430-890c-4755-8ad8-f25f11b0a749 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:03.483994 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 7/13] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:54:03.505814 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c6ea2-23ce-476d-8c44-ed26b2c48c36 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:03.520070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b64c1-8e4f-4436-b1a5-58a2e72afd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:03.520866 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b64c1-8e4f-4436-b1a5-58a2e72afd0c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:03.521351 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b64c1-8e4f-4436-b1a5-58a2e72afd0c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:03.521476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b64c1-8e4f-4436-b1a5-58a2e72afd0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:03.533566 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b64c1-8e4f-4436-b1a5-58a2e72afd0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:03.544713 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-e57b64c1-8e4f-4436-b1a5-58a2e72afd0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:54:03.544713 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:03.544713 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:03.544713 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:03.544713 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:03.544713 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:03.544713 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:03.544713 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:03.544713 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:03.544713 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:03.544713 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:03.544713 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:03.544713 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:03.544713 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:03.544713 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:03.544713 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:03.545639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:03.545639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:03.545639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:03.545639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:03.545639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:03.545639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:03.545639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:03.545639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:03.545639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:03.545639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:03.545639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:03.545639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:03.545639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:03.545639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:03.545639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:03.545639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:03.546742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:03.546742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:03.546742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:03.546742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:03.546742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:03.546742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:03.546742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:03.546742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:03.546742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:03.546742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:03.546742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:54:03.546742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:54:03.546742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 7/14] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:54:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:54:03.552011 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b64c1-8e4f-4436-b1a5-58a2e72afd0c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:03.611054 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c6ea2-23ce-476d-8c44-ed26b2c48c36 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:03.613368 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:03.640401 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:03.650833 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254938c-70dc-4bf3-b5c3-f8b98478414c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:03.651770 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254938c-70dc-4bf3-b5c3-f8b98478414c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:03.652062 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254938c-70dc-4bf3-b5c3-f8b98478414c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:03.652339 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254938c-70dc-4bf3-b5c3-f8b98478414c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:03.660589 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b64c1-8e4f-4436-b1a5-58a2e72afd0c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:03.697708 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0342379-c333-497b-8549-57db80d07c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:03.698456 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0342379-c333-497b-8549-57db80d07c61 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:03.698748 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0342379-c333-497b-8549-57db80d07c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:03.698975 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0342379-c333-497b-8549-57db80d07c61 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:03.699742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0342379-c333-497b-8549-57db80d07c61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:03.700060 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0342379-c333-497b-8549-57db80d07c61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:03.702161 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0342379-c333-497b-8549-57db80d07c61 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:03.715056 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 8/15] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:03.720708 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0342379-c333-497b-8549-57db80d07c61 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:03.724617 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254938c-70dc-4bf3-b5c3-f8b98478414c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:03.726162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254938c-70dc-4bf3-b5c3-f8b98478414c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:03.827444 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0342379-c333-497b-8549-57db80d07c61 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:03.838101 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 8/16] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:54:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 11:54:03.843861 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254938c-70dc-4bf3-b5c3-f8b98478414c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:03.847090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:03.862247 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efea08b-0945-4680-aa1c-ecd5266c978c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:03.863163 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efea08b-0945-4680-aa1c-ecd5266c978c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:03.863444 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efea08b-0945-4680-aa1c-ecd5266c978c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:03.863717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efea08b-0945-4680-aa1c-ecd5266c978c None admin] PATH_INFO: `/v3/users/4f4a8278e3e04f37a60d10d95e900321` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:03.864944 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efea08b-0945-4680-aa1c-ecd5266c978c None admin] RBAC: Authorizing `identity:get_user(user_id=4f4a8278e3e04f37a60d10d95e900321)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:03.866418 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efea08b-0945-4680-aa1c-ecd5266c978c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:03.868084 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 9/17] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:03 2022] GET /identity/v3/users/4f4a8278e3e04f37a60d10d95e900321 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:03.874118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efea08b-0945-4680-aa1c-ecd5266c978c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:03.890440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:03.952679 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254938c-70dc-4bf3-b5c3-f8b98478414c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:03.982384 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efea08b-0945-4680-aa1c-ecd5266c978c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:03.990921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b284d-b72e-45fd-80f1-25927cfacad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:03.991765 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b284d-b72e-45fd-80f1-25927cfacad4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:03.992029 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b284d-b72e-45fd-80f1-25927cfacad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:03.992306 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b284d-b72e-45fd-80f1-25927cfacad4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:04.014309 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b284d-b72e-45fd-80f1-25927cfacad4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:04.015850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b284d-b72e-45fd-80f1-25927cfacad4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:04.022084 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f805a23-431c-42bc-bb85-ffbb05541523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:04.022944 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f805a23-431c-42bc-bb85-ffbb05541523 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:04.023238 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f805a23-431c-42bc-bb85-ffbb05541523 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:04.023516 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f805a23-431c-42bc-bb85-ffbb05541523 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:04.024809 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f805a23-431c-42bc-bb85-ffbb05541523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:04.026296 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f805a23-431c-42bc-bb85-ffbb05541523 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:04.028020 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 10/18] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:54:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:04.033892 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f805a23-431c-42bc-bb85-ffbb05541523 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:04.037391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-013b284d-b72e-45fd-80f1-25927cfacad4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:54:04.037391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:04.037391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:04.037391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:04.037391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:04.037391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:04.037391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:04.037391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:04.037391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:04.037391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:04.037391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:04.037391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:04.037391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:54:04.037391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:54:04.037391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:54:04.038420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:54:04.038420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:04.038420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:04.038420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:04.038420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:04.038420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:04.038420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:04.038420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:04.038420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:04.038420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:04.038420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:04.038420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:04.038420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:04.038420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:04.038420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:04.038420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:04.038420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:04.039511 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:54:04.039511 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:54:04.039511 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:54:04.039511 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:54:04.039511 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 9/19] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:54:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:54:04.045480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b284d-b72e-45fd-80f1-25927cfacad4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:04.105799 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:04.123758 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:04.143246 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f805a23-431c-42bc-bb85-ffbb05541523 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:04.150511 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b284d-b72e-45fd-80f1-25927cfacad4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:04.178121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4389157-c781-4d9a-b0aa-54a9b7eea381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:04.178827 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4389157-c781-4d9a-b0aa-54a9b7eea381 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:04.179115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4389157-c781-4d9a-b0aa-54a9b7eea381 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:04.179400 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4389157-c781-4d9a-b0aa-54a9b7eea381 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:04.180240 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4389157-c781-4d9a-b0aa-54a9b7eea381 None admin] RBAC: Adding query filter params (role.id=eff4f9bbb7064bc1a0f9fc55a05fea51, scope.domain.id=default, user.id=4f4a8278e3e04f37a60d10d95e900321) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:04.180562 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4389157-c781-4d9a-b0aa-54a9b7eea381 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:04.182021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4389157-c781-4d9a-b0aa-54a9b7eea381 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:04.186003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b26ed-6c47-4a54-82bd-120c7e348e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:04.186709 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b26ed-6c47-4a54-82bd-120c7e348e33 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:04.187021 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b26ed-6c47-4a54-82bd-120c7e348e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:04.187300 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b26ed-6c47-4a54-82bd-120c7e348e33 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:04.188036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b26ed-6c47-4a54-82bd-120c7e348e33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:04.188349 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b26ed-6c47-4a54-82bd-120c7e348e33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:04.189526 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 11/20] 10.222.0.79 () {56 vars in 1322 bytes} [Thu Jul 14 11:54:04 2022] GET /identity/v3/role_assignments?user.id=4f4a8278e3e04f37a60d10d95e900321&scope.domain.id=default&role.id=eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 233 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:04.189735 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b26ed-6c47-4a54-82bd-120c7e348e33 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:04.209941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 10/21] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:06.489147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e892c4-45c0-46c2-9c1e-9f2e35fbb1df None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:06.489671 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e892c4-45c0-46c2-9c1e-9f2e35fbb1df None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:06.489851 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e892c4-45c0-46c2-9c1e-9f2e35fbb1df None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:06.491135 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 12/22] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:06.496839 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b64bc4-26e4-464c-9ac7-1c34cb17fd27 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:06.497860 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b64bc4-26e4-464c-9ac7-1c34cb17fd27 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:06.497952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b64bc4-26e4-464c-9ac7-1c34cb17fd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:06.539915 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-57b64bc4-26e4-464c-9ac7-1c34cb17fd27 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:06.541142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-57b64bc4-26e4-464c-9ac7-1c34cb17fd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:06.619768 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 11/23] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:54:06.654897 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e892c4-45c0-46c2-9c1e-9f2e35fbb1df None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:06.858577 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e892c4-45c0-46c2-9c1e-9f2e35fbb1df None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:06.906692 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e3809-0416-432d-ae19-edda3d0c741b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:06.907500 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e3809-0416-432d-ae19-edda3d0c741b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:06.907790 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e3809-0416-432d-ae19-edda3d0c741b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:06.908070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e3809-0416-432d-ae19-edda3d0c741b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:06.929734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e3809-0416-432d-ae19-edda3d0c741b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:06.938024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-258e3809-0416-432d-ae19-edda3d0c741b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:54:06.938024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:06.938024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:06.938024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:06.938024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:06.938024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:06.938024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:06.938024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:06.938024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:06.938024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:06.938024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:06.938024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:06.938024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:06.938024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:06.938024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:06.938024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:06.938921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:06.938921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:06.938921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:06.938921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:06.938921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:06.938921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:06.938921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:06.938921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:06.938921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:06.938921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:06.938921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:06.938921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:06.938921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:06.938921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:06.938921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:06.938921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:06.939667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:06.939667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:06.939667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:06.939667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:06.939667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:06.939667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:06.939667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:06.939667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:06.939667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:06.939667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:06.939667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:54:06.939667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:54:06.939667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 13/24] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:54:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:06.947657 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b64bc4-26e4-464c-9ac7-1c34cb17fd27 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:07.019734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fd3c5-482c-47ad-8016-e25ccf81ce77 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:07.020362 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fd3c5-482c-47ad-8016-e25ccf81ce77 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:07.020653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fd3c5-482c-47ad-8016-e25ccf81ce77 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:07.023068 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 14/25] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:07.027775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:07.031361 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6e7c3-0e0d-410a-8f7e-fb2c93cb17b7 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:07.031662 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6e7c3-0e0d-410a-8f7e-fb2c93cb17b7 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:07.032274 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6e7c3-0e0d-410a-8f7e-fb2c93cb17b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:07.054856 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:07.070413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-79f6e7c3-0e0d-410a-8f7e-fb2c93cb17b7 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:07.072002 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-79f6e7c3-0e0d-410a-8f7e-fb2c93cb17b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:07.099215 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b64bc4-26e4-464c-9ac7-1c34cb17fd27 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:07.160693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a6c09-35e3-40ba-84a2-c9682913609e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:07.161625 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a6c09-35e3-40ba-84a2-c9682913609e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:07.162056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a6c09-35e3-40ba-84a2-c9682913609e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:07.162530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a6c09-35e3-40ba-84a2-c9682913609e None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:07.163439 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a6c09-35e3-40ba-84a2-c9682913609e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:07.163896 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a6c09-35e3-40ba-84a2-c9682913609e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:07.165688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a6c09-35e3-40ba-84a2-c9682913609e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:07.188532 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 12/26] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:07.189890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52d2ac-6398-4b4c-8c06-0f9c14f10a1c None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:07.190188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52d2ac-6398-4b4c-8c06-0f9c14f10a1c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:07.190474 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52d2ac-6398-4b4c-8c06-0f9c14f10a1c None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:07.191924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 13/27] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:07.194836 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52d2ac-6398-4b4c-8c06-0f9c14f10a1c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:07.209046 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 15/28] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:54:07.210855 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfffa9-4469-4276-9613-066ce2275874 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:07.211433 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfffa9-4469-4276-9613-066ce2275874 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:07.211930 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfffa9-4469-4276-9613-066ce2275874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:07.235237 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-e7dfffa9-4469-4276-9613-066ce2275874 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:07.236851 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e7dfffa9-4469-4276-9613-066ce2275874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:07.315604 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 16/29] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:07.317158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166594e6-2cc3-4302-838a-681d54e4cee3 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:07.317670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166594e6-2cc3-4302-838a-681d54e4cee3 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:07.318155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166594e6-2cc3-4302-838a-681d54e4cee3 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:07.320034 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 17/30] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:07.321054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166594e6-2cc3-4302-838a-681d54e4cee3 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:07.364037 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52d2ac-6398-4b4c-8c06-0f9c14f10a1c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:07.378675 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:07.412667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:07.415751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de307ba7-cd3e-45c2-aa8c-e6a4587ccf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:07.417167 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de307ba7-cd3e-45c2-aa8c-e6a4587ccf7c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:07.418109 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de307ba7-cd3e-45c2-aa8c-e6a4587ccf7c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:07.418763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de307ba7-cd3e-45c2-aa8c-e6a4587ccf7c None admin] PATH_INFO: `/v3/users/4f4a8278e3e04f37a60d10d95e900321` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:07.421219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de307ba7-cd3e-45c2-aa8c-e6a4587ccf7c None admin] RBAC: Authorizing `identity:get_user(user_id=4f4a8278e3e04f37a60d10d95e900321)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:07.423347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de307ba7-cd3e-45c2-aa8c-e6a4587ccf7c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:07.426053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 14/31] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:07 2022] GET /identity/v3/users/4f4a8278e3e04f37a60d10d95e900321 => generated 247 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:07.427966 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355ad5a-fe90-46b7-a30b-76084d89a856 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:07.428513 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355ad5a-fe90-46b7-a30b-76084d89a856 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:07.429040 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355ad5a-fe90-46b7-a30b-76084d89a856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:07.448889 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e355ad5a-fe90-46b7-a30b-76084d89a856 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:07.451252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e355ad5a-fe90-46b7-a30b-76084d89a856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:07.460585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166594e6-2cc3-4302-838a-681d54e4cee3 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:07.495613 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7ed94-7d75-4299-b029-69748a7582f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:07.496368 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7ed94-7d75-4299-b029-69748a7582f0 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:07.496564 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7ed94-7d75-4299-b029-69748a7582f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:07.496833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7ed94-7d75-4299-b029-69748a7582f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:07.498103 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7ed94-7d75-4299-b029-69748a7582f0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:07.499551 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7ed94-7d75-4299-b029-69748a7582f0 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:07.531794 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 15/32] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:07.533423 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355ad5a-fe90-46b7-a30b-76084d89a856 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:07.649174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 18/33] 10.222.0.79 () {60 vars in 1131 bytes} [Thu Jul 14 11:54:07 2022] POST /identity/v3/roles => generated 219 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:54:07.650304 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7ed94-7d75-4299-b029-69748a7582f0 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:07.656618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355ad5a-fe90-46b7-a30b-76084d89a856 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:07.669986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:07.728120 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60806720-56d4-48fe-8074-66051d7b2a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:07.729170 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60806720-56d4-48fe-8074-66051d7b2a97 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:07.729553 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60806720-56d4-48fe-8074-66051d7b2a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:07.729913 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60806720-56d4-48fe-8074-66051d7b2a97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:07.767575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60806720-56d4-48fe-8074-66051d7b2a97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:07.769157 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60806720-56d4-48fe-8074-66051d7b2a97 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:07.778789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7ed94-7d75-4299-b029-69748a7582f0 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:07.811015 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:07.815132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-60806720-56d4-48fe-8074-66051d7b2a97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:54:07.815132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:07.815132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:07.815132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:07.815132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:07.815132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:07.815132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:07.815132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:07.815132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:07.815132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:07.815132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:07.815132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:07.815132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:54:07.815132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:54:07.815132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:54:07.815990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:54:07.815990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:07.815990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:07.815990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:07.815990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:07.815990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:07.815990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:07.815990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:07.815990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:07.815990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:07.815990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:07.815990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:07.815990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:07.815990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:07.815990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:07.815990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:07.815990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:07.816792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:54:07.816792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:54:07.816792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:54:07.816792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:54:07.816792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 16/34] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:54:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:07.821842 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60806720-56d4-48fe-8074-66051d7b2a97 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:07.831954 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025dda4d-0351-4c93-8ee9-a6529866f986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:07.833325 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dda4d-0351-4c93-8ee9-a6529866f986 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:07.833866 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dda4d-0351-4c93-8ee9-a6529866f986 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:07.834370 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dda4d-0351-4c93-8ee9-a6529866f986 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:07.836097 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025dda4d-0351-4c93-8ee9-a6529866f986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:07.837977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025dda4d-0351-4c93-8ee9-a6529866f986 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:07.840224 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 19/35] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:54:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:07.842025 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025dda4d-0351-4c93-8ee9-a6529866f986 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:07.956468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025dda4d-0351-4c93-8ee9-a6529866f986 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:07.979662 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60806720-56d4-48fe-8074-66051d7b2a97 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:07.995319 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c872cd0-8d07-454c-bb78-ea219a4509c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:07.996355 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c872cd0-8d07-454c-bb78-ea219a4509c5 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:07.996888 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c872cd0-8d07-454c-bb78-ea219a4509c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:07.997441 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c872cd0-8d07-454c-bb78-ea219a4509c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:07.998584 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c872cd0-8d07-454c-bb78-ea219a4509c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:07.999137 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c872cd0-8d07-454c-bb78-ea219a4509c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:08.000751 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c872cd0-8d07-454c-bb78-ea219a4509c5 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:08.016972 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904cdaf-6ca9-4dd7-bbf4-4fd1b7c99dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:08.017647 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904cdaf-6ca9-4dd7-bbf4-4fd1b7c99dcc None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:08.017930 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904cdaf-6ca9-4dd7-bbf4-4fd1b7c99dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:08.018203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904cdaf-6ca9-4dd7-bbf4-4fd1b7c99dcc None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:08.019329 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904cdaf-6ca9-4dd7-bbf4-4fd1b7c99dcc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:08.020535 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904cdaf-6ca9-4dd7-bbf4-4fd1b7c99dcc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:08.023339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 20/36] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:08.024590 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c872cd0-8d07-454c-bb78-ea219a4509c5 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:08.156079 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 17/37] 10.222.0.79 () {60 vars in 1131 bytes} [Thu Jul 14 11:54:07 2022] POST /identity/v3/roles => generated 225 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:54:08.157194 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904cdaf-6ca9-4dd7-bbf4-4fd1b7c99dcc None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:08.182516 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:08.215067 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:08.267806 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c872cd0-8d07-454c-bb78-ea219a4509c5 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:08.291809 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904cdaf-6ca9-4dd7-bbf4-4fd1b7c99dcc None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:08.313289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c137d3-0afe-429f-9401-0bda69b81adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:08.314201 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c137d3-0afe-429f-9401-0bda69b81adc None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:08.314521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c137d3-0afe-429f-9401-0bda69b81adc None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:08.314833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c137d3-0afe-429f-9401-0bda69b81adc None admin] PATH_INFO: `/v3/domains/default/users/4f4a8278e3e04f37a60d10d95e900321/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:08.317272 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c137d3-0afe-429f-9401-0bda69b81adc None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4f4a8278e3e04f37a60d10d95e900321, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:08.318803 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c137d3-0afe-429f-9401-0bda69b81adc None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:08.335063 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762139a9-ac80-4559-9354-2031f8b3dc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:08.335286 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762139a9-ac80-4559-9354-2031f8b3dc93 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:08.335537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762139a9-ac80-4559-9354-2031f8b3dc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:08.335804 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762139a9-ac80-4559-9354-2031f8b3dc93 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:08.337666 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762139a9-ac80-4559-9354-2031f8b3dc93 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:08.337790 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 21/38] 10.222.0.79 () {58 vars in 1361 bytes} [Thu Jul 14 11:54:08 2022] PUT /identity/v3/domains/default/users/4f4a8278e3e04f37a60d10d95e900321/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:54:08.338126 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762139a9-ac80-4559-9354-2031f8b3dc93 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:08.338361 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6bd53-df73-49f6-a463-f56ad6027c4e None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:08.338688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6bd53-df73-49f6-a463-f56ad6027c4e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:08.338977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6bd53-df73-49f6-a463-f56ad6027c4e None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:08.340362 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 22/39] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:08.342199 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10adc8-ed27-4e8a-ba30-2f4772c84ad7 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:08.343517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10adc8-ed27-4e8a-ba30-2f4772c84ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:08.343517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10adc8-ed27-4e8a-ba30-2f4772c84ad7 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:08.344404 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 23/40] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:08.346644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302196a9-a4e4-4417-94aa-3b5aa56658e3 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:08.347047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302196a9-a4e4-4417-94aa-3b5aa56658e3 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:08.347432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302196a9-a4e4-4417-94aa-3b5aa56658e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:08.367586 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-302196a9-a4e4-4417-94aa-3b5aa56658e3 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:08.369488 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-302196a9-a4e4-4417-94aa-3b5aa56658e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:08.383304 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 18/41] 10.222.0.79 () {60 vars in 1141 bytes} [Thu Jul 14 11:54:08 2022] POST /identity/v3/projects => generated 301 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:54:08.385167 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260f1ad-11b0-4802-a2dd-b85e5408499d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:08.385401 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260f1ad-11b0-4802-a2dd-b85e5408499d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:08.385677 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260f1ad-11b0-4802-a2dd-b85e5408499d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:08.414425 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-b260f1ad-11b0-4802-a2dd-b85e5408499d None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:08.416516 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b260f1ad-11b0-4802-a2dd-b85e5408499d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:08.479099 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 24/42] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:08.509713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:08.518260 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 19/43] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:08.519258 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302196a9-a4e4-4417-94aa-3b5aa56658e3 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:08.542204 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260f1ad-11b0-4802-a2dd-b85e5408499d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:08.582430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:08.665569 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302196a9-a4e4-4417-94aa-3b5aa56658e3 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:08.670252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260f1ad-11b0-4802-a2dd-b85e5408499d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:08.702204 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e765e7e-91cb-4ac7-856f-9f320fcc397c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:08.702923 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e765e7e-91cb-4ac7-856f-9f320fcc397c None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:08.703212 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e765e7e-91cb-4ac7-856f-9f320fcc397c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:08.703494 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e765e7e-91cb-4ac7-856f-9f320fcc397c None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:08.704264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e765e7e-91cb-4ac7-856f-9f320fcc397c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:08.705728 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e765e7e-91cb-4ac7-856f-9f320fcc397c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:08.713511 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d94a2-3d62-4ba7-bdd0-75bb6aa5bceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:08.714393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d94a2-3d62-4ba7-bdd0-75bb6aa5bceb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:08.714723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d94a2-3d62-4ba7-bdd0-75bb6aa5bceb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:08.715015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d94a2-3d62-4ba7-bdd0-75bb6aa5bceb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:08.716786 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d94a2-3d62-4ba7-bdd0-75bb6aa5bceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:08.718257 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d94a2-3d62-4ba7-bdd0-75bb6aa5bceb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:08.720119 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 20/44] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:54:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:08.726551 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 25/45] 10.222.0.79 () {60 vars in 1131 bytes} [Thu Jul 14 11:54:08 2022] POST /identity/v3/roles => generated 223 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:54:08.726724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d94a2-3d62-4ba7-bdd0-75bb6aa5bceb None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:08.824513 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:08.886335 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d94a2-3d62-4ba7-bdd0-75bb6aa5bceb None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:08.927751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f76afe-a3a1-40a7-976a-942245e53b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:08.928438 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f76afe-a3a1-40a7-976a-942245e53b00 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:08.928736 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f76afe-a3a1-40a7-976a-942245e53b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:08.929023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f76afe-a3a1-40a7-976a-942245e53b00 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:08.929751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f76afe-a3a1-40a7-976a-942245e53b00 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:08.931292 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f76afe-a3a1-40a7-976a-942245e53b00 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:09.063792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 21/46] 10.222.0.79 () {60 vars in 1141 bytes} [Thu Jul 14 11:54:08 2022] POST /identity/v3/projects => generated 312 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:54:10.474990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042d2c7-1730-4681-8b21-a1d578927254 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:10.475633 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042d2c7-1730-4681-8b21-a1d578927254 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:10.475633 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042d2c7-1730-4681-8b21-a1d578927254 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:10.476916 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 26/47] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:10.482217 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad414f23-a949-4128-b339-103e4cdb28e5 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:10.482737 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad414f23-a949-4128-b339-103e4cdb28e5 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:10.482822 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad414f23-a949-4128-b339-103e4cdb28e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:10.500017 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ad414f23-a949-4128-b339-103e4cdb28e5 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:10.501214 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ad414f23-a949-4128-b339-103e4cdb28e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:10.572437 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 22/48] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:10.595385 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042d2c7-1730-4681-8b21-a1d578927254 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:10.697089 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042d2c7-1730-4681-8b21-a1d578927254 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:10.698823 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:10.736522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358fa93-373c-4620-b771-6a58c8eda003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:10.737245 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358fa93-373c-4620-b771-6a58c8eda003 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:10.737527 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358fa93-373c-4620-b771-6a58c8eda003 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:10.737805 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358fa93-373c-4620-b771-6a58c8eda003 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:10.748545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358fa93-373c-4620-b771-6a58c8eda003 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:10.756181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-5358fa93-373c-4620-b771-6a58c8eda003 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:54:10.756181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:10.756181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:10.756181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:10.756181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:10.756181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:10.756181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:10.756181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:10.756181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:10.756181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:10.756181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:10.756181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:10.756181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:10.756181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:10.756181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:10.756181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:10.756986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:10.756986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:10.756986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:10.756986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:10.756986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:10.756986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:10.756986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:10.756986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:10.756986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:10.756986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:10.756986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:10.756986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:10.756986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:10.756986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:10.756986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:10.756986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:10.757717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:10.757717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:10.757717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:10.757717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:10.757717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:10.757717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:10.757717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:10.757717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:10.757717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:10.757717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:10.757717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:54:10.757717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:54:10.757717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 27/49] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:54:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:54:10.763322 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad414f23-a949-4128-b339-103e4cdb28e5 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:10.813299 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:10.865055 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad414f23-a949-4128-b339-103e4cdb28e5 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:10.899700 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42008220-b80a-45a7-8936-ab6e8a7248b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:10.900375 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42008220-b80a-45a7-8936-ab6e8a7248b9 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:10.900666 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42008220-b80a-45a7-8936-ab6e8a7248b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:10.900944 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42008220-b80a-45a7-8936-ab6e8a7248b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:10.901698 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42008220-b80a-45a7-8936-ab6e8a7248b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:10.902009 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42008220-b80a-45a7-8936-ab6e8a7248b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:10.903977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42008220-b80a-45a7-8936-ab6e8a7248b9 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:10.912555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 23/50] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:10.917887 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358fa93-373c-4620-b771-6a58c8eda003 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:11.018477 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358fa93-373c-4620-b771-6a58c8eda003 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:11.052264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6931494-a5a9-4b6a-9d01-14e11dca2301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:11.053392 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6931494-a5a9-4b6a-9d01-14e11dca2301 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:11.053683 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6931494-a5a9-4b6a-9d01-14e11dca2301 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:11.053966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6931494-a5a9-4b6a-9d01-14e11dca2301 None admin] PATH_INFO: `/v3/users/4f4a8278e3e04f37a60d10d95e900321` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:11.055189 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6931494-a5a9-4b6a-9d01-14e11dca2301 None admin] RBAC: Authorizing `identity:get_user(user_id=4f4a8278e3e04f37a60d10d95e900321)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:11.056659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6931494-a5a9-4b6a-9d01-14e11dca2301 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:11.058298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 28/51] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:10 2022] GET /identity/v3/users/4f4a8278e3e04f37a60d10d95e900321 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:11.063903 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42008220-b80a-45a7-8936-ab6e8a7248b9 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:11.120710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443323a3-39e0-4406-8e07-ee1268c19dc0 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:11.121001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443323a3-39e0-4406-8e07-ee1268c19dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:11.121288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443323a3-39e0-4406-8e07-ee1268c19dc0 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:11.123258 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 29/52] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:54:11.128345 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b009f50-e432-4185-81b0-94b54988024e None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:11.128638 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b009f50-e432-4185-81b0-94b54988024e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:11.128923 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b009f50-e432-4185-81b0-94b54988024e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:11.145182 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-0b009f50-e432-4185-81b0-94b54988024e None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:11.146404 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-0b009f50-e432-4185-81b0-94b54988024e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:11.168011 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42008220-b80a-45a7-8936-ab6e8a7248b9 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:11.171416 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:11.182986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:11.204745 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216455c-22ad-4d30-b070-81bd62561e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:11.205550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216455c-22ad-4d30-b070-81bd62561e2c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:11.205842 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216455c-22ad-4d30-b070-81bd62561e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:11.206125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216455c-22ad-4d30-b070-81bd62561e2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:11.207352 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216455c-22ad-4d30-b070-81bd62561e2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:11.208826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216455c-22ad-4d30-b070-81bd62561e2c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:11.210659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 24/53] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:54:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:11.216742 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216455c-22ad-4d30-b070-81bd62561e2c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:11.217680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 30/54] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:54:11.240898 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b009f50-e432-4185-81b0-94b54988024e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:11.319039 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216455c-22ad-4d30-b070-81bd62561e2c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:11.341714 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b009f50-e432-4185-81b0-94b54988024e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:11.353133 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf96a01-148f-4843-9f29-3a775bab0952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:11.353803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf96a01-148f-4843-9f29-3a775bab0952 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:11.354095 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf96a01-148f-4843-9f29-3a775bab0952 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:11.354378 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf96a01-148f-4843-9f29-3a775bab0952 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:11.355270 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf96a01-148f-4843-9f29-3a775bab0952 None admin] RBAC: Adding query filter params (role.id=eff4f9bbb7064bc1a0f9fc55a05fea51, scope.domain.id=default, user.id=4f4a8278e3e04f37a60d10d95e900321) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:11.355587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf96a01-148f-4843-9f29-3a775bab0952 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:11.357600 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf96a01-148f-4843-9f29-3a775bab0952 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:11.367682 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 25/55] 10.222.0.79 () {56 vars in 1322 bytes} [Thu Jul 14 11:54:11 2022] GET /identity/v3/role_assignments?user.id=4f4a8278e3e04f37a60d10d95e900321&scope.domain.id=default&role.id=eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:11.376496 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8651542-a9ed-4abc-8101-4acbcdfbaa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:11.377334 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8651542-a9ed-4abc-8101-4acbcdfbaa22 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:11.377653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8651542-a9ed-4abc-8101-4acbcdfbaa22 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:11.377911 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8651542-a9ed-4abc-8101-4acbcdfbaa22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:11.379264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8651542-a9ed-4abc-8101-4acbcdfbaa22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:11.380785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8651542-a9ed-4abc-8101-4acbcdfbaa22 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:11.382552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 31/56] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:54:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:11.389506 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf96a01-148f-4843-9f29-3a775bab0952 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:11.443605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:11.502988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf96a01-148f-4843-9f29-3a775bab0952 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:11.539416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90945888-2ff7-42ef-9c01-b735d69634c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:11.540098 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90945888-2ff7-42ef-9c01-b735d69634c8 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:11.540392 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90945888-2ff7-42ef-9c01-b735d69634c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:11.540674 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90945888-2ff7-42ef-9c01-b735d69634c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:11.541417 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90945888-2ff7-42ef-9c01-b735d69634c8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:11.542955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90945888-2ff7-42ef-9c01-b735d69634c8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:11.570619 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 26/57] 10.222.0.79 () {60 vars in 1140 bytes} [Thu Jul 14 11:54:11 2022] POST /identity/v3/projects => generated 298 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:54:13.590043 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907d6f7-07b9-4410-af15-4a97e7afbb77 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:13.591083 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907d6f7-07b9-4410-af15-4a97e7afbb77 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:13.591189 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907d6f7-07b9-4410-af15-4a97e7afbb77 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:13.592509 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 32/58] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:13.597767 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029af46-e31c-4dda-bde6-da108560e156 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:13.598190 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029af46-e31c-4dda-bde6-da108560e156 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:13.598352 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029af46-e31c-4dda-bde6-da108560e156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:13.615352 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-7029af46-e31c-4dda-bde6-da108560e156 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:13.616547 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7029af46-e31c-4dda-bde6-da108560e156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:13.692769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 27/59] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:54:13.717961 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907d6f7-07b9-4410-af15-4a97e7afbb77 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:13.746243 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:13.819122 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907d6f7-07b9-4410-af15-4a97e7afbb77 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:13.852977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a871d3b-dae5-46be-a905-874db8f3c737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:13.853691 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a871d3b-dae5-46be-a905-874db8f3c737 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:13.853973 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a871d3b-dae5-46be-a905-874db8f3c737 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:13.854246 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a871d3b-dae5-46be-a905-874db8f3c737 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:13.855465 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a871d3b-dae5-46be-a905-874db8f3c737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:13.856931 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a871d3b-dae5-46be-a905-874db8f3c737 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:13.858602 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 33/60] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:54:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:13.864235 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029af46-e31c-4dda-bde6-da108560e156 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:13.891711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:13.964047 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029af46-e31c-4dda-bde6-da108560e156 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:13.997225 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ff968-0e28-4274-9b52-06bb754a2c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:13.997904 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ff968-0e28-4274-9b52-06bb754a2c51 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:13.998197 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ff968-0e28-4274-9b52-06bb754a2c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:13.998482 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ff968-0e28-4274-9b52-06bb754a2c51 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:13.999238 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ff968-0e28-4274-9b52-06bb754a2c51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:14.000727 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ff968-0e28-4274-9b52-06bb754a2c51 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:14.032635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 28/61] 10.222.0.79 () {60 vars in 1132 bytes} [Thu Jul 14 11:54:13 2022] POST /identity/v3/users => generated 275 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:54:17.101712 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c918e-2b74-4725-a2cc-b0f9604a0dab None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:17.102643 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c918e-2b74-4725-a2cc-b0f9604a0dab None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:17.103087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c918e-2b74-4725-a2cc-b0f9604a0dab None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:17.104928 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 34/62] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:17.110514 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954aedbc-199a-465d-ba4b-66d7bb733341 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:17.111296 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954aedbc-199a-465d-ba4b-66d7bb733341 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:17.111721 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954aedbc-199a-465d-ba4b-66d7bb733341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:17.135039 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-954aedbc-199a-465d-ba4b-66d7bb733341 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:17.136472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-954aedbc-199a-465d-ba4b-66d7bb733341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:17.234765 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 29/63] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:17.269886 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c918e-2b74-4725-a2cc-b0f9604a0dab None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:17.334962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd1d1f-0d36-423d-ad7a-2a9fb265b8b6 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:17.335494 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd1d1f-0d36-423d-ad7a-2a9fb265b8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:17.336075 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd1d1f-0d36-423d-ad7a-2a9fb265b8b6 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:17.338367 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 30/64] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:17.345431 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dd2b6-0238-491c-94e6-b5edd737c72b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:17.346259 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dd2b6-0238-491c-94e6-b5edd737c72b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:17.346965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dd2b6-0238-491c-94e6-b5edd737c72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:17.383270 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f00dd2b6-0238-491c-94e6-b5edd737c72b None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:17.389586 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f00dd2b6-0238-491c-94e6-b5edd737c72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:17.406348 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:17.430337 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:17.439945 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c918e-2b74-4725-a2cc-b0f9604a0dab None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:17.469738 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 31/65] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:54:17.471444 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b058e-2f06-4e64-b889-896f5a700348 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:17.471937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b058e-2f06-4e64-b889-896f5a700348 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:17.472359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b058e-2f06-4e64-b889-896f5a700348 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:17.473854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 32/66] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:17.479298 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbe013-df05-47b6-9d2a-1a75b741860a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:17.479765 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbe013-df05-47b6-9d2a-1a75b741860a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:17.480347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbe013-df05-47b6-9d2a-1a75b741860a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:17.481543 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e98e4-5d57-4691-8423-45eccd95c5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:17.482448 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e98e4-5d57-4691-8423-45eccd95c5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:17.482854 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e98e4-5d57-4691-8423-45eccd95c5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:17.483225 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e98e4-5d57-4691-8423-45eccd95c5b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:17.498441 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6bbbe013-df05-47b6-9d2a-1a75b741860a None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:17.500023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6bbbe013-df05-47b6-9d2a-1a75b741860a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:17.501647 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e98e4-5d57-4691-8423-45eccd95c5b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:17.509959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-7f4e98e4-5d57-4691-8423-45eccd95c5b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:54:17.509959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:17.509959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:17.509959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:17.509959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:17.509959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:17.509959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:17.509959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:17.509959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:17.509959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:17.509959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:17.509959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:17.509959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:17.509959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:17.509959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:17.509959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:17.510865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:17.510865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:17.510865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:17.510865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:17.510865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:17.510865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:17.510865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:17.510865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:17.510865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:17.510865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:17.510865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:17.510865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:17.510865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:17.510865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:17.510865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:17.510865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:17.511593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:17.511593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:17.511593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:17.511593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:17.511593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:17.511593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:17.511593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:17.511593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:17.511593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:17.511593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:17.511593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:54:17.511593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:54:17.511593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 35/67] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:54:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:17.513773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e98e4-5d57-4691-8423-45eccd95c5b7 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:17.574475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 33/68] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:54:17.579516 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbe013-df05-47b6-9d2a-1a75b741860a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:17.625444 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e98e4-5d57-4691-8423-45eccd95c5b7 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:17.661586 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc158355-7f09-4971-a33e-4fcda2d25ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:17.662319 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc158355-7f09-4971-a33e-4fcda2d25ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:17.663078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc158355-7f09-4971-a33e-4fcda2d25ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:17.663078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc158355-7f09-4971-a33e-4fcda2d25ed6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:17.674627 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc158355-7f09-4971-a33e-4fcda2d25ed6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:17.681773 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:17.684426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-dc158355-7f09-4971-a33e-4fcda2d25ed6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:17.684426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:17.684426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:17.684426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:17.684426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:17.684426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:17.684426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:17.684426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:17.684426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:17.684426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:17.684426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:17.684426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:17.684426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:17.684426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:17.684426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:17.684426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:17.685276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:17.685276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:17.685276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:17.685276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:17.685276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:17.685276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:17.685276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:17.685276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:17.685276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:17.685276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:17.685276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:17.685276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:17.685276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:17.685276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:17.685276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:17.685276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:17.685997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:17.685997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:17.685997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:17.685997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:17.685997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:17.685997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:17.685997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:17.685997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:17.685997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:17.685997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:17.685997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:17.685997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:54:17.685997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 36/69] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:17.686632 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc158355-7f09-4971-a33e-4fcda2d25ed6 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:17.717109 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbe013-df05-47b6-9d2a-1a75b741860a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:17.736392 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:17.761529 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e18d3-af0c-42d7-924b-cff61475f7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:17.762737 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e18d3-af0c-42d7-924b-cff61475f7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:17.763081 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e18d3-af0c-42d7-924b-cff61475f7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:17.763369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e18d3-af0c-42d7-924b-cff61475f7f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:17.764136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e18d3-af0c-42d7-924b-cff61475f7f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:17.764453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e18d3-af0c-42d7-924b-cff61475f7f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:17.765866 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e18d3-af0c-42d7-924b-cff61475f7f5 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:17.774938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 34/70] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:17.775778 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e18d3-af0c-42d7-924b-cff61475f7f5 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:17.819413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc158355-7f09-4971-a33e-4fcda2d25ed6 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:17.854595 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd7f70-c7b7-48e7-a348-e858eacf4354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:17.855871 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd7f70-c7b7-48e7-a348-e858eacf4354 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:17.856393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd7f70-c7b7-48e7-a348-e858eacf4354 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:17.856865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd7f70-c7b7-48e7-a348-e858eacf4354 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:17.868807 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd7f70-c7b7-48e7-a348-e858eacf4354 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:17.878277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-a7dd7f70-c7b7-48e7-a348-e858eacf4354 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:54:17.878277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:17.878277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:17.878277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:17.878277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:17.878277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:17.878277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:17.878277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:17.878277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:17.878277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:17.878277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:17.878277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:17.878277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:17.878277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:17.878277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:17.878277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:17.879287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:17.879287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:17.879287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:17.879287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:17.879287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:17.879287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:17.879287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:17.879287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:17.879287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:17.879287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:17.879287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:17.879287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:17.879287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:17.879287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:17.879287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:17.879287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:17.880095 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:17.880095 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:17.880095 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:17.880095 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:17.880095 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:17.880095 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:17.880095 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:17.880095 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:17.880095 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:17.880095 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:17.880095 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:54:17.880095 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:54:17.882054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 37/71] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Jul 14 11:54:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:17.888763 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38434e9d-2c28-4954-908d-a871796e49c5 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:17.889053 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38434e9d-2c28-4954-908d-a871796e49c5 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:17.889339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38434e9d-2c28-4954-908d-a871796e49c5 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:17.890842 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 38/72] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:17.895984 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38434e9d-2c28-4954-908d-a871796e49c5 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:17.901870 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e18d3-af0c-42d7-924b-cff61475f7f5 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:17.947032 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb048a7-c7a4-4e2e-ae44-76aa617e2c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:17.948081 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb048a7-c7a4-4e2e-ae44-76aa617e2c54 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:17.948572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb048a7-c7a4-4e2e-ae44-76aa617e2c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:17.949049 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb048a7-c7a4-4e2e-ae44-76aa617e2c54 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:17.950926 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb048a7-c7a4-4e2e-ae44-76aa617e2c54 None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:17.951458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb048a7-c7a4-4e2e-ae44-76aa617e2c54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:17.953785 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb048a7-c7a4-4e2e-ae44-76aa617e2c54 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:17.955741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:17.973329 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 35/73] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:54:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:17.973329 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb048a7-c7a4-4e2e-ae44-76aa617e2c54 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:18.011197 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:18.037196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38434e9d-2c28-4954-908d-a871796e49c5 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:18.085935 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb048a7-c7a4-4e2e-ae44-76aa617e2c54 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:18.090236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69774d98-955d-4859-8acc-060f46dc24eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:18.091190 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69774d98-955d-4859-8acc-060f46dc24eb None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:18.091476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69774d98-955d-4859-8acc-060f46dc24eb None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:18.091754 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69774d98-955d-4859-8acc-060f46dc24eb None admin] PATH_INFO: `/v3/users/4f4a8278e3e04f37a60d10d95e900321` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:18.092977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69774d98-955d-4859-8acc-060f46dc24eb None admin] RBAC: Authorizing `identity:get_user(user_id=4f4a8278e3e04f37a60d10d95e900321)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:18.094443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69774d98-955d-4859-8acc-060f46dc24eb None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:18.096304 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 39/74] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:17 2022] GET /identity/v3/users/4f4a8278e3e04f37a60d10d95e900321 => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:18.099003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aee7ba-86e8-4a72-9a4a-950e8777daff None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:18.100185 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aee7ba-86e8-4a72-9a4a-950e8777daff None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:18.100639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aee7ba-86e8-4a72-9a4a-950e8777daff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:18.120616 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-04aee7ba-86e8-4a72-9a4a-950e8777daff None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:18.122365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-04aee7ba-86e8-4a72-9a4a-950e8777daff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:18.139917 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acc899-6048-480c-a84d-bdbcda90e8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:18.140598 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acc899-6048-480c-a84d-bdbcda90e8bf None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:18.140891 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acc899-6048-480c-a84d-bdbcda90e8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:18.141181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acc899-6048-480c-a84d-bdbcda90e8bf None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:18.141939 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acc899-6048-480c-a84d-bdbcda90e8bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:18.142256 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acc899-6048-480c-a84d-bdbcda90e8bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:18.143694 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acc899-6048-480c-a84d-bdbcda90e8bf None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:18.151818 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 36/75] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:54:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:18.152622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acc899-6048-480c-a84d-bdbcda90e8bf None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:18.193806 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 40/76] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:18.194697 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aee7ba-86e8-4a72-9a4a-950e8777daff None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:18.222653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:18.267326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acc899-6048-480c-a84d-bdbcda90e8bf None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:18.272283 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:18.299224 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aee7ba-86e8-4a72-9a4a-950e8777daff None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:18.302824 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcdbcc-2fe8-47ad-90cc-0ebb49cdf5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:18.303700 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcdbcc-2fe8-47ad-90cc-0ebb49cdf5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:18.303990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcdbcc-2fe8-47ad-90cc-0ebb49cdf5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:18.304272 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcdbcc-2fe8-47ad-90cc-0ebb49cdf5d6 None admin] PATH_INFO: `/v3/users/5786c5828f214152a6e9a90fca93504e` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:18.319745 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bcdbcc-2fe8-47ad-90cc-0ebb49cdf5d6 None admin] RBAC: Authorizing `identity:get_user(user_id=5786c5828f214152a6e9a90fca93504e)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:18.321211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bcdbcc-2fe8-47ad-90cc-0ebb49cdf5d6 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:18.327373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 37/77] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:18 2022] GET /identity/v3/users/5786c5828f214152a6e9a90fca93504e => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:18.327373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da017b7-40dd-4247-bfea-6d7cb907c8f9 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:18.327373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da017b7-40dd-4247-bfea-6d7cb907c8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:18.327373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da017b7-40dd-4247-bfea-6d7cb907c8f9 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:18.327373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 38/78] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:18.327373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da017b7-40dd-4247-bfea-6d7cb907c8f9 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:18.336909 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4e9f6-0008-422e-b767-e348c81e79d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:18.337576 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4e9f6-0008-422e-b767-e348c81e79d7 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:18.337869 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4e9f6-0008-422e-b767-e348c81e79d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:18.338153 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4e9f6-0008-422e-b767-e348c81e79d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:18.406408 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4e9f6-0008-422e-b767-e348c81e79d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:18.407934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4e9f6-0008-422e-b767-e348c81e79d7 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:18.427109 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da017b7-40dd-4247-bfea-6d7cb907c8f9 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:18.443962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:18.462070 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efda14-7168-4547-a625-3a3cc18a1020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:18.462978 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efda14-7168-4547-a625-3a3cc18a1020 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:18.463272 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efda14-7168-4547-a625-3a3cc18a1020 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:18.463548 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efda14-7168-4547-a625-3a3cc18a1020 None admin] PATH_INFO: `/v3/users/5786c5828f214152a6e9a90fca93504e` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:18.464775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efda14-7168-4547-a625-3a3cc18a1020 None admin] RBAC: Authorizing `identity:get_user(user_id=5786c5828f214152a6e9a90fca93504e)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:18.466259 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efda14-7168-4547-a625-3a3cc18a1020 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:18.468203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 39/79] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:18 2022] GET /identity/v3/users/5786c5828f214152a6e9a90fca93504e => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:18.468887 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efda14-7168-4547-a625-3a3cc18a1020 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:18.488038 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:18.515370 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 41/80] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:54:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:18.516491 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4e9f6-0008-422e-b767-e348c81e79d7 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:18.571988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efda14-7168-4547-a625-3a3cc18a1020 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:18.604301 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb261b-6f2c-4873-a160-c6f5cecc2d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:18.605108 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb261b-6f2c-4873-a160-c6f5cecc2d82 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:18.605399 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb261b-6f2c-4873-a160-c6f5cecc2d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:18.605681 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb261b-6f2c-4873-a160-c6f5cecc2d82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:18.613710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4e9f6-0008-422e-b767-e348c81e79d7 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:18.618518 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb261b-6f2c-4873-a160-c6f5cecc2d82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:18.628169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-dbfb261b-6f2c-4873-a160-c6f5cecc2d82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:18.628169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:18.628169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:18.628169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:18.628169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:18.628169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:18.628169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:18.628169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:18.628169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:18.628169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:18.628169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:18.628169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:18.628169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:18.628169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:18.628169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:18.628169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:18.629162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:18.629162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:18.629162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:18.629162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:18.629162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:18.629162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:18.629162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:18.629162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:18.629162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:18.629162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:18.629162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:18.629162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:18.629162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:18.629162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:18.629162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:18.629162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:18.630003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:18.630003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:18.630003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:18.630003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:18.630003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:18.630003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:18.630003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:18.630003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:18.630003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:18.630003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:18.630003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:18.630003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:54:18.630003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 40/81] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:18.635487 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6af767-c7ed-404a-8e9a-75dc4df5c916 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:18.635785 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6af767-c7ed-404a-8e9a-75dc4df5c916 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:18.636074 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6af767-c7ed-404a-8e9a-75dc4df5c916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:18.649647 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fbeb5-abc5-4e17-8fc0-0eed06512fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:18.650308 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fbeb5-abc5-4e17-8fc0-0eed06512fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:18.650632 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fbeb5-abc5-4e17-8fc0-0eed06512fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:18.650922 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fbeb5-abc5-4e17-8fc0-0eed06512fe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:18.652611 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-4b6af767-c7ed-404a-8e9a-75dc4df5c916 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:18.654333 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4b6af767-c7ed-404a-8e9a-75dc4df5c916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:18.696176 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:18.697429 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:18.724344 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fbeb5-abc5-4e17-8fc0-0eed06512fe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:18.725833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fbeb5-abc5-4e17-8fc0-0eed06512fe9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:18.726204 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 41/82] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:18.727116 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6af767-c7ed-404a-8e9a-75dc4df5c916 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:18.832320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 42/83] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:54:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:18.833196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fbeb5-abc5-4e17-8fc0-0eed06512fe9 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:18.845451 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6af767-c7ed-404a-8e9a-75dc4df5c916 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:18.882716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4031a-a63e-4c32-a127-d39995dd8c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:18.883383 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4031a-a63e-4c32-a127-d39995dd8c42 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:18.883674 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4031a-a63e-4c32-a127-d39995dd8c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:18.883959 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4031a-a63e-4c32-a127-d39995dd8c42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:18.911440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:18.927843 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:18.938238 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fbeb5-abc5-4e17-8fc0-0eed06512fe9 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:18.953631 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4031a-a63e-4c32-a127-d39995dd8c42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:18.955159 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4031a-a63e-4c32-a127-d39995dd8c42 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:18.971737 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ec4ce-9775-4b11-a350-ca9ce5a1213a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:18.972600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ec4ce-9775-4b11-a350-ca9ce5a1213a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:18.972889 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ec4ce-9775-4b11-a350-ca9ce5a1213a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:18.973169 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ec4ce-9775-4b11-a350-ca9ce5a1213a None admin] PATH_INFO: `/v3/projects/05ae476a690b4d899f0bd474f195f9ea` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:18.974383 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ec4ce-9775-4b11-a350-ca9ce5a1213a None admin] RBAC: Authorizing `identity:get_project(project_id=05ae476a690b4d899f0bd474f195f9ea)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:18.975906 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ec4ce-9775-4b11-a350-ca9ce5a1213a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:18.977658 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 43/84] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:18 2022] GET /identity/v3/projects/05ae476a690b4d899f0bd474f195f9ea => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:18.978468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ec4ce-9775-4b11-a350-ca9ce5a1213a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:19.061633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 42/85] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:54:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:19.062834 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4031a-a63e-4c32-a127-d39995dd8c42 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:19.077194 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ec4ce-9775-4b11-a350-ca9ce5a1213a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:19.110301 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52fa26-602e-4170-9342-79d65d2c2344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:19.111020 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52fa26-602e-4170-9342-79d65d2c2344 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:19.111304 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52fa26-602e-4170-9342-79d65d2c2344 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:19.111581 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52fa26-602e-4170-9342-79d65d2c2344 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:19.112325 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52fa26-602e-4170-9342-79d65d2c2344 None admin] RBAC: Adding query filter params (name=member) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:19.112637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52fa26-602e-4170-9342-79d65d2c2344 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:19.114030 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52fa26-602e-4170-9342-79d65d2c2344 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:19.122830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 44/86] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:54:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:19.123644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52fa26-602e-4170-9342-79d65d2c2344 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:19.127223 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:19.140898 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:19.164812 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4031a-a63e-4c32-a127-d39995dd8c42 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:19.199115 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d074fb4-a88f-414d-a6ee-c3e0358287be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:19.200424 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d074fb4-a88f-414d-a6ee-c3e0358287be None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:19.200704 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d074fb4-a88f-414d-a6ee-c3e0358287be None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:19.200986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d074fb4-a88f-414d-a6ee-c3e0358287be None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:19.202158 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d074fb4-a88f-414d-a6ee-c3e0358287be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:19.203641 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d074fb4-a88f-414d-a6ee-c3e0358287be None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:19.205259 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 43/87] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:54:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:19.206028 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d074fb4-a88f-414d-a6ee-c3e0358287be None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:19.231605 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52fa26-602e-4170-9342-79d65d2c2344 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:19.267097 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a44c07-c9ea-4627-81e9-d670856ceb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:19.267971 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a44c07-c9ea-4627-81e9-d670856ceb92 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:19.268249 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a44c07-c9ea-4627-81e9-d670856ceb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:19.268528 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a44c07-c9ea-4627-81e9-d670856ceb92 None admin] PATH_INFO: `/v3/projects/05ae476a690b4d899f0bd474f195f9ea` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:19.269712 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a44c07-c9ea-4627-81e9-d670856ceb92 None admin] RBAC: Authorizing `identity:get_project(project_id=05ae476a690b4d899f0bd474f195f9ea)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:19.271208 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a44c07-c9ea-4627-81e9-d670856ceb92 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:19.272909 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 45/88] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:19 2022] GET /identity/v3/projects/05ae476a690b4d899f0bd474f195f9ea => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:19.273676 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a44c07-c9ea-4627-81e9-d670856ceb92 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:19.315004 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d074fb4-a88f-414d-a6ee-c3e0358287be None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:19.341848 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:19.352941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26c415-9224-4c32-8e29-fe798751c482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:19.353611 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26c415-9224-4c32-8e29-fe798751c482 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:19.353901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26c415-9224-4c32-8e29-fe798751c482 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:19.354178 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26c415-9224-4c32-8e29-fe798751c482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:19.355064 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26c415-9224-4c32-8e29-fe798751c482 None admin] RBAC: Adding query filter params (role.id=eff4f9bbb7064bc1a0f9fc55a05fea51, scope.project.id=05ae476a690b4d899f0bd474f195f9ea, user.id=4f4a8278e3e04f37a60d10d95e900321) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:19.355373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26c415-9224-4c32-8e29-fe798751c482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:19.356841 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26c415-9224-4c32-8e29-fe798751c482 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:19.362466 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 44/89] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:54:19 2022] GET /identity/v3/role_assignments?user.id=4f4a8278e3e04f37a60d10d95e900321&scope.project.id=05ae476a690b4d899f0bd474f195f9ea&role.id=eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:19.363292 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26c415-9224-4c32-8e29-fe798751c482 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:19.373685 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a44c07-c9ea-4627-81e9-d670856ceb92 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:19.386646 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:19.415360 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d087e3-f71c-4d68-801a-947e16111068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:19.416252 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d087e3-f71c-4d68-801a-947e16111068 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:19.416540 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d087e3-f71c-4d68-801a-947e16111068 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:19.416826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d087e3-f71c-4d68-801a-947e16111068 None admin] PATH_INFO: `/v3/projects/05ae476a690b4d899f0bd474f195f9ea` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:19.418131 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d087e3-f71c-4d68-801a-947e16111068 None admin] RBAC: Authorizing `identity:get_project(project_id=05ae476a690b4d899f0bd474f195f9ea)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:19.419719 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d087e3-f71c-4d68-801a-947e16111068 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:19.421781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 46/90] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:19 2022] GET /identity/v3/projects/05ae476a690b4d899f0bd474f195f9ea => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:19.422632 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d087e3-f71c-4d68-801a-947e16111068 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:19.515746 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26c415-9224-4c32-8e29-fe798751c482 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:19.536894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d087e3-f71c-4d68-801a-947e16111068 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:19.554706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047d19a-9a94-4457-9a42-18541e1c1a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:19.555589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047d19a-9a94-4457-9a42-18541e1c1a89 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:19.555880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047d19a-9a94-4457-9a42-18541e1c1a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:19.556158 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047d19a-9a94-4457-9a42-18541e1c1a89 None admin] PATH_INFO: `/v3/users/5786c5828f214152a6e9a90fca93504e` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:19.557770 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047d19a-9a94-4457-9a42-18541e1c1a89 None admin] RBAC: Authorizing `identity:get_user(user_id=5786c5828f214152a6e9a90fca93504e)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:19.559822 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047d19a-9a94-4457-9a42-18541e1c1a89 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:19.561495 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 45/91] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:19 2022] GET /identity/v3/users/5786c5828f214152a6e9a90fca93504e => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:19.562280 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047d19a-9a94-4457-9a42-18541e1c1a89 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:19.577213 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af623801-2536-4b2d-aa62-d398b5908c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:19.577819 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af623801-2536-4b2d-aa62-d398b5908c8a None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:19.578104 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af623801-2536-4b2d-aa62-d398b5908c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:19.578387 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af623801-2536-4b2d-aa62-d398b5908c8a None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:19.579137 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af623801-2536-4b2d-aa62-d398b5908c8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:19.580657 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af623801-2536-4b2d-aa62-d398b5908c8a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:19.597676 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:19.618733 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 47/92] 10.222.0.79 () {60 vars in 1132 bytes} [Thu Jul 14 11:54:19 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:54:19.620087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af623801-2536-4b2d-aa62-d398b5908c8a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:19.653504 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:19.684473 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047d19a-9a94-4457-9a42-18541e1c1a89 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:19.725318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0598fdd-1880-4486-a746-f58bcfe1fe58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:19.726181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0598fdd-1880-4486-a746-f58bcfe1fe58 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:19.726573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0598fdd-1880-4486-a746-f58bcfe1fe58 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:19.726930 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0598fdd-1880-4486-a746-f58bcfe1fe58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:19.727907 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0598fdd-1880-4486-a746-f58bcfe1fe58 None admin] RBAC: Adding query filter params (role.id=9a3a3371dd4d4405b2e4604acc314d43, scope.project.id=05ae476a690b4d899f0bd474f195f9ea, user.id=5786c5828f214152a6e9a90fca93504e) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:19.728322 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0598fdd-1880-4486-a746-f58bcfe1fe58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:19.731724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0598fdd-1880-4486-a746-f58bcfe1fe58 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:19.747875 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 46/93] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:54:19 2022] GET /identity/v3/role_assignments?user.id=5786c5828f214152a6e9a90fca93504e&scope.project.id=05ae476a690b4d899f0bd474f195f9ea&role.id=9a3a3371dd4d4405b2e4604acc314d43 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:19.747875 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0598fdd-1880-4486-a746-f58bcfe1fe58 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:19.793075 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af623801-2536-4b2d-aa62-d398b5908c8a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:19.860722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901aedd3-4611-4629-b8a5-2d04e29f1b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:19.861618 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901aedd3-4611-4629-b8a5-2d04e29f1b6e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:19.861916 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901aedd3-4611-4629-b8a5-2d04e29f1b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:19.863264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901aedd3-4611-4629-b8a5-2d04e29f1b6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:19.864186 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901aedd3-4611-4629-b8a5-2d04e29f1b6e None admin] RBAC: Adding query filter params (role.id=986e347cbb9e43e7a49dfef9be8ec9dd, scope.project.id=05ae476a690b4d899f0bd474f195f9ea, user.id=5786c5828f214152a6e9a90fca93504e) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:19.864517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901aedd3-4611-4629-b8a5-2d04e29f1b6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:19.866069 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901aedd3-4611-4629-b8a5-2d04e29f1b6e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:19.874355 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 48/94] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:54:19 2022] GET /identity/v3/role_assignments?user.id=5786c5828f214152a6e9a90fca93504e&scope.project.id=05ae476a690b4d899f0bd474f195f9ea&role.id=986e347cbb9e43e7a49dfef9be8ec9dd => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:19.903985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0598fdd-1880-4486-a746-f58bcfe1fe58 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:19.946280 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138db8d6-cbd7-4e03-b421-dd3215beca12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:19.947005 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138db8d6-cbd7-4e03-b421-dd3215beca12 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:19.947295 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138db8d6-cbd7-4e03-b421-dd3215beca12 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:19.947579 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138db8d6-cbd7-4e03-b421-dd3215beca12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:19.958808 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:20.030322 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138db8d6-cbd7-4e03-b421-dd3215beca12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:20.032203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138db8d6-cbd7-4e03-b421-dd3215beca12 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:20.150068 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 47/95] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:54:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:20.156459 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901aedd3-4611-4629-b8a5-2d04e29f1b6e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:20.228299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:20.276208 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901aedd3-4611-4629-b8a5-2d04e29f1b6e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:20.316878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df238cff-3538-4cb2-8536-b458ae519c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:20.317763 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df238cff-3538-4cb2-8536-b458ae519c69 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:20.318052 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df238cff-3538-4cb2-8536-b458ae519c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:20.318334 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df238cff-3538-4cb2-8536-b458ae519c69 None admin] PATH_INFO: `/v3/projects/a857274b837347e4b25e6735c7f958ae` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:20.319611 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df238cff-3538-4cb2-8536-b458ae519c69 None admin] RBAC: Authorizing `identity:get_project(project_id=a857274b837347e4b25e6735c7f958ae)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:20.321109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df238cff-3538-4cb2-8536-b458ae519c69 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:20.323248 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 49/96] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:20 2022] GET /identity/v3/projects/a857274b837347e4b25e6735c7f958ae => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:20.329716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138db8d6-cbd7-4e03-b421-dd3215beca12 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:20.376972 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:20.455699 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138db8d6-cbd7-4e03-b421-dd3215beca12 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:20.503604 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12259fc9-a394-4e98-a0e2-264e6f0a604f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:20.504281 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12259fc9-a394-4e98-a0e2-264e6f0a604f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:20.504577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12259fc9-a394-4e98-a0e2-264e6f0a604f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:20.504859 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12259fc9-a394-4e98-a0e2-264e6f0a604f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:20.505761 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12259fc9-a394-4e98-a0e2-264e6f0a604f None admin] RBAC: Adding query filter params (role.id=9a3a3371dd4d4405b2e4604acc314d43, scope.project.id=a857274b837347e4b25e6735c7f958ae, user.id=5786c5828f214152a6e9a90fca93504e) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:20.506076 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12259fc9-a394-4e98-a0e2-264e6f0a604f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:20.507558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12259fc9-a394-4e98-a0e2-264e6f0a604f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:20.519449 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 48/97] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:54:20 2022] GET /identity/v3/role_assignments?user.id=5786c5828f214152a6e9a90fca93504e&scope.project.id=a857274b837347e4b25e6735c7f958ae&role.id=9a3a3371dd4d4405b2e4604acc314d43 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:21.894420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8f016-4bc1-4872-b485-e9e7de6a29d4 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:21.894960 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8f016-4bc1-4872-b485-e9e7de6a29d4 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:21.895032 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8f016-4bc1-4872-b485-e9e7de6a29d4 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:21.896629 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 50/98] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:21.902547 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6838c-642b-48c3-aa79-b32bf0df967f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:21.903103 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6838c-642b-48c3-aa79-b32bf0df967f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:21.903173 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6838c-642b-48c3-aa79-b32bf0df967f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:21.926057 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-87d6838c-642b-48c3-aa79-b32bf0df967f None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:21.927619 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-87d6838c-642b-48c3-aa79-b32bf0df967f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:22.018045 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 49/99] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:22.054461 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8f016-4bc1-4872-b485-e9e7de6a29d4 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:22.193369 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8f016-4bc1-4872-b485-e9e7de6a29d4 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:22.232547 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:22.244096 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab748abe-0fe2-406e-a819-a7968394a90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:22.244914 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab748abe-0fe2-406e-a819-a7968394a90b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:22.245211 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab748abe-0fe2-406e-a819-a7968394a90b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:22.245497 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab748abe-0fe2-406e-a819-a7968394a90b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:22.256921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab748abe-0fe2-406e-a819-a7968394a90b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:22.265300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-ab748abe-0fe2-406e-a819-a7968394a90b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:54:22.265300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:22.265300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:22.265300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:22.265300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:22.265300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:22.265300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:22.265300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:22.265300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:22.265300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:22.265300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:22.265300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:22.265300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:22.265300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:22.265300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:22.265300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:22.266176 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:22.266176 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:22.266176 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:22.266176 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:22.266176 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:22.266176 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:22.266176 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:22.266176 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:22.266176 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:22.266176 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:22.266176 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:22.266176 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:22.266176 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:22.266176 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:22.266176 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:22.266176 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:22.268320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:22.268320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:22.268320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:22.268320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:22.268320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:22.268320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:22.268320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:22.268320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:22.268320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:22.268320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:22.268320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:54:22.268320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:54:22.268320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 51/100] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:54:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:22.272733 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6838c-642b-48c3-aa79-b32bf0df967f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:22.327603 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:22.432685 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6838c-642b-48c3-aa79-b32bf0df967f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:22.467842 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d1ea6-dc57-478c-8376-fddbf3233cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:22.468527 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d1ea6-dc57-478c-8376-fddbf3233cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:22.468814 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d1ea6-dc57-478c-8376-fddbf3233cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:22.469095 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d1ea6-dc57-478c-8376-fddbf3233cc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:22.469846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d1ea6-dc57-478c-8376-fddbf3233cc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:22.470153 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d1ea6-dc57-478c-8376-fddbf3233cc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:22.471570 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d1ea6-dc57-478c-8376-fddbf3233cc9 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:22.480475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 50/101] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:22.485831 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab748abe-0fe2-406e-a819-a7968394a90b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:22.508492 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f1d56-b321-4b60-a175-388e8f29b07d None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:22.508795 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f1d56-b321-4b60-a175-388e8f29b07d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:22.509061 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f1d56-b321-4b60-a175-388e8f29b07d None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:22.510525 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 51/102] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:54:22.516691 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b912fa-b928-4eee-a8fc-57049478c4f9 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:22.516939 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b912fa-b928-4eee-a8fc-57049478c4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:22.517154 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b912fa-b928-4eee-a8fc-57049478c4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:22.548259 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-46b912fa-b928-4eee-a8fc-57049478c4f9 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:22.551502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-46b912fa-b928-4eee-a8fc-57049478c4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:22.702789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab748abe-0fe2-406e-a819-a7968394a90b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:22.755778 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 52/103] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:54:22.781719 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a235172-5d1f-44d6-9b9f-a5b1727e40e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:22.783010 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a235172-5d1f-44d6-9b9f-a5b1727e40e6 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:22.783511 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a235172-5d1f-44d6-9b9f-a5b1727e40e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:22.784074 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a235172-5d1f-44d6-9b9f-a5b1727e40e6 None admin] PATH_INFO: `/v3/users/4f4a8278e3e04f37a60d10d95e900321` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:22.789269 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b912fa-b928-4eee-a8fc-57049478c4f9 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:22.793987 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a235172-5d1f-44d6-9b9f-a5b1727e40e6 None admin] RBAC: Authorizing `identity:get_user(user_id=4f4a8278e3e04f37a60d10d95e900321)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:22.800672 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a235172-5d1f-44d6-9b9f-a5b1727e40e6 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:22.807258 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 52/104] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:22 2022] GET /identity/v3/users/4f4a8278e3e04f37a60d10d95e900321 => generated 247 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:22.815513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a235172-5d1f-44d6-9b9f-a5b1727e40e6 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:22.845506 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:22.935697 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:22.981616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b912fa-b928-4eee-a8fc-57049478c4f9 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:23.025688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a235172-5d1f-44d6-9b9f-a5b1727e40e6 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:23.057521 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3d920-dec9-4ca4-bbfb-cd8a16a8daa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:23.059147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3d920-dec9-4ca4-bbfb-cd8a16a8daa3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:23.059746 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3d920-dec9-4ca4-bbfb-cd8a16a8daa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:23.060222 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3d920-dec9-4ca4-bbfb-cd8a16a8daa3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:23.071931 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121dfea2-03f7-46aa-9070-590a27738e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:23.074003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121dfea2-03f7-46aa-9070-590a27738e8b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:23.074297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121dfea2-03f7-46aa-9070-590a27738e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:23.075137 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121dfea2-03f7-46aa-9070-590a27738e8b None admin] PATH_INFO: `/v3/projects/05ae476a690b4d899f0bd474f195f9ea` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:23.078845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121dfea2-03f7-46aa-9070-590a27738e8b None admin] RBAC: Authorizing `identity:get_project(project_id=05ae476a690b4d899f0bd474f195f9ea)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:23.080339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121dfea2-03f7-46aa-9070-590a27738e8b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:23.082122 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 53/105] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:22 2022] GET /identity/v3/projects/05ae476a690b4d899f0bd474f195f9ea => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:23.085541 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3d920-dec9-4ca4-bbfb-cd8a16a8daa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:23.088672 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121dfea2-03f7-46aa-9070-590a27738e8b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:23.101121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-5ae3d920-dec9-4ca4-bbfb-cd8a16a8daa3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:23.101121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:23.101121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:23.101121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:23.101121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:23.101121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:23.101121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:23.101121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:23.101121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:23.101121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:23.101121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:23.101121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:23.101121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:23.101121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:23.101121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:23.101121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:23.102146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:23.102146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:23.102146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:23.102146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:23.102146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:23.102146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:23.102146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:23.102146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:23.102146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:23.102146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:23.102146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:23.102146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:23.102146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:23.102146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:23.102146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:23.102146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:23.102946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:23.102946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:23.102946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:23.102946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:23.102946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:23.102946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:23.102946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:23.102946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:23.102946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:23.102946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:23.102946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:23.102946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:54:23.106622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 53/106] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:54:23.108644 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b031d-0991-44f8-a7c2-8e6c7d2df4b6 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:23.109459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b031d-0991-44f8-a7c2-8e6c7d2df4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:23.109960 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b031d-0991-44f8-a7c2-8e6c7d2df4b6 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:23.111763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 54/107] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:23.112989 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b031d-0991-44f8-a7c2-8e6c7d2df4b6 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:23.209400 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121dfea2-03f7-46aa-9070-590a27738e8b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:23.211009 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:23.230869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b031d-0991-44f8-a7c2-8e6c7d2df4b6 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:23.255260 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:23.280831 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df48c41-eee2-44ae-8c95-5c6649cefd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:23.281742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df48c41-eee2-44ae-8c95-5c6649cefd6c None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:23.282034 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df48c41-eee2-44ae-8c95-5c6649cefd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:23.282313 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df48c41-eee2-44ae-8c95-5c6649cefd6c None admin] PATH_INFO: `/v3/projects/05ae476a690b4d899f0bd474f195f9ea/users/4f4a8278e3e04f37a60d10d95e900321/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:23.283005 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e71b5-2568-492f-ae60-fe139454c386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:23.283991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e71b5-2568-492f-ae60-fe139454c386 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:23.284524 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e71b5-2568-492f-ae60-fe139454c386 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:23.285003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e71b5-2568-492f-ae60-fe139454c386 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:23.285985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e71b5-2568-492f-ae60-fe139454c386 None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:23.286585 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e71b5-2568-492f-ae60-fe139454c386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:23.287944 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df48c41-eee2-44ae-8c95-5c6649cefd6c None admin] RBAC: Authorizing `identity:create_grant(project_id=05ae476a690b4d899f0bd474f195f9ea, user_id=4f4a8278e3e04f37a60d10d95e900321, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:23.288594 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e71b5-2568-492f-ae60-fe139454c386 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:23.289434 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df48c41-eee2-44ae-8c95-5c6649cefd6c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:23.301114 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 55/108] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:54:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:23.303193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa625a-8119-47d9-8af3-9f2bda805545 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:23.303717 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa625a-8119-47d9-8af3-9f2bda805545 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:23.304303 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa625a-8119-47d9-8af3-9f2bda805545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:23.319654 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 54/109] 10.222.0.79 () {58 vars in 1439 bytes} [Thu Jul 14 11:54:23 2022] PUT /identity/v3/projects/05ae476a690b4d899f0bd474f195f9ea/users/4f4a8278e3e04f37a60d10d95e900321/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:54:23.324392 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-13aa625a-8119-47d9-8af3-9f2bda805545 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:23.326067 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-13aa625a-8119-47d9-8af3-9f2bda805545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:23.327091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df48c41-eee2-44ae-8c95-5c6649cefd6c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:23.410049 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 56/110] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:23.497713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa625a-8119-47d9-8af3-9f2bda805545 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:23.537131 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df48c41-eee2-44ae-8c95-5c6649cefd6c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:23.581037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72acb2f-6bda-44cd-997a-8d980ce6e2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:23.582248 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72acb2f-6bda-44cd-997a-8d980ce6e2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:23.582830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72acb2f-6bda-44cd-997a-8d980ce6e2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:23.583424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72acb2f-6bda-44cd-997a-8d980ce6e2c8 None admin] PATH_INFO: `/v3/users/5786c5828f214152a6e9a90fca93504e` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:23.585006 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72acb2f-6bda-44cd-997a-8d980ce6e2c8 None admin] RBAC: Authorizing `identity:get_user(user_id=5786c5828f214152a6e9a90fca93504e)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:23.586756 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72acb2f-6bda-44cd-997a-8d980ce6e2c8 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:23.588906 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 55/111] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:23 2022] GET /identity/v3/users/5786c5828f214152a6e9a90fca93504e => generated 275 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:23.620645 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72acb2f-6bda-44cd-997a-8d980ce6e2c8 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:23.637784 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:23.669634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa625a-8119-47d9-8af3-9f2bda805545 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:23.684714 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:23.709697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7df1db-1267-4ed9-8543-2b5eead95952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:23.710703 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7df1db-1267-4ed9-8543-2b5eead95952 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:23.710999 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7df1db-1267-4ed9-8543-2b5eead95952 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:23.711283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7df1db-1267-4ed9-8543-2b5eead95952 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:23.723751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7df1db-1267-4ed9-8543-2b5eead95952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:23.735902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-df7df1db-1267-4ed9-8543-2b5eead95952 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:54:23.735902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:23.735902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:23.735902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:23.735902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:23.735902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:23.735902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:23.735902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:23.735902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:23.735902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:23.735902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:23.735902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:23.735902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:23.735902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:23.735902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:23.735902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:23.736977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:23.736977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:23.736977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:23.736977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:23.736977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:23.736977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:23.736977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:23.736977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:23.736977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:23.736977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:23.736977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:23.736977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:23.736977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:23.736977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:23.736977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:23.736977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:23.737792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:23.737792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:23.737792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:23.737792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:23.737792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:23.737792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:23.737792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:23.737792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:23.737792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:23.737792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:23.737792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:54:23.737792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:54:23.737792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 57/112] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Jul 14 11:54:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:23.738478 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3472d4b-29e4-44d7-9ff3-ee99f8e4d872 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:23.738745 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3472d4b-29e4-44d7-9ff3-ee99f8e4d872 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:23.739030 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3472d4b-29e4-44d7-9ff3-ee99f8e4d872 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:23.740468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 58/113] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:23.744503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40056371-6a5f-4a84-b4d6-3f016c8a0e96 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:23.744503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40056371-6a5f-4a84-b4d6-3f016c8a0e96 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:23.744503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40056371-6a5f-4a84-b4d6-3f016c8a0e96 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:23.744503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 59/114] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:23.744503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad409cd-c64f-4474-ba6e-9148c4550d56 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:23.744921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad409cd-c64f-4474-ba6e-9148c4550d56 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:23.744921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad409cd-c64f-4474-ba6e-9148c4550d56 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:23.746121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 60/115] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:23.750873 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad409cd-c64f-4474-ba6e-9148c4550d56 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:23.751852 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72acb2f-6bda-44cd-997a-8d980ce6e2c8 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:23.793629 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50287c4e-5416-4334-9f26-7c13b8a6d126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:23.794508 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50287c4e-5416-4334-9f26-7c13b8a6d126 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:23.794822 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50287c4e-5416-4334-9f26-7c13b8a6d126 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:23.795108 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50287c4e-5416-4334-9f26-7c13b8a6d126 None admin] PATH_INFO: `/v3/projects/05ae476a690b4d899f0bd474f195f9ea` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:23.796337 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50287c4e-5416-4334-9f26-7c13b8a6d126 None admin] RBAC: Authorizing `identity:get_project(project_id=05ae476a690b4d899f0bd474f195f9ea)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:23.797829 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50287c4e-5416-4334-9f26-7c13b8a6d126 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:23.804384 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 56/116] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:23 2022] GET /identity/v3/projects/05ae476a690b4d899f0bd474f195f9ea => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:23.804384 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43000647-9c9e-4d63-b4ae-0eb06fd445c5 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:23.804384 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43000647-9c9e-4d63-b4ae-0eb06fd445c5 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:23.804384 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43000647-9c9e-4d63-b4ae-0eb06fd445c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:23.820040 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-43000647-9c9e-4d63-b4ae-0eb06fd445c5 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:23.821261 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-43000647-9c9e-4d63-b4ae-0eb06fd445c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:23.872393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad409cd-c64f-4474-ba6e-9148c4550d56 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:23.902531 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 57/117] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:23.902531 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7c098-66a0-4d8f-9d03-632223a0b10d None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:23.902531 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7c098-66a0-4d8f-9d03-632223a0b10d None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:23.902531 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7c098-66a0-4d8f-9d03-632223a0b10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:23.913972 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4d044-aeb9-4d54-a4ad-d0e0248c13cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:23.914787 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4d044-aeb9-4d54-a4ad-d0e0248c13cd None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:23.915075 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4d044-aeb9-4d54-a4ad-d0e0248c13cd None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:23.915381 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4d044-aeb9-4d54-a4ad-d0e0248c13cd None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:23.916143 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4d044-aeb9-4d54-a4ad-d0e0248c13cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:23.916463 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4d044-aeb9-4d54-a4ad-d0e0248c13cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:23.917855 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4d044-aeb9-4d54-a4ad-d0e0248c13cd None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:23.920754 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:23.928151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 61/118] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:54:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:23.929436 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c2936-fe16-41f4-91fb-9b061b0b324c None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:23.929734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c2936-fe16-41f4-91fb-9b061b0b324c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:23.930017 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c2936-fe16-41f4-91fb-9b061b0b324c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:23.935045 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-31b7c098-66a0-4d8f-9d03-632223a0b10d None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:23.936968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-31b7c098-66a0-4d8f-9d03-632223a0b10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:23.954855 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3a4c2936-fe16-41f4-91fb-9b061b0b324c None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:23.956351 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3a4c2936-fe16-41f4-91fb-9b061b0b324c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:23.990540 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:24.022523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 58/119] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:24.022523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7c098-66a0-4d8f-9d03-632223a0b10d None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:24.047604 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 62/120] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:24.048854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c2936-fe16-41f4-91fb-9b061b0b324c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:24.129649 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7c098-66a0-4d8f-9d03-632223a0b10d None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:24.163942 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6877f9-9fca-4605-8b3e-314382355821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:24.164835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6877f9-9fca-4605-8b3e-314382355821 None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:24.165121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6877f9-9fca-4605-8b3e-314382355821 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:24.165398 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6877f9-9fca-4605-8b3e-314382355821 None admin] PATH_INFO: `/v3/projects/05ae476a690b4d899f0bd474f195f9ea/users/5786c5828f214152a6e9a90fca93504e/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:24.167411 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6877f9-9fca-4605-8b3e-314382355821 None admin] RBAC: Authorizing `identity:create_grant(project_id=05ae476a690b4d899f0bd474f195f9ea, user_id=5786c5828f214152a6e9a90fca93504e, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:24.169549 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6877f9-9fca-4605-8b3e-314382355821 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:24.170468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c2936-fe16-41f4-91fb-9b061b0b324c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:24.184253 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 59/121] 10.222.0.79 () {58 vars in 1439 bytes} [Thu Jul 14 11:54:24 2022] PUT /identity/v3/projects/05ae476a690b4d899f0bd474f195f9ea/users/5786c5828f214152a6e9a90fca93504e/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:54:24.191677 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6877f9-9fca-4605-8b3e-314382355821 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:24.208618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:24.221808 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8cf50-5fe0-47e3-8bca-75b3776e5d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:24.222730 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8cf50-5fe0-47e3-8bca-75b3776e5d70 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:24.223030 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8cf50-5fe0-47e3-8bca-75b3776e5d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:24.223307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8cf50-5fe0-47e3-8bca-75b3776e5d70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:24.239327 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8cf50-5fe0-47e3-8bca-75b3776e5d70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:24.250346 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-bfd8cf50-5fe0-47e3-8bca-75b3776e5d70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:24.250346 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:24.250346 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:24.250346 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:24.250346 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:24.250346 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:24.250346 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:24.250346 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:24.250346 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:24.250346 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:24.250346 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:24.250346 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:24.250346 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:24.250346 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:24.250346 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:24.250346 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:24.251313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:24.251313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:24.251313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:24.251313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:24.251313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:24.251313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:24.251313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:24.251313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:24.251313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:24.251313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:24.251313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:24.251313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:24.251313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:24.251313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:24.251313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:24.251313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:24.252788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:24.252788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:24.252788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:24.252788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:24.252788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:24.252788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:24.252788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:24.252788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:24.252788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:24.252788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:24.252788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:24.252788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:54:24.252788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 63/122] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:24.252788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8cf50-5fe0-47e3-8bca-75b3776e5d70 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:24.268370 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:24.342520 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6877f9-9fca-4605-8b3e-314382355821 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:24.379166 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155d890-dc46-4c50-993a-00788bacf947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:24.379603 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8cf50-5fe0-47e3-8bca-75b3776e5d70 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:24.380113 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155d890-dc46-4c50-993a-00788bacf947 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:24.380340 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155d890-dc46-4c50-993a-00788bacf947 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:24.380624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155d890-dc46-4c50-993a-00788bacf947 None admin] PATH_INFO: `/v3/users/5786c5828f214152a6e9a90fca93504e` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:24.381866 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155d890-dc46-4c50-993a-00788bacf947 None admin] RBAC: Authorizing `identity:get_user(user_id=5786c5828f214152a6e9a90fca93504e)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:24.384307 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155d890-dc46-4c50-993a-00788bacf947 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:24.385037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 60/123] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:24 2022] GET /identity/v3/users/5786c5828f214152a6e9a90fca93504e => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:24.385827 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155d890-dc46-4c50-993a-00788bacf947 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:24.420883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dc447-f1f0-4118-8b69-c31a84b43bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:24.422161 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dc447-f1f0-4118-8b69-c31a84b43bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:24.422706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dc447-f1f0-4118-8b69-c31a84b43bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:24.423191 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dc447-f1f0-4118-8b69-c31a84b43bc3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:24.424670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247dc447-f1f0-4118-8b69-c31a84b43bc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:24.426440 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247dc447-f1f0-4118-8b69-c31a84b43bc3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:24.428667 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 64/124] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:54:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:24.429828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dc447-f1f0-4118-8b69-c31a84b43bc3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:24.491969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:24.503378 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155d890-dc46-4c50-993a-00788bacf947 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:24.513388 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:24.542991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dc447-f1f0-4118-8b69-c31a84b43bc3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:24.543868 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da84788-d25d-418d-a37e-59763681267c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:24.544696 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da84788-d25d-418d-a37e-59763681267c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:24.544988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da84788-d25d-418d-a37e-59763681267c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:24.545266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da84788-d25d-418d-a37e-59763681267c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:24.557292 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da84788-d25d-418d-a37e-59763681267c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:24.566014 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-7da84788-d25d-418d-a37e-59763681267c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:54:24.566014 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:24.566014 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:24.566014 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:24.566014 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:24.566014 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:24.566014 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:24.566014 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:24.566014 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:24.566014 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:24.566014 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:24.566014 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:24.566014 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:24.566014 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:24.566014 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:24.566014 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:24.566934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:24.566934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:24.566934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:24.566934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:24.566934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:24.566934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:24.566934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:24.566934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:24.566934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:24.566934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:24.566934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:24.566934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:24.566934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:24.566934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:24.566934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:24.566934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:24.568163 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:24.568163 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:24.568163 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:24.568163 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:24.568163 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:24.568163 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:24.568163 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:24.568163 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:24.568163 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:24.568163 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:24.568163 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:54:24.568163 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:54:24.568163 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 61/125] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:24.568163 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da84788-d25d-418d-a37e-59763681267c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:24.586979 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556ab47-314b-4a26-bf44-d6da6838aa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:24.588132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556ab47-314b-4a26-bf44-d6da6838aa91 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:24.588623 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556ab47-314b-4a26-bf44-d6da6838aa91 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:24.589113 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556ab47-314b-4a26-bf44-d6da6838aa91 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:24.590078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556ab47-314b-4a26-bf44-d6da6838aa91 None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:24.590658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556ab47-314b-4a26-bf44-d6da6838aa91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:24.592269 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556ab47-314b-4a26-bf44-d6da6838aa91 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:24.601747 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 65/126] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:54:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:24.603086 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556ab47-314b-4a26-bf44-d6da6838aa91 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:24.685377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da84788-d25d-418d-a37e-59763681267c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:24.716355 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556ab47-314b-4a26-bf44-d6da6838aa91 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:24.723740 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef840b-c7a3-4b5a-9154-7af420011b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:24.724620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef840b-c7a3-4b5a-9154-7af420011b23 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:24.724913 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef840b-c7a3-4b5a-9154-7af420011b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:24.725206 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef840b-c7a3-4b5a-9154-7af420011b23 None admin] PATH_INFO: `/v3/projects/05ae476a690b4d899f0bd474f195f9ea` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:24.726785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef840b-c7a3-4b5a-9154-7af420011b23 None admin] RBAC: Authorizing `identity:get_project(project_id=05ae476a690b4d899f0bd474f195f9ea)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:24.728068 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef840b-c7a3-4b5a-9154-7af420011b23 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:24.730044 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 62/127] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:24 2022] GET /identity/v3/projects/05ae476a690b4d899f0bd474f195f9ea => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:24.731515 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef840b-c7a3-4b5a-9154-7af420011b23 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:24.739140 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:24.759761 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba34c86-8eac-4123-8fb0-e6320d16bac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:24.760825 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba34c86-8eac-4123-8fb0-e6320d16bac5 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:24.761370 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba34c86-8eac-4123-8fb0-e6320d16bac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:24.761871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba34c86-8eac-4123-8fb0-e6320d16bac5 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:24.762916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba34c86-8eac-4123-8fb0-e6320d16bac5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:24.764613 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba34c86-8eac-4123-8fb0-e6320d16bac5 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:24.773147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:24.795913 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 66/128] 10.222.0.79 () {60 vars in 1141 bytes} [Thu Jul 14 11:54:24 2022] POST /identity/v3/projects => generated 302 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:54:24.797416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba34c86-8eac-4123-8fb0-e6320d16bac5 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:24.852680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef840b-c7a3-4b5a-9154-7af420011b23 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:24.891607 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1a557-2880-441a-a431-34abcdc70bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:24.892739 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1a557-2880-441a-a431-34abcdc70bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:24.892739 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1a557-2880-441a-a431-34abcdc70bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:24.893033 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1a557-2880-441a-a431-34abcdc70bb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:24.893765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1a557-2880-441a-a431-34abcdc70bb5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:24.894090 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1a557-2880-441a-a431-34abcdc70bb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:24.896152 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1a557-2880-441a-a431-34abcdc70bb5 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:24.905770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 63/129] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:54:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:24.906567 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1a557-2880-441a-a431-34abcdc70bb5 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:24.931832 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba34c86-8eac-4123-8fb0-e6320d16bac5 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:24.974370 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba26974-f6d7-44f0-98b8-f05e02564611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:24.975772 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba26974-f6d7-44f0-98b8-f05e02564611 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:24.976287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba26974-f6d7-44f0-98b8-f05e02564611 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:24.976815 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba26974-f6d7-44f0-98b8-f05e02564611 None admin] PATH_INFO: `/v3/users/5786c5828f214152a6e9a90fca93504e` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:24.980575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba26974-f6d7-44f0-98b8-f05e02564611 None admin] RBAC: Authorizing `identity:get_user(user_id=5786c5828f214152a6e9a90fca93504e)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:24.984013 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba26974-f6d7-44f0-98b8-f05e02564611 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:24.986258 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 67/130] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:24 2022] GET /identity/v3/users/5786c5828f214152a6e9a90fca93504e => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:24.988569 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba26974-f6d7-44f0-98b8-f05e02564611 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:25.058913 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:25.068328 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:25.077366 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1a557-2880-441a-a431-34abcdc70bb5 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:25.125198 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae3c1e-4597-49fa-87e6-83db6b4cc14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:25.127252 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae3c1e-4597-49fa-87e6-83db6b4cc14c None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:25.127767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae3c1e-4597-49fa-87e6-83db6b4cc14c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:25.128515 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae3c1e-4597-49fa-87e6-83db6b4cc14c None admin] PATH_INFO: `/v3/projects/05ae476a690b4d899f0bd474f195f9ea/users/5786c5828f214152a6e9a90fca93504e/roles/986e347cbb9e43e7a49dfef9be8ec9dd` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:25.132435 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae3c1e-4597-49fa-87e6-83db6b4cc14c None admin] RBAC: Authorizing `identity:create_grant(project_id=05ae476a690b4d899f0bd474f195f9ea, user_id=5786c5828f214152a6e9a90fca93504e, role_id=986e347cbb9e43e7a49dfef9be8ec9dd)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:25.134580 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae3c1e-4597-49fa-87e6-83db6b4cc14c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:25.135016 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba26974-f6d7-44f0-98b8-f05e02564611 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:25.156035 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 64/131] 10.222.0.79 () {58 vars in 1439 bytes} [Thu Jul 14 11:54:24 2022] PUT /identity/v3/projects/05ae476a690b4d899f0bd474f195f9ea/users/5786c5828f214152a6e9a90fca93504e/roles/986e347cbb9e43e7a49dfef9be8ec9dd => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:54:25.157972 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae3c1e-4597-49fa-87e6-83db6b4cc14c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:25.182319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a9c0c-00ac-47b9-8d0a-93d25832e1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:25.185133 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a9c0c-00ac-47b9-8d0a-93d25832e1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:25.185296 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a9c0c-00ac-47b9-8d0a-93d25832e1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:25.185605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a9c0c-00ac-47b9-8d0a-93d25832e1e3 None admin] PATH_INFO: `/v3/users/e2e8c28d33f54e8cbf59231cde95e27c` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:25.204395 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a9c0c-00ac-47b9-8d0a-93d25832e1e3 None admin] RBAC: Authorizing `identity:get_user(user_id=e2e8c28d33f54e8cbf59231cde95e27c)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:25.206011 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a9c0c-00ac-47b9-8d0a-93d25832e1e3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:25.208544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 68/132] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:24 2022] GET /identity/v3/users/e2e8c28d33f54e8cbf59231cde95e27c => generated 289 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:25.214348 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a9c0c-00ac-47b9-8d0a-93d25832e1e3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:25.304873 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae3c1e-4597-49fa-87e6-83db6b4cc14c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:25.350946 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac997ba-140f-44bc-a43e-36ddcbe03b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:25.352234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac997ba-140f-44bc-a43e-36ddcbe03b77 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:25.352731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac997ba-140f-44bc-a43e-36ddcbe03b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:25.353224 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac997ba-140f-44bc-a43e-36ddcbe03b77 None admin] PATH_INFO: `/v3/projects/a857274b837347e4b25e6735c7f958ae` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:25.354722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac997ba-140f-44bc-a43e-36ddcbe03b77 None admin] RBAC: Authorizing `identity:get_project(project_id=a857274b837347e4b25e6735c7f958ae)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:25.357160 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac997ba-140f-44bc-a43e-36ddcbe03b77 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:25.360224 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 65/133] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:25 2022] GET /identity/v3/projects/a857274b837347e4b25e6735c7f958ae => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:25.369264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac997ba-140f-44bc-a43e-36ddcbe03b77 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:25.428077 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:25.434354 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:25.458288 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a9c0c-00ac-47b9-8d0a-93d25832e1e3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:25.550634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cdc53b-8950-40fd-bf1f-960eb44f7c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:25.552963 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdc53b-8950-40fd-bf1f-960eb44f7c8b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:25.553372 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdc53b-8950-40fd-bf1f-960eb44f7c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:25.555538 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdc53b-8950-40fd-bf1f-960eb44f7c8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:25.558331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac997ba-140f-44bc-a43e-36ddcbe03b77 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:25.638351 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b5900-763a-4dfa-9772-9d32146a3027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:25.639440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b5900-763a-4dfa-9772-9d32146a3027 None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:25.639888 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b5900-763a-4dfa-9772-9d32146a3027 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:25.640181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b5900-763a-4dfa-9772-9d32146a3027 None admin] PATH_INFO: `/v3/projects/a857274b837347e4b25e6735c7f958ae/users/5786c5828f214152a6e9a90fca93504e/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:25.644447 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b5900-763a-4dfa-9772-9d32146a3027 None admin] RBAC: Authorizing `identity:create_grant(project_id=a857274b837347e4b25e6735c7f958ae, user_id=5786c5828f214152a6e9a90fca93504e, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:25.645931 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b5900-763a-4dfa-9772-9d32146a3027 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:25.671186 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 66/134] 10.222.0.79 () {58 vars in 1439 bytes} [Thu Jul 14 11:54:25 2022] PUT /identity/v3/projects/a857274b837347e4b25e6735c7f958ae/users/5786c5828f214152a6e9a90fca93504e/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:54:25.701099 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cdc53b-8950-40fd-bf1f-960eb44f7c8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:25.702632 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cdc53b-8950-40fd-bf1f-960eb44f7c8b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:25.873687 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:25.884897 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 69/135] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:54:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:25.891008 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b5900-763a-4dfa-9772-9d32146a3027 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:25.991931 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:26.010671 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b5900-763a-4dfa-9772-9d32146a3027 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:26.062346 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c11fee-8986-4901-9c86-6554ae3d030b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:26.063261 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c11fee-8986-4901-9c86-6554ae3d030b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:26.063556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c11fee-8986-4901-9c86-6554ae3d030b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:26.063843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c11fee-8986-4901-9c86-6554ae3d030b None admin] PATH_INFO: `/v3/projects/05ae476a690b4d899f0bd474f195f9ea` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:26.067299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c11fee-8986-4901-9c86-6554ae3d030b None admin] RBAC: Authorizing `identity:get_project(project_id=05ae476a690b4d899f0bd474f195f9ea)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:26.069004 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c11fee-8986-4901-9c86-6554ae3d030b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:26.071787 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 67/136] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:25 2022] GET /identity/v3/projects/05ae476a690b4d899f0bd474f195f9ea => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:26.079080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cdc53b-8950-40fd-bf1f-960eb44f7c8b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:26.190736 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cdc53b-8950-40fd-bf1f-960eb44f7c8b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:26.227095 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7288ce0-6734-4ae0-8ab8-020f2f5515cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:26.227790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7288ce0-6734-4ae0-8ab8-020f2f5515cc None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:26.228092 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7288ce0-6734-4ae0-8ab8-020f2f5515cc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:26.228383 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7288ce0-6734-4ae0-8ab8-020f2f5515cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:26.229256 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7288ce0-6734-4ae0-8ab8-020f2f5515cc None admin] RBAC: Adding query filter params (role.id=78a510490d1e423c89a3b430c8530483, scope.project.id=05ae476a690b4d899f0bd474f195f9ea, user.id=e2e8c28d33f54e8cbf59231cde95e27c) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:26.229585 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7288ce0-6734-4ae0-8ab8-020f2f5515cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:26.231143 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7288ce0-6734-4ae0-8ab8-020f2f5515cc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:26.237594 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 70/137] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:54:26 2022] GET /identity/v3/role_assignments?user.id=e2e8c28d33f54e8cbf59231cde95e27c&scope.project.id=05ae476a690b4d899f0bd474f195f9ea&role.id=78a510490d1e423c89a3b430c8530483 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:26.304936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60028b6d-40ed-4b30-ab54-0fa28ac337e8 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:26.305574 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60028b6d-40ed-4b30-ab54-0fa28ac337e8 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:26.306067 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60028b6d-40ed-4b30-ab54-0fa28ac337e8 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:26.308113 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 68/138] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:26.322630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cda2a-d5ee-4469-b4a9-024f4a2e31ce None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:26.322968 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cda2a-d5ee-4469-b4a9-024f4a2e31ce None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:26.323217 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cda2a-d5ee-4469-b4a9-024f4a2e31ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:26.345377 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-7e4cda2a-d5ee-4469-b4a9-024f4a2e31ce None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:26.346632 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7e4cda2a-d5ee-4469-b4a9-024f4a2e31ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:26.430854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:26.453429 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 71/139] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:26.511050 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60028b6d-40ed-4b30-ab54-0fa28ac337e8 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:26.659286 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60028b6d-40ed-4b30-ab54-0fa28ac337e8 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:26.703971 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1640ba3-f6bb-401d-8282-a8256a1aca18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:26.704791 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1640ba3-f6bb-401d-8282-a8256a1aca18 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:26.705154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1640ba3-f6bb-401d-8282-a8256a1aca18 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:26.705502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1640ba3-f6bb-401d-8282-a8256a1aca18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:26.722600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1640ba3-f6bb-401d-8282-a8256a1aca18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:26.730414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-b1640ba3-f6bb-401d-8282-a8256a1aca18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:54:26.730414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:26.730414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:26.730414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:26.730414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:26.730414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:26.730414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:26.730414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:26.730414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:26.730414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:26.730414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:26.730414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:26.730414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:26.730414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:26.730414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:26.730414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:26.731545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:26.731545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:26.731545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:26.731545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:26.731545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:26.731545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:26.731545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:26.731545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:26.731545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:26.731545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:26.731545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:26.731545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:26.731545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:26.731545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:26.731545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:26.731545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:26.732485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:26.732485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:26.732485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:26.732485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:26.732485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:26.732485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:26.732485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:26.732485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:26.732485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:26.732485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:26.732485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:54:26.732485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:54:26.733781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 69/140] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:54:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:26.739677 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cda2a-d5ee-4469-b4a9-024f4a2e31ce None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:26.844885 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cda2a-d5ee-4469-b4a9-024f4a2e31ce None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:26.882311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a5d98-aad1-45c2-ab28-6bc1bd10c189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:26.883193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a5d98-aad1-45c2-ab28-6bc1bd10c189 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:26.883584 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a5d98-aad1-45c2-ab28-6bc1bd10c189 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:26.883970 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a5d98-aad1-45c2-ab28-6bc1bd10c189 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:26.884853 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a5d98-aad1-45c2-ab28-6bc1bd10c189 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:26.885272 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a5d98-aad1-45c2-ab28-6bc1bd10c189 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:26.886869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a5d98-aad1-45c2-ab28-6bc1bd10c189 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:26.896625 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 72/141] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:26.904903 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1640ba3-f6bb-401d-8282-a8256a1aca18 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:26.952313 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:27.052165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3739ba6-637a-4250-9d28-69030fd32f44 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:27.052704 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3739ba6-637a-4250-9d28-69030fd32f44 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:27.052943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3739ba6-637a-4250-9d28-69030fd32f44 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:27.054304 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 73/142] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:54:27.060765 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e299dc-0693-47e9-affa-9287c5045fd3 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:27.061063 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e299dc-0693-47e9-affa-9287c5045fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:27.061348 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e299dc-0693-47e9-affa-9287c5045fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:27.087642 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-71e299dc-0693-47e9-affa-9287c5045fd3 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:27.088877 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-71e299dc-0693-47e9-affa-9287c5045fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:27.138259 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1640ba3-f6bb-401d-8282-a8256a1aca18 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:27.182113 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:27.213593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8d265-4770-421d-97a3-f7ed11cdfd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:27.214952 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8d265-4770-421d-97a3-f7ed11cdfd0c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:27.215972 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8d265-4770-421d-97a3-f7ed11cdfd0c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:27.216455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8d265-4770-421d-97a3-f7ed11cdfd0c None admin] PATH_INFO: `/v3/users/4f4a8278e3e04f37a60d10d95e900321` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:27.217916 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8d265-4770-421d-97a3-f7ed11cdfd0c None admin] RBAC: Authorizing `identity:get_user(user_id=4f4a8278e3e04f37a60d10d95e900321)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:27.220046 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8d265-4770-421d-97a3-f7ed11cdfd0c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:27.221983 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 70/143] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:26 2022] GET /identity/v3/users/4f4a8278e3e04f37a60d10d95e900321 => generated 247 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:27.228045 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8d265-4770-421d-97a3-f7ed11cdfd0c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:27.265190 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 74/144] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:27.342157 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:27.364851 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8d265-4770-421d-97a3-f7ed11cdfd0c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:27.376791 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e299dc-0693-47e9-affa-9287c5045fd3 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:27.410211 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935bc4d6-f97f-4453-81ed-c0ea27fbcce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:27.411285 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bc4d6-f97f-4453-81ed-c0ea27fbcce3 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:27.411779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bc4d6-f97f-4453-81ed-c0ea27fbcce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:27.412358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bc4d6-f97f-4453-81ed-c0ea27fbcce3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:27.485299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935bc4d6-f97f-4453-81ed-c0ea27fbcce3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:27.487234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935bc4d6-f97f-4453-81ed-c0ea27fbcce3 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:27.510357 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e299dc-0693-47e9-affa-9287c5045fd3 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:27.548639 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fc064-8d3f-4fe7-b396-e5e910b16bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:27.549451 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fc064-8d3f-4fe7-b396-e5e910b16bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:27.549741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fc064-8d3f-4fe7-b396-e5e910b16bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:27.550021 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fc064-8d3f-4fe7-b396-e5e910b16bd3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:27.562354 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9fc064-8d3f-4fe7-b396-e5e910b16bd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:27.570797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-da9fc064-8d3f-4fe7-b396-e5e910b16bd3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:27.570797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:27.570797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:27.570797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:27.570797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:27.570797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:27.570797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:27.570797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:27.570797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:27.570797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:27.570797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:27.570797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:27.570797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:27.570797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:27.570797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:27.570797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:27.571692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:27.571692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:27.571692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:27.571692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:27.571692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:27.571692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:27.571692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:27.571692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:27.571692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:27.571692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:27.571692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:27.571692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:27.571692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:27.571692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:27.571692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:27.571692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:27.572445 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:27.572445 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:27.572445 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:27.572445 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:27.572445 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:27.572445 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:27.572445 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:27.572445 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:27.572445 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:27.572445 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:27.572445 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:27.572445 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:54:27.572445 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 75/145] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:27.580649 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:27.583384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fc064-8d3f-4fe7-b396-e5e910b16bd3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:27.601286 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 71/146] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:54:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:27.607250 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935bc4d6-f97f-4453-81ed-c0ea27fbcce3 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:27.655088 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:27.731810 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935bc4d6-f97f-4453-81ed-c0ea27fbcce3 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:27.734895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fc064-8d3f-4fe7-b396-e5e910b16bd3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:27.772401 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dca9da-14ab-4ab1-b386-63bf5b2bfd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:27.773292 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dca9da-14ab-4ab1-b386-63bf5b2bfd38 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:27.773725 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dca9da-14ab-4ab1-b386-63bf5b2bfd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:27.774168 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dca9da-14ab-4ab1-b386-63bf5b2bfd38 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:27.775233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dca9da-14ab-4ab1-b386-63bf5b2bfd38 None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:27.775745 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dca9da-14ab-4ab1-b386-63bf5b2bfd38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:27.777253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dca9da-14ab-4ab1-b386-63bf5b2bfd38 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:27.787402 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 76/147] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:54:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:27.795510 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230e42c-c7c7-482c-96b8-fca6eddd00be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:27.796032 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dca9da-14ab-4ab1-b386-63bf5b2bfd38 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:27.796659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230e42c-c7c7-482c-96b8-fca6eddd00be None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:27.797053 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230e42c-c7c7-482c-96b8-fca6eddd00be None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:27.797438 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230e42c-c7c7-482c-96b8-fca6eddd00be None admin] PATH_INFO: `/v3/projects/05ae476a690b4d899f0bd474f195f9ea` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:27.798832 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230e42c-c7c7-482c-96b8-fca6eddd00be None admin] RBAC: Authorizing `identity:get_project(project_id=05ae476a690b4d899f0bd474f195f9ea)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:27.800474 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230e42c-c7c7-482c-96b8-fca6eddd00be None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:27.806515 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 72/148] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:27 2022] GET /identity/v3/projects/05ae476a690b4d899f0bd474f195f9ea => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:27.809937 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230e42c-c7c7-482c-96b8-fca6eddd00be None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:27.868820 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:27.917630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230e42c-c7c7-482c-96b8-fca6eddd00be None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:27.954385 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f503f3-513b-4fe1-88a5-bb497ad792c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:27.955271 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f503f3-513b-4fe1-88a5-bb497ad792c9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:27.955664 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f503f3-513b-4fe1-88a5-bb497ad792c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:27.956051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f503f3-513b-4fe1-88a5-bb497ad792c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:27.957007 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f503f3-513b-4fe1-88a5-bb497ad792c9 None admin] RBAC: Adding query filter params (role.id=eff4f9bbb7064bc1a0f9fc55a05fea51, scope.project.id=05ae476a690b4d899f0bd474f195f9ea, user.id=4f4a8278e3e04f37a60d10d95e900321) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:27.957435 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f503f3-513b-4fe1-88a5-bb497ad792c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:27.959078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f503f3-513b-4fe1-88a5-bb497ad792c9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:27.965957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 73/149] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:54:27 2022] GET /identity/v3/role_assignments?user.id=4f4a8278e3e04f37a60d10d95e900321&scope.project.id=05ae476a690b4d899f0bd474f195f9ea&role.id=eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:27.977817 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dca9da-14ab-4ab1-b386-63bf5b2bfd38 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:27.986969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:28.019173 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2928f-d70d-4ae0-ba81-ed4bebc125d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:28.020087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2928f-d70d-4ae0-ba81-ed4bebc125d7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:28.020373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2928f-d70d-4ae0-ba81-ed4bebc125d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:28.020654 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2928f-d70d-4ae0-ba81-ed4bebc125d7 None admin] PATH_INFO: `/v3/users/5786c5828f214152a6e9a90fca93504e` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:28.022154 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2928f-d70d-4ae0-ba81-ed4bebc125d7 None admin] RBAC: Authorizing `identity:get_user(user_id=5786c5828f214152a6e9a90fca93504e)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:28.023705 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2928f-d70d-4ae0-ba81-ed4bebc125d7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:28.025469 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 77/150] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:27 2022] GET /identity/v3/users/5786c5828f214152a6e9a90fca93504e => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:28.031452 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f503f3-513b-4fe1-88a5-bb497ad792c9 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:28.163910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f503f3-513b-4fe1-88a5-bb497ad792c9 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:28.178867 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:28.200245 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2cf9c-4511-4ba3-bad6-319d82fc2cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:28.200906 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2cf9c-4511-4ba3-bad6-319d82fc2cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:28.201195 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2cf9c-4511-4ba3-bad6-319d82fc2cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:28.201475 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2cf9c-4511-4ba3-bad6-319d82fc2cd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:28.277020 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2cf9c-4511-4ba3-bad6-319d82fc2cd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:28.278627 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2cf9c-4511-4ba3-bad6-319d82fc2cd6 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:28.382102 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 74/151] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:54:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:28.387617 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2928f-d70d-4ae0-ba81-ed4bebc125d7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:28.532628 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2928f-d70d-4ae0-ba81-ed4bebc125d7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:28.581580 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344b37d-f988-4fa4-8580-53e088d4fb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:28.582715 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344b37d-f988-4fa4-8580-53e088d4fb66 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:28.583175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344b37d-f988-4fa4-8580-53e088d4fb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:28.583666 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344b37d-f988-4fa4-8580-53e088d4fb66 None admin] PATH_INFO: `/v3/projects/05ae476a690b4d899f0bd474f195f9ea` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:28.585036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344b37d-f988-4fa4-8580-53e088d4fb66 None admin] RBAC: Authorizing `identity:get_project(project_id=05ae476a690b4d899f0bd474f195f9ea)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:28.586661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344b37d-f988-4fa4-8580-53e088d4fb66 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:28.589625 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 78/152] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:28 2022] GET /identity/v3/projects/05ae476a690b4d899f0bd474f195f9ea => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:28.594578 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2cf9c-4511-4ba3-bad6-319d82fc2cd6 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:28.617742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:28.716850 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2cf9c-4511-4ba3-bad6-319d82fc2cd6 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:28.754228 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bbd70-0f65-4bec-ba8d-97adb9e9689b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:28.754930 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bbd70-0f65-4bec-ba8d-97adb9e9689b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:28.755218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bbd70-0f65-4bec-ba8d-97adb9e9689b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:28.755500 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bbd70-0f65-4bec-ba8d-97adb9e9689b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:28.756337 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bbd70-0f65-4bec-ba8d-97adb9e9689b None admin] RBAC: Adding query filter params (role.id=9a3a3371dd4d4405b2e4604acc314d43, scope.project.id=05ae476a690b4d899f0bd474f195f9ea, user.id=5786c5828f214152a6e9a90fca93504e) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:28.756656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bbd70-0f65-4bec-ba8d-97adb9e9689b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:28.758125 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bbd70-0f65-4bec-ba8d-97adb9e9689b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:28.765176 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 75/153] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:54:28 2022] GET /identity/v3/role_assignments?user.id=5786c5828f214152a6e9a90fca93504e&scope.project.id=05ae476a690b4d899f0bd474f195f9ea&role.id=9a3a3371dd4d4405b2e4604acc314d43 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:28.898373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a91f46-2054-47ae-818f-f6def666ee80 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:28.898896 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a91f46-2054-47ae-818f-f6def666ee80 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:28.899343 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a91f46-2054-47ae-818f-f6def666ee80 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:28.901386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 79/154] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:28.908346 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962714ac-8bfb-4797-a539-fc085282776e None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:28.908787 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962714ac-8bfb-4797-a539-fc085282776e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:28.909201 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962714ac-8bfb-4797-a539-fc085282776e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:28.930158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-962714ac-8bfb-4797-a539-fc085282776e None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:28.931493 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-962714ac-8bfb-4797-a539-fc085282776e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:29.006306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 76/155] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:29.031874 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a91f46-2054-47ae-818f-f6def666ee80 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:29.079653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:29.107145 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be5783-f7b9-4faf-8be8-d9389dac576e None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:29.107433 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be5783-f7b9-4faf-8be8-d9389dac576e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:29.107716 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be5783-f7b9-4faf-8be8-d9389dac576e None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:29.109194 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 77/156] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:29.115392 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79993fbc-44f5-4790-9193-290f14fab175 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:29.115720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79993fbc-44f5-4790-9193-290f14fab175 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:29.115949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79993fbc-44f5-4790-9193-290f14fab175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:29.135225 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-79993fbc-44f5-4790-9193-290f14fab175 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:29.136487 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-79993fbc-44f5-4790-9193-290f14fab175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:29.138817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:29.150600 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a91f46-2054-47ae-818f-f6def666ee80 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:29.208937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c426836-4423-4ed6-b5de-9bff315c6e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:29.210200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c426836-4423-4ed6-b5de-9bff315c6e20 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:29.210789 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c426836-4423-4ed6-b5de-9bff315c6e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:29.211207 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c426836-4423-4ed6-b5de-9bff315c6e20 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:29.213487 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c426836-4423-4ed6-b5de-9bff315c6e20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:29.215842 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c426836-4423-4ed6-b5de-9bff315c6e20 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:29.218469 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 80/157] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:54:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:29.225279 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c426836-4423-4ed6-b5de-9bff315c6e20 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:29.232895 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 78/158] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:54:29.268060 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79993fbc-44f5-4790-9193-290f14fab175 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:29.355541 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c426836-4423-4ed6-b5de-9bff315c6e20 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:29.366344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:29.392864 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79993fbc-44f5-4790-9193-290f14fab175 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:29.393918 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807e67e-28a5-49c6-9b12-4761931b54e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:29.393918 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807e67e-28a5-49c6-9b12-4761931b54e2 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:29.394480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807e67e-28a5-49c6-9b12-4761931b54e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:29.394480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807e67e-28a5-49c6-9b12-4761931b54e2 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:29.394480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807e67e-28a5-49c6-9b12-4761931b54e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:29.396433 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807e67e-28a5-49c6-9b12-4761931b54e2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:29.425881 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 81/159] 10.222.0.79 () {60 vars in 1132 bytes} [Thu Jul 14 11:54:29 2022] POST /identity/v3/users => generated 283 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:54:29.427543 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a7380-356f-42cd-a0cf-98f30ab24587 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:29.427835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a7380-356f-42cd-a0cf-98f30ab24587 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:29.428111 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a7380-356f-42cd-a0cf-98f30ab24587 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:29.430676 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 82/160] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:29.437356 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b609c0b-48b0-40b0-866e-6bb7c054132f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:29.437821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b609c0b-48b0-40b0-866e-6bb7c054132f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:29.437984 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b609c0b-48b0-40b0-866e-6bb7c054132f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:29.448442 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76b6c5-ca1e-4ae2-b19e-55067d8d5d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:29.450435 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76b6c5-ca1e-4ae2-b19e-55067d8d5d13 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:29.451045 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76b6c5-ca1e-4ae2-b19e-55067d8d5d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:29.451625 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76b6c5-ca1e-4ae2-b19e-55067d8d5d13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:29.458156 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6b609c0b-48b0-40b0-866e-6bb7c054132f None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:29.459433 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6b609c0b-48b0-40b0-866e-6bb7c054132f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:29.463721 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:29.469643 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76b6c5-ca1e-4ae2-b19e-55067d8d5d13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:29.482610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-2f76b6c5-ca1e-4ae2-b19e-55067d8d5d13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:29.482610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:29.482610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:29.482610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:29.482610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:29.482610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:29.482610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:29.482610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:29.482610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:29.482610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:29.482610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:29.482610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:29.482610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:29.482610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:29.482610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:29.482610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:29.483561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:29.483561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:29.483561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:29.483561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:29.483561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:29.483561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:29.483561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:29.483561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:29.483561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:29.483561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:29.483561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:29.483561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:29.483561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:29.483561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:29.483561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:29.483561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:29.484316 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:29.484316 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:29.484316 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:29.484316 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:29.484316 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:29.484316 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:29.484316 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:29.484316 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:29.484316 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:29.484316 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:29.484316 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:29.484316 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:54:29.488234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 79/161] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:29.494553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76b6c5-ca1e-4ae2-b19e-55067d8d5d13 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:29.554525 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 83/162] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:29.576789 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b609c0b-48b0-40b0-866e-6bb7c054132f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:29.643380 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76b6c5-ca1e-4ae2-b19e-55067d8d5d13 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:29.691399 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aee761-278d-48f5-ae67-f7b046bed56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:29.692293 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aee761-278d-48f5-ae67-f7b046bed56b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:29.692585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aee761-278d-48f5-ae67-f7b046bed56b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:29.692870 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aee761-278d-48f5-ae67-f7b046bed56b None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:29.693637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aee761-278d-48f5-ae67-f7b046bed56b None admin] RBAC: Adding query filter params (name=member) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:29.693958 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aee761-278d-48f5-ae67-f7b046bed56b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:29.696925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aee761-278d-48f5-ae67-f7b046bed56b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:29.703980 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:29.708914 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 80/163] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:54:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:29.714741 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aee761-278d-48f5-ae67-f7b046bed56b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:29.721591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b609c0b-48b0-40b0-866e-6bb7c054132f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:29.771915 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a874e7-b23a-4722-91da-13bc77409cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:29.772837 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a874e7-b23a-4722-91da-13bc77409cce None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:29.773133 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a874e7-b23a-4722-91da-13bc77409cce None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:29.773417 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a874e7-b23a-4722-91da-13bc77409cce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:29.788447 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a874e7-b23a-4722-91da-13bc77409cce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:29.794867 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:29.798941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-52a874e7-b23a-4722-91da-13bc77409cce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:54:29.798941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:29.798941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:29.798941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:29.798941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:29.798941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:29.798941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:29.798941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:29.798941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:29.798941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:29.798941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:29.798941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:29.798941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:29.798941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:29.798941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:29.798941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:29.800007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:29.800007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:29.800007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:29.800007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:29.800007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:29.800007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:29.800007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:29.800007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:29.800007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:29.800007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:29.800007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:29.800007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:29.800007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:29.800007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:29.800007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:29.800007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:29.801240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:29.801240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:29.801240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:29.801240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:29.801240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:29.801240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:29.801240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:29.801240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:29.801240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:29.801240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:29.801240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:54:29.801240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:54:29.801240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 84/164] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Jul 14 11:54:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:54:29.812751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a874e7-b23a-4722-91da-13bc77409cce None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:29.855319 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aee761-278d-48f5-ae67-f7b046bed56b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:29.897420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6a456-6c91-4c90-98be-75eb27a217ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:29.898359 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6a456-6c91-4c90-98be-75eb27a217ba None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:29.898796 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6a456-6c91-4c90-98be-75eb27a217ba None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:29.899083 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6a456-6c91-4c90-98be-75eb27a217ba None admin] PATH_INFO: `/v3/users/5786c5828f214152a6e9a90fca93504e` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:29.901350 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6a456-6c91-4c90-98be-75eb27a217ba None admin] RBAC: Authorizing `identity:get_user(user_id=5786c5828f214152a6e9a90fca93504e)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:29.903525 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6a456-6c91-4c90-98be-75eb27a217ba None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:29.905685 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 81/165] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:29 2022] GET /identity/v3/users/5786c5828f214152a6e9a90fca93504e => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:29.907035 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15261f12-34ab-4fa2-8fec-fea6064b99d9 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:29.907327 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15261f12-34ab-4fa2-8fec-fea6064b99d9 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:29.907608 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15261f12-34ab-4fa2-8fec-fea6064b99d9 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:29.908918 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 82/166] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:29.913507 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15261f12-34ab-4fa2-8fec-fea6064b99d9 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:29.957083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a874e7-b23a-4722-91da-13bc77409cce None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:30.005275 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33314461-986c-4273-8ded-b587d55dca7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:30.005963 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33314461-986c-4273-8ded-b587d55dca7f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:30.006249 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33314461-986c-4273-8ded-b587d55dca7f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:30.006555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33314461-986c-4273-8ded-b587d55dca7f None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:30.007330 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33314461-986c-4273-8ded-b587d55dca7f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:30.007730 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33314461-986c-4273-8ded-b587d55dca7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:30.009067 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33314461-986c-4273-8ded-b587d55dca7f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:30.019758 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 85/167] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:54:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:30.020903 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416776b-7765-45ab-80b1-500dbb04ba12 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:30.021200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416776b-7765-45ab-80b1-500dbb04ba12 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:30.021481 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416776b-7765-45ab-80b1-500dbb04ba12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:30.041480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6416776b-7765-45ab-80b1-500dbb04ba12 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:30.043448 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6416776b-7765-45ab-80b1-500dbb04ba12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:30.049664 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15261f12-34ab-4fa2-8fec-fea6064b99d9 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:30.057219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:30.112535 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:30.128415 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af21246-d41d-43a9-85a8-d1d6bb8f3ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:30.129065 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af21246-d41d-43a9-85a8-d1d6bb8f3ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:30.129352 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af21246-d41d-43a9-85a8-d1d6bb8f3ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:30.129629 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af21246-d41d-43a9-85a8-d1d6bb8f3ca6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:30.154885 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 86/168] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:30.155843 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416776b-7765-45ab-80b1-500dbb04ba12 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:30.301308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416776b-7765-45ab-80b1-500dbb04ba12 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:30.311419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af21246-d41d-43a9-85a8-d1d6bb8f3ca6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:30.312948 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af21246-d41d-43a9-85a8-d1d6bb8f3ca6 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:30.340943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97faab-5c7c-45c9-9d84-2cf508a12d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:30.341845 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97faab-5c7c-45c9-9d84-2cf508a12d4e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:30.342128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97faab-5c7c-45c9-9d84-2cf508a12d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:30.342401 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97faab-5c7c-45c9-9d84-2cf508a12d4e None admin] PATH_INFO: `/v3/users/5786c5828f214152a6e9a90fca93504e` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:30.343742 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97faab-5c7c-45c9-9d84-2cf508a12d4e None admin] RBAC: Authorizing `identity:get_user(user_id=5786c5828f214152a6e9a90fca93504e)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:30.345741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97faab-5c7c-45c9-9d84-2cf508a12d4e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:30.347732 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 87/169] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:30 2022] GET /identity/v3/users/5786c5828f214152a6e9a90fca93504e => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:30.348755 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97faab-5c7c-45c9-9d84-2cf508a12d4e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:30.370894 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:30.486936 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97faab-5c7c-45c9-9d84-2cf508a12d4e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:30.523432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 83/170] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:54:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 11:54:30.524420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af21246-d41d-43a9-85a8-d1d6bb8f3ca6 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:30.562362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30467f3-50c3-4e43-ba97-d3f40500cdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:30.563161 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30467f3-50c3-4e43-ba97-d3f40500cdf0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:30.563445 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30467f3-50c3-4e43-ba97-d3f40500cdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:30.563722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30467f3-50c3-4e43-ba97-d3f40500cdf0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:30.587840 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30467f3-50c3-4e43-ba97-d3f40500cdf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:30.588212 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:30.595816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-b30467f3-50c3-4e43-ba97-d3f40500cdf0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:54:30.595816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:30.595816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:30.595816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:30.595816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:30.595816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:30.595816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:30.595816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:30.595816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:30.595816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:30.595816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:30.595816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:30.595816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:30.595816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:30.595816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:30.595816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:30.596693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:30.596693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:30.596693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:30.596693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:30.596693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:30.596693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:30.596693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:30.596693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:30.596693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:30.596693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:30.596693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:30.596693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:30.596693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:30.596693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:30.596693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:30.596693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:30.597450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:30.597450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:30.597450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:30.597450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:30.597450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:30.597450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:30.597450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:30.597450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:30.597450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:30.597450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:30.597450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:54:30.597450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:54:30.611698 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 88/171] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:30.612647 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30467f3-50c3-4e43-ba97-d3f40500cdf0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:30.741508 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af21246-d41d-43a9-85a8-d1d6bb8f3ca6 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:30.770716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:30.816544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45fe5d-25d3-4e5c-bfa6-e7bef1e13b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:30.818810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30467f3-50c3-4e43-ba97-d3f40500cdf0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:30.819682 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45fe5d-25d3-4e5c-bfa6-e7bef1e13b01 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:30.820171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45fe5d-25d3-4e5c-bfa6-e7bef1e13b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:30.820649 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45fe5d-25d3-4e5c-bfa6-e7bef1e13b01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:30.889012 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1b393-9266-41fc-b15f-8678cba71bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:30.892454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1b393-9266-41fc-b15f-8678cba71bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:30.892454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1b393-9266-41fc-b15f-8678cba71bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:30.892454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1b393-9266-41fc-b15f-8678cba71bb0 None admin] PATH_INFO: `/v3/projects/a857274b837347e4b25e6735c7f958ae` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:30.894701 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1b393-9266-41fc-b15f-8678cba71bb0 None admin] RBAC: Authorizing `identity:get_project(project_id=a857274b837347e4b25e6735c7f958ae)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:30.897404 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1b393-9266-41fc-b15f-8678cba71bb0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:30.899692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 89/172] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:30 2022] GET /identity/v3/projects/a857274b837347e4b25e6735c7f958ae => generated 312 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:30.900649 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1b393-9266-41fc-b15f-8678cba71bb0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:30.961245 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45fe5d-25d3-4e5c-bfa6-e7bef1e13b01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:30.964208 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45fe5d-25d3-4e5c-bfa6-e7bef1e13b01 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:31.023201 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:31.063502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1b393-9266-41fc-b15f-8678cba71bb0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:31.100589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbff0f-42c8-4a55-9b43-28fe2dc4f904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:31.101197 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbff0f-42c8-4a55-9b43-28fe2dc4f904 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:31.101483 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbff0f-42c8-4a55-9b43-28fe2dc4f904 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:31.101759 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbff0f-42c8-4a55-9b43-28fe2dc4f904 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:31.102546 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cbff0f-42c8-4a55-9b43-28fe2dc4f904 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:31.102986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cbff0f-42c8-4a55-9b43-28fe2dc4f904 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:31.104383 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cbff0f-42c8-4a55-9b43-28fe2dc4f904 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:31.113789 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 90/173] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:54:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:31.114654 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbff0f-42c8-4a55-9b43-28fe2dc4f904 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:31.118838 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:31.201806 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 84/174] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:54:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:31.202519 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45fe5d-25d3-4e5c-bfa6-e7bef1e13b01 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:31.221215 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbff0f-42c8-4a55-9b43-28fe2dc4f904 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:31.258475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a49b11-cbf6-4c79-941f-d545079190e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:31.259255 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a49b11-cbf6-4c79-941f-d545079190e3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:31.259547 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a49b11-cbf6-4c79-941f-d545079190e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:31.259827 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a49b11-cbf6-4c79-941f-d545079190e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:31.261150 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a49b11-cbf6-4c79-941f-d545079190e3 None admin] RBAC: Adding query filter params (role.id=9a3a3371dd4d4405b2e4604acc314d43, scope.project.id=a857274b837347e4b25e6735c7f958ae, user.id=5786c5828f214152a6e9a90fca93504e) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:31.261479 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a49b11-cbf6-4c79-941f-d545079190e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:31.263626 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a49b11-cbf6-4c79-941f-d545079190e3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:31.270998 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 91/175] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:54:31 2022] GET /identity/v3/role_assignments?user.id=5786c5828f214152a6e9a90fca93504e&scope.project.id=a857274b837347e4b25e6735c7f958ae&role.id=9a3a3371dd4d4405b2e4604acc314d43 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:31.271689 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a49b11-cbf6-4c79-941f-d545079190e3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:31.343864 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45fe5d-25d3-4e5c-bfa6-e7bef1e13b01 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:31.375702 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:31.383723 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d86863-e11d-4a4f-99d5-3aef48c572d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:31.385256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d86863-e11d-4a4f-99d5-3aef48c572d8 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:31.385765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d86863-e11d-4a4f-99d5-3aef48c572d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:31.386298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d86863-e11d-4a4f-99d5-3aef48c572d8 None admin] PATH_INFO: `/v3/users/e2e8c28d33f54e8cbf59231cde95e27c` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:31.390025 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d86863-e11d-4a4f-99d5-3aef48c572d8 None admin] RBAC: Authorizing `identity:get_user(user_id=e2e8c28d33f54e8cbf59231cde95e27c)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:31.392072 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d86863-e11d-4a4f-99d5-3aef48c572d8 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:31.395076 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 85/176] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:31 2022] GET /identity/v3/users/e2e8c28d33f54e8cbf59231cde95e27c => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:31.407554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d86863-e11d-4a4f-99d5-3aef48c572d8 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:31.433304 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:31.476849 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a49b11-cbf6-4c79-941f-d545079190e3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:31.517333 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17ea24-889f-4740-b4ce-d41e58062bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:31.519090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17ea24-889f-4740-b4ce-d41e58062bba None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:31.519591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17ea24-889f-4740-b4ce-d41e58062bba None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:31.520059 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17ea24-889f-4740-b4ce-d41e58062bba None admin] PATH_INFO: `/v3/projects/05ae476a690b4d899f0bd474f195f9ea` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:31.521607 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17ea24-889f-4740-b4ce-d41e58062bba None admin] RBAC: Authorizing `identity:get_project(project_id=05ae476a690b4d899f0bd474f195f9ea)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:31.524074 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17ea24-889f-4740-b4ce-d41e58062bba None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:31.528155 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 92/177] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:31 2022] GET /identity/v3/projects/05ae476a690b4d899f0bd474f195f9ea => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:31.534287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17ea24-889f-4740-b4ce-d41e58062bba None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:31.654522 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17ea24-889f-4740-b4ce-d41e58062bba None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:31.691050 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d86863-e11d-4a4f-99d5-3aef48c572d8 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:31.706286 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30394a6e-7501-49a8-b955-ee6ef9b0f360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:31.707381 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30394a6e-7501-49a8-b955-ee6ef9b0f360 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:31.707910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30394a6e-7501-49a8-b955-ee6ef9b0f360 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:31.708404 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30394a6e-7501-49a8-b955-ee6ef9b0f360 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:31.709514 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30394a6e-7501-49a8-b955-ee6ef9b0f360 None admin] RBAC: Adding query filter params (role.id=986e347cbb9e43e7a49dfef9be8ec9dd, scope.project.id=05ae476a690b4d899f0bd474f195f9ea, user.id=5786c5828f214152a6e9a90fca93504e) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:31.710022 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30394a6e-7501-49a8-b955-ee6ef9b0f360 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:31.711687 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30394a6e-7501-49a8-b955-ee6ef9b0f360 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:31.721874 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:31.724964 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 93/178] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:54:31 2022] GET /identity/v3/role_assignments?user.id=5786c5828f214152a6e9a90fca93504e&scope.project.id=05ae476a690b4d899f0bd474f195f9ea&role.id=986e347cbb9e43e7a49dfef9be8ec9dd => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:31.776293 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72f00e-93ef-496c-9ade-78784fc049dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:31.778423 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72f00e-93ef-496c-9ade-78784fc049dc None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:31.778963 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72f00e-93ef-496c-9ade-78784fc049dc None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:31.779538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72f00e-93ef-496c-9ade-78784fc049dc None admin] PATH_INFO: `/v3/projects/05ae476a690b4d899f0bd474f195f9ea` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:31.783431 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72f00e-93ef-496c-9ade-78784fc049dc None admin] RBAC: Authorizing `identity:get_project(project_id=05ae476a690b4d899f0bd474f195f9ea)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:31.785273 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72f00e-93ef-496c-9ade-78784fc049dc None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:31.787777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 86/179] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:31 2022] GET /identity/v3/projects/05ae476a690b4d899f0bd474f195f9ea => generated 298 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:31.796373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30394a6e-7501-49a8-b955-ee6ef9b0f360 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:31.962467 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30394a6e-7501-49a8-b955-ee6ef9b0f360 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:32.013884 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cb51c-8cd5-4489-9fef-5174f2737928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:32.014827 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cb51c-8cd5-4489-9fef-5174f2737928 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:32.015119 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cb51c-8cd5-4489-9fef-5174f2737928 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:32.015395 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cb51c-8cd5-4489-9fef-5174f2737928 None admin] PATH_INFO: `/v3/projects/05ae476a690b4d899f0bd474f195f9ea/users/e2e8c28d33f54e8cbf59231cde95e27c/roles/78a510490d1e423c89a3b430c8530483` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:32.020260 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cb51c-8cd5-4489-9fef-5174f2737928 None admin] RBAC: Authorizing `identity:create_grant(project_id=05ae476a690b4d899f0bd474f195f9ea, user_id=e2e8c28d33f54e8cbf59231cde95e27c, role_id=78a510490d1e423c89a3b430c8530483)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:32.021915 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cb51c-8cd5-4489-9fef-5174f2737928 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:32.048525 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 94/180] 10.222.0.79 () {58 vars in 1439 bytes} [Thu Jul 14 11:54:31 2022] PUT /identity/v3/projects/05ae476a690b4d899f0bd474f195f9ea/users/e2e8c28d33f54e8cbf59231cde95e27c/roles/78a510490d1e423c89a3b430c8530483 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:54:32.185879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497901a-3b3e-441f-8441-77b6103a7652 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:32.186285 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497901a-3b3e-441f-8441-77b6103a7652 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:32.186457 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497901a-3b3e-441f-8441-77b6103a7652 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:32.188094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 87/181] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:54:32.193800 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c7584-6c63-4cac-929e-f7947f7bfbfc None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:32.194193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c7584-6c63-4cac-929e-f7947f7bfbfc None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:32.194432 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c7584-6c63-4cac-929e-f7947f7bfbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:32.216623 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-802c7584-6c63-4cac-929e-f7947f7bfbfc None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:32.217762 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-802c7584-6c63-4cac-929e-f7947f7bfbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:32.255805 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135b852-6414-4777-9d35-c87bd83bb8da None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:32.256196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135b852-6414-4777-9d35-c87bd83bb8da None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:32.256388 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135b852-6414-4777-9d35-c87bd83bb8da None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:32.257764 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 88/182] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:54:32.263830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacd8c4-83bc-465d-a383-39524af7a48f None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:32.264209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacd8c4-83bc-465d-a383-39524af7a48f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:32.264453 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacd8c4-83bc-465d-a383-39524af7a48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:32.283504 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-dcacd8c4-83bc-465d-a383-39524af7a48f None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:32.288430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-dcacd8c4-83bc-465d-a383-39524af7a48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:32.302982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:32.324616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 95/183] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:32.350894 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c7584-6c63-4cac-929e-f7947f7bfbfc None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:32.378327 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:32.391423 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 89/184] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:32.414461 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacd8c4-83bc-465d-a383-39524af7a48f None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:32.478580 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c7584-6c63-4cac-929e-f7947f7bfbfc None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:32.518799 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c0979-a05b-40b1-9dab-dbca23b81b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:32.519636 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c0979-a05b-40b1-9dab-dbca23b81b18 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:32.519929 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c0979-a05b-40b1-9dab-dbca23b81b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:32.520211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c0979-a05b-40b1-9dab-dbca23b81b18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:32.521513 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c0979-a05b-40b1-9dab-dbca23b81b18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:32.523196 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c0979-a05b-40b1-9dab-dbca23b81b18 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:32.525272 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 96/185] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:54:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:32.531418 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c0979-a05b-40b1-9dab-dbca23b81b18 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:32.532208 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacd8c4-83bc-465d-a383-39524af7a48f None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:32.569997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f251dd-f86a-4e99-bd3a-c618fcdfd8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:32.570910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f251dd-f86a-4e99-bd3a-c618fcdfd8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:32.571195 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f251dd-f86a-4e99-bd3a-c618fcdfd8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:32.571472 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f251dd-f86a-4e99-bd3a-c618fcdfd8a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:32.584804 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f251dd-f86a-4e99-bd3a-c618fcdfd8a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:32.593781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-63f251dd-f86a-4e99-bd3a-c618fcdfd8a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:54:32.593781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:32.593781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:32.593781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:32.593781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:32.593781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:32.593781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:32.593781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:32.593781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:32.593781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:32.593781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:32.593781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:32.593781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:32.593781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:32.593781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:32.593781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:32.594910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:32.594910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:32.594910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:32.594910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:32.594910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:32.594910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:32.594910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:32.594910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:32.594910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:32.594910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:32.594910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:32.594910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:32.594910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:32.594910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:32.594910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:32.594910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:32.595905 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:32.595905 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:32.595905 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:32.595905 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:32.595905 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:32.595905 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:32.595905 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:32.595905 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:32.595905 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:32.595905 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:32.595905 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:54:32.595905 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:54:32.595905 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 90/186] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:54:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:54:32.596687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104dc4d-adea-40a6-a72c-9066705b4a94 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:32.596687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104dc4d-adea-40a6-a72c-9066705b4a94 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:32.598314 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104dc4d-adea-40a6-a72c-9066705b4a94 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:32.598314 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 91/187] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:32.603286 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:32.604305 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd7d8a-1c2e-477f-a0c5-3810a2115a3e None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:32.604597 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd7d8a-1c2e-477f-a0c5-3810a2115a3e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:32.604874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd7d8a-1c2e-477f-a0c5-3810a2115a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:32.622296 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-e7fd7d8a-1c2e-477f-a0c5-3810a2115a3e None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:32.623576 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e7fd7d8a-1c2e-477f-a0c5-3810a2115a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:32.653654 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c0979-a05b-40b1-9dab-dbca23b81b18 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:32.682039 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:32.692180 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f939f93-f2f8-4560-a309-5689498ae755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:32.693026 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f939f93-f2f8-4560-a309-5689498ae755 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:32.693321 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f939f93-f2f8-4560-a309-5689498ae755 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:32.693601 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f939f93-f2f8-4560-a309-5689498ae755 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:32.694569 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f939f93-f2f8-4560-a309-5689498ae755 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:32.695853 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f939f93-f2f8-4560-a309-5689498ae755 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:32.702827 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 92/188] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:32.703575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd7d8a-1c2e-477f-a0c5-3810a2115a3e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:32.726727 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 97/189] 10.222.0.79 () {60 vars in 1132 bytes} [Thu Jul 14 11:54:32 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:54:32.727993 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f939f93-f2f8-4560-a309-5689498ae755 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:32.851959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd7d8a-1c2e-477f-a0c5-3810a2115a3e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:32.862479 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f939f93-f2f8-4560-a309-5689498ae755 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:32.885955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:32.894234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc93cdc-6023-440e-a696-1158fdc84776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:32.895051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc93cdc-6023-440e-a696-1158fdc84776 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:32.895273 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc93cdc-6023-440e-a696-1158fdc84776 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:32.896340 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc93cdc-6023-440e-a696-1158fdc84776 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:32.896340 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc93cdc-6023-440e-a696-1158fdc84776 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:32.896626 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc93cdc-6023-440e-a696-1158fdc84776 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:32.898485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc93cdc-6023-440e-a696-1158fdc84776 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:32.908566 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 93/190] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:32.914231 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc93cdc-6023-440e-a696-1158fdc84776 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:32.922299 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b18df3-1e50-4feb-bf57-306fce979e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:32.923171 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b18df3-1e50-4feb-bf57-306fce979e24 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:32.923464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b18df3-1e50-4feb-bf57-306fce979e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:32.923747 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b18df3-1e50-4feb-bf57-306fce979e24 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:32.943404 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b18df3-1e50-4feb-bf57-306fce979e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:32.952788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-43b18df3-1e50-4feb-bf57-306fce979e24 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:54:32.952788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:32.952788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:32.952788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:32.952788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:32.952788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:32.952788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:32.952788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:32.952788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:32.952788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:32.952788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:32.952788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:32.952788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:32.952788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:32.952788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:32.952788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:32.953728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:32.953728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:32.953728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:32.953728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:32.953728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:32.953728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:32.953728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:32.953728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:32.953728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:32.953728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:32.953728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:32.953728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:32.953728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:32.953728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:32.953728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:32.953728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:32.954651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:32.954651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:32.954651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:32.954651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:32.954651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:32.954651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:32.954651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:32.954651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:32.954651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:32.954651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:32.954651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:54:32.954651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:54:32.954651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 98/191] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Jul 14 11:54:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:32.961549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b18df3-1e50-4feb-bf57-306fce979e24 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:32.978962 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:33.049355 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc93cdc-6023-440e-a696-1158fdc84776 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:33.095392 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b18df3-1e50-4feb-bf57-306fce979e24 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:33.096361 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0996b-6575-4c5d-a33a-517ab905e569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:33.097880 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0996b-6575-4c5d-a33a-517ab905e569 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:33.097880 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0996b-6575-4c5d-a33a-517ab905e569 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:33.098171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0996b-6575-4c5d-a33a-517ab905e569 None admin] PATH_INFO: `/v3/users/c1676f2cdcc1480fb5a832e8d7146183` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:33.119903 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0996b-6575-4c5d-a33a-517ab905e569 None admin] RBAC: Authorizing `identity:get_user(user_id=c1676f2cdcc1480fb5a832e8d7146183)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:33.122038 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0996b-6575-4c5d-a33a-517ab905e569 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:33.123981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 94/192] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:32 2022] GET /identity/v3/users/c1676f2cdcc1480fb5a832e8d7146183 => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:33.129404 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0996b-6575-4c5d-a33a-517ab905e569 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:33.143554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4de3f-4822-454c-853d-23b2fccfab13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:33.144598 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4de3f-4822-454c-853d-23b2fccfab13 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:33.145039 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4de3f-4822-454c-853d-23b2fccfab13 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:33.145625 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4de3f-4822-454c-853d-23b2fccfab13 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:33.146984 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4de3f-4822-454c-853d-23b2fccfab13 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:33.147726 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4de3f-4822-454c-853d-23b2fccfab13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:33.149775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4de3f-4822-454c-853d-23b2fccfab13 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:33.161939 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 99/193] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:54:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:33.168586 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4de3f-4822-454c-853d-23b2fccfab13 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:33.214283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:33.258386 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0996b-6575-4c5d-a33a-517ab905e569 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:33.261572 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:33.299957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4de3f-4822-454c-853d-23b2fccfab13 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:33.327951 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6a48a-630d-4e5a-b8ee-8192c0216f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:33.329402 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6a48a-630d-4e5a-b8ee-8192c0216f02 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:33.330114 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6a48a-630d-4e5a-b8ee-8192c0216f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:33.330735 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6a48a-630d-4e5a-b8ee-8192c0216f02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:33.363252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21c593-9890-4409-8f7a-9d4107c51697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:33.366230 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21c593-9890-4409-8f7a-9d4107c51697 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:33.366544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21c593-9890-4409-8f7a-9d4107c51697 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:33.366827 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21c593-9890-4409-8f7a-9d4107c51697 None admin] PATH_INFO: `/v3/users/c1676f2cdcc1480fb5a832e8d7146183` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:33.372447 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21c593-9890-4409-8f7a-9d4107c51697 None admin] RBAC: Authorizing `identity:get_user(user_id=c1676f2cdcc1480fb5a832e8d7146183)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:33.377040 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21c593-9890-4409-8f7a-9d4107c51697 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:33.379039 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 100/194] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:33 2022] GET /identity/v3/users/c1676f2cdcc1480fb5a832e8d7146183 => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:33.384730 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21c593-9890-4409-8f7a-9d4107c51697 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:33.482175 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6a48a-630d-4e5a-b8ee-8192c0216f02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:33.484366 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6a48a-630d-4e5a-b8ee-8192c0216f02 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:33.581704 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21c593-9890-4409-8f7a-9d4107c51697 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:33.591874 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:33.640124 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 95/195] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:54:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 11:54:33.646315 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6a48a-630d-4e5a-b8ee-8192c0216f02 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:33.649463 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:33.667276 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65270768-d1a4-456b-b204-17724c8148a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:33.668020 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65270768-d1a4-456b-b204-17724c8148a4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:33.668318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65270768-d1a4-456b-b204-17724c8148a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:33.668883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65270768-d1a4-456b-b204-17724c8148a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:33.760597 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6a48a-630d-4e5a-b8ee-8192c0216f02 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:33.798412 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f472ec-a0ac-4e1d-95cb-bed3ba774cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:33.799664 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f472ec-a0ac-4e1d-95cb-bed3ba774cdc None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:33.800165 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f472ec-a0ac-4e1d-95cb-bed3ba774cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:33.800631 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f472ec-a0ac-4e1d-95cb-bed3ba774cdc None admin] PATH_INFO: `/v3/projects/bf999b1796e2439bb0a35f1812856355` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:33.802017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f472ec-a0ac-4e1d-95cb-bed3ba774cdc None admin] RBAC: Authorizing `identity:get_project(project_id=bf999b1796e2439bb0a35f1812856355)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:33.804088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f472ec-a0ac-4e1d-95cb-bed3ba774cdc None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:33.806532 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 96/196] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:33 2022] GET /identity/v3/projects/bf999b1796e2439bb0a35f1812856355 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:33.813209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f472ec-a0ac-4e1d-95cb-bed3ba774cdc None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:33.872411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65270768-d1a4-456b-b204-17724c8148a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:33.873834 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65270768-d1a4-456b-b204-17724c8148a4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:33.895118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:33.931529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f472ec-a0ac-4e1d-95cb-bed3ba774cdc None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:33.971735 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0491d41-97c1-4c1a-8486-e533f53be391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:33.973105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0491d41-97c1-4c1a-8486-e533f53be391 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:33.973899 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0491d41-97c1-4c1a-8486-e533f53be391 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:33.974532 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0491d41-97c1-4c1a-8486-e533f53be391 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:33.975642 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0491d41-97c1-4c1a-8486-e533f53be391 None admin] RBAC: Adding query filter params (role.id=eff4f9bbb7064bc1a0f9fc55a05fea51, scope.project.id=bf999b1796e2439bb0a35f1812856355, user.id=c1676f2cdcc1480fb5a832e8d7146183) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:33.976287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0491d41-97c1-4c1a-8486-e533f53be391 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:33.978577 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0491d41-97c1-4c1a-8486-e533f53be391 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:33.986873 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 97/197] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:54:33 2022] GET /identity/v3/role_assignments?user.id=c1676f2cdcc1480fb5a832e8d7146183&scope.project.id=bf999b1796e2439bb0a35f1812856355&role.id=eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:34.098621 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 101/198] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:54:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 11:54:34.104334 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0491d41-97c1-4c1a-8486-e533f53be391 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:34.253453 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0491d41-97c1-4c1a-8486-e533f53be391 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:34.312992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62273694-bdd9-4896-85c1-e4b56f1e49e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:34.313861 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62273694-bdd9-4896-85c1-e4b56f1e49e2 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:34.314149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62273694-bdd9-4896-85c1-e4b56f1e49e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:34.314429 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62273694-bdd9-4896-85c1-e4b56f1e49e2 None admin] PATH_INFO: `/v3/projects/bf999b1796e2439bb0a35f1812856355` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:34.319288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62273694-bdd9-4896-85c1-e4b56f1e49e2 None admin] RBAC: Authorizing `identity:get_project(project_id=bf999b1796e2439bb0a35f1812856355)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:34.320777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62273694-bdd9-4896-85c1-e4b56f1e49e2 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:34.322729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 98/199] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:34 2022] GET /identity/v3/projects/bf999b1796e2439bb0a35f1812856355 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:34.329309 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65270768-d1a4-456b-b204-17724c8148a4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:34.335619 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:34.472887 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65270768-d1a4-456b-b204-17724c8148a4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:34.508373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a165c-1ca4-49e7-a65c-83a39017bde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:34.508961 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a165c-1ca4-49e7-a65c-83a39017bde4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:34.509244 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a165c-1ca4-49e7-a65c-83a39017bde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:34.509518 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a165c-1ca4-49e7-a65c-83a39017bde4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:34.510366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a165c-1ca4-49e7-a65c-83a39017bde4 None admin] RBAC: Adding query filter params (role.id=986e347cbb9e43e7a49dfef9be8ec9dd, scope.project.id=bf999b1796e2439bb0a35f1812856355, user.id=c1676f2cdcc1480fb5a832e8d7146183) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:34.510708 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a165c-1ca4-49e7-a65c-83a39017bde4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:34.512797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a165c-1ca4-49e7-a65c-83a39017bde4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:34.518927 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 102/200] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:54:34 2022] GET /identity/v3/role_assignments?user.id=c1676f2cdcc1480fb5a832e8d7146183&scope.project.id=bf999b1796e2439bb0a35f1812856355&role.id=986e347cbb9e43e7a49dfef9be8ec9dd => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:34.561656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb2b5e-09ed-4336-ba60-900a0e14f0b8 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:34.562182 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb2b5e-09ed-4336-ba60-900a0e14f0b8 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:34.562288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb2b5e-09ed-4336-ba60-900a0e14f0b8 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:34.563918 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 99/201] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:34.570505 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ff01c-dd08-431f-b5bc-02013c76e4b6 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:34.570836 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ff01c-dd08-431f-b5bc-02013c76e4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:34.571343 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ff01c-dd08-431f-b5bc-02013c76e4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:34.604164 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-c41ff01c-dd08-431f-b5bc-02013c76e4b6 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:34.605394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c41ff01c-dd08-431f-b5bc-02013c76e4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:34.686778 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:34.700288 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 103/202] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:34.731261 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb2b5e-09ed-4336-ba60-900a0e14f0b8 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:34.742614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:34.863836 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb2b5e-09ed-4336-ba60-900a0e14f0b8 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:34.913019 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cd2e6-c7f1-4d6f-8b18-ba4afe80921e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:34.913830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cd2e6-c7f1-4d6f-8b18-ba4afe80921e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:34.914114 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cd2e6-c7f1-4d6f-8b18-ba4afe80921e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:34.914391 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cd2e6-c7f1-4d6f-8b18-ba4afe80921e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:34.930153 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cd2e6-c7f1-4d6f-8b18-ba4afe80921e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:34.938789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-d63cd2e6-c7f1-4d6f-8b18-ba4afe80921e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:54:34.938789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:34.938789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:34.938789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:34.938789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:34.938789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:34.938789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:34.938789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:34.938789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:34.938789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:34.938789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:34.938789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:34.938789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:34.938789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:34.938789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:34.938789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:34.939686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:34.939686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:34.939686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:34.939686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:34.939686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:34.939686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:34.939686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:34.939686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:34.939686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:34.939686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:34.939686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:34.939686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:34.939686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:34.939686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:34.939686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:34.939686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:34.940441 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:34.940441 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:34.940441 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:34.940441 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:34.940441 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:34.940441 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:34.940441 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:34.940441 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:34.940441 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:34.940441 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:34.940441 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:54:34.940441 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:54:34.940441 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 100/203] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:34.947647 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ff01c-dd08-431f-b5bc-02013c76e4b6 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:35.098026 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ff01c-dd08-431f-b5bc-02013c76e4b6 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:35.160353 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb87534-eb7d-477a-88eb-41fde2175550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:35.161300 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb87534-eb7d-477a-88eb-41fde2175550 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:35.161730 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb87534-eb7d-477a-88eb-41fde2175550 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:35.162155 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb87534-eb7d-477a-88eb-41fde2175550 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:35.163391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb87534-eb7d-477a-88eb-41fde2175550 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:35.163880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb87534-eb7d-477a-88eb-41fde2175550 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:35.166320 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb87534-eb7d-477a-88eb-41fde2175550 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:35.181054 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 104/204] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:54:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:35.187893 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cd2e6-c7f1-4d6f-8b18-ba4afe80921e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:35.310728 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:35.370514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cd2e6-c7f1-4d6f-8b18-ba4afe80921e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:35.417762 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1d69d-b77a-4c0c-9eaf-2cbf80a0cca7 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:35.418052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1d69d-b77a-4c0c-9eaf-2cbf80a0cca7 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:35.418336 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1d69d-b77a-4c0c-9eaf-2cbf80a0cca7 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:35.419753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 105/205] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:54:35.421214 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e11d6-0344-4381-a88a-934c46d05c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:35.422093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e11d6-0344-4381-a88a-934c46d05c19 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:35.422377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e11d6-0344-4381-a88a-934c46d05c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:35.422734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e11d6-0344-4381-a88a-934c46d05c19 None admin] PATH_INFO: `/v3/users/e2e8c28d33f54e8cbf59231cde95e27c` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:35.425084 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e11d6-0344-4381-a88a-934c46d05c19 None admin] RBAC: Authorizing `identity:get_user(user_id=e2e8c28d33f54e8cbf59231cde95e27c)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:35.426665 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e11d6-0344-4381-a88a-934c46d05c19 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:35.428592 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 101/206] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:35 2022] GET /identity/v3/users/e2e8c28d33f54e8cbf59231cde95e27c => generated 289 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:35.433295 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8e396-37ca-4b1e-9479-db82b24c572e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:35.434194 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8e396-37ca-4b1e-9479-db82b24c572e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:35.434478 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8e396-37ca-4b1e-9479-db82b24c572e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:35.441090 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e11d6-0344-4381-a88a-934c46d05c19 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:35.462530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e8c8e396-37ca-4b1e-9479-db82b24c572e None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:35.463750 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e8c8e396-37ca-4b1e-9479-db82b24c572e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:35.585114 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:35.601380 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 106/207] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:35.607889 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c2e3a-a6cc-429d-aed7-ef4669c009f4 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:35.608456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c2e3a-a6cc-429d-aed7-ef4669c009f4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:35.608456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c2e3a-a6cc-429d-aed7-ef4669c009f4 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:35.610102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 107/208] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:35.611281 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e11d6-0344-4381-a88a-934c46d05c19 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:35.615057 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700b232-db03-4332-b103-46444c965bcf None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:35.615308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700b232-db03-4332-b103-46444c965bcf None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:35.615592 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700b232-db03-4332-b103-46444c965bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:35.646886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-d700b232-db03-4332-b103-46444c965bcf None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:35.648098 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d700b232-db03-4332-b103-46444c965bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:35.649269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:35.658609 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7c2c4-bda9-470f-ade2-22302dba98c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:35.659635 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7c2c4-bda9-470f-ade2-22302dba98c8 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:35.660586 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7c2c4-bda9-470f-ade2-22302dba98c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:35.661068 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7c2c4-bda9-470f-ade2-22302dba98c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:35.731463 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 108/209] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:35.731463 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700b232-db03-4332-b103-46444c965bcf None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:35.771711 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7c2c4-bda9-470f-ade2-22302dba98c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:35.773556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7c2c4-bda9-470f-ade2-22302dba98c8 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:35.843994 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700b232-db03-4332-b103-46444c965bcf None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:35.865255 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:35.887729 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f26c68-4b84-4f19-b6d6-2edc548566a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:35.889101 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f26c68-4b84-4f19-b6d6-2edc548566a2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:35.889561 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f26c68-4b84-4f19-b6d6-2edc548566a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:35.890159 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f26c68-4b84-4f19-b6d6-2edc548566a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:35.894268 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f26c68-4b84-4f19-b6d6-2edc548566a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:35.896461 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f26c68-4b84-4f19-b6d6-2edc548566a2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:35.898962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 109/210] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:54:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:35.904182 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 102/211] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:54:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:35.904182 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7c2c4-bda9-470f-ade2-22302dba98c8 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:35.906961 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f26c68-4b84-4f19-b6d6-2edc548566a2 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:35.940455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:36.029438 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7c2c4-bda9-470f-ade2-22302dba98c8 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:36.043353 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f26c68-4b84-4f19-b6d6-2edc548566a2 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:36.069584 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f967a2-31be-41df-90cc-b08a9364e4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:36.070996 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f967a2-31be-41df-90cc-b08a9364e4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:36.071583 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f967a2-31be-41df-90cc-b08a9364e4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:36.072066 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f967a2-31be-41df-90cc-b08a9364e4a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:36.084403 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f967a2-31be-41df-90cc-b08a9364e4a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:36.091991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d47a2-d375-48e7-8920-c6f942122d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:36.092678 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d47a2-d375-48e7-8920-c6f942122d9f None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:36.092966 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d47a2-d375-48e7-8920-c6f942122d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:36.093244 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d47a2-d375-48e7-8920-c6f942122d9f None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:36.093968 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d47a2-d375-48e7-8920-c6f942122d9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:36.095509 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d47a2-d375-48e7-8920-c6f942122d9f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:36.095730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-67f967a2-31be-41df-90cc-b08a9364e4a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:36.095730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:36.095730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:36.095730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:36.095730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:36.095730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:36.095730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:36.095730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:36.095730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:36.095730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:36.095730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:36.095730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:36.095730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:36.095730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:36.095730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:36.095730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:36.096544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:36.096544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:36.096544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:36.096544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:36.096544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:36.096544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:36.096544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:36.096544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:36.096544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:36.096544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:36.096544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:36.096544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:36.096544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:36.096544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:36.096544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:36.096544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:36.097333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:36.097333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:36.097333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:36.097333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:36.097333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:36.097333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:36.097333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:36.097333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:36.097333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:36.097333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:36.097333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:36.097333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:54:36.100091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 103/212] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:36.101157 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f967a2-31be-41df-90cc-b08a9364e4a9 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:36.134521 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 110/213] 10.222.0.79 () {60 vars in 1132 bytes} [Thu Jul 14 11:54:35 2022] POST /identity/v3/users => generated 297 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:54:36.134521 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d47a2-d375-48e7-8920-c6f942122d9f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:36.242096 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:36.308011 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:36.320874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f967a2-31be-41df-90cc-b08a9364e4a9 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:36.358031 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d47a2-d375-48e7-8920-c6f942122d9f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:36.367140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408341f2-7631-442d-800d-842c7134ca12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:36.368025 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408341f2-7631-442d-800d-842c7134ca12 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:36.368310 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408341f2-7631-442d-800d-842c7134ca12 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:36.368607 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408341f2-7631-442d-800d-842c7134ca12 None admin] PATH_INFO: `/v3/projects/05ae476a690b4d899f0bd474f195f9ea` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:36.370391 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408341f2-7631-442d-800d-842c7134ca12 None admin] RBAC: Authorizing `identity:get_project(project_id=05ae476a690b4d899f0bd474f195f9ea)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:36.371467 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408341f2-7631-442d-800d-842c7134ca12 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:36.373421 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 104/214] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:36 2022] GET /identity/v3/projects/05ae476a690b4d899f0bd474f195f9ea => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:36.379142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408341f2-7631-442d-800d-842c7134ca12 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:36.412143 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0858f4d-4654-412a-a295-0a0f0f7a61a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:36.413175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0858f4d-4654-412a-a295-0a0f0f7a61a3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:36.413947 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0858f4d-4654-412a-a295-0a0f0f7a61a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:36.414404 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0858f4d-4654-412a-a295-0a0f0f7a61a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:36.416027 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0858f4d-4654-412a-a295-0a0f0f7a61a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:36.416494 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0858f4d-4654-412a-a295-0a0f0f7a61a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:36.418963 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0858f4d-4654-412a-a295-0a0f0f7a61a3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:36.430796 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 111/215] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:54:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:36.435934 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0858f4d-4654-412a-a295-0a0f0f7a61a3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:36.518510 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408341f2-7631-442d-800d-842c7134ca12 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:36.575001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7508b-d736-4c65-aedd-cdc18b5915a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:36.575897 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7508b-d736-4c65-aedd-cdc18b5915a9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:36.576228 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7508b-d736-4c65-aedd-cdc18b5915a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:36.576923 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7508b-d736-4c65-aedd-cdc18b5915a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:36.577831 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7508b-d736-4c65-aedd-cdc18b5915a9 None admin] RBAC: Adding query filter params (role.id=78a510490d1e423c89a3b430c8530483, scope.project.id=05ae476a690b4d899f0bd474f195f9ea, user.id=e2e8c28d33f54e8cbf59231cde95e27c) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:36.578148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7508b-d736-4c65-aedd-cdc18b5915a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:36.579924 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7508b-d736-4c65-aedd-cdc18b5915a9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:36.584864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0858f4d-4654-412a-a295-0a0f0f7a61a3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:36.590366 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 105/216] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:54:36 2022] GET /identity/v3/role_assignments?user.id=e2e8c28d33f54e8cbf59231cde95e27c&scope.project.id=05ae476a690b4d899f0bd474f195f9ea&role.id=78a510490d1e423c89a3b430c8530483 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:36.594465 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:36.642278 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3acf60-3baf-4dce-b06a-73c05e13d90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:36.644004 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3acf60-3baf-4dce-b06a-73c05e13d90d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:36.644470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3acf60-3baf-4dce-b06a-73c05e13d90d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:36.645029 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3acf60-3baf-4dce-b06a-73c05e13d90d None admin] PATH_INFO: `/v3/users/0ffd6cf4fc554f1f8bd887bbf29de1c4` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:36.661237 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75833f-0bab-41b5-8d44-a03d80a01061 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:36.662387 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75833f-0bab-41b5-8d44-a03d80a01061 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:36.662887 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75833f-0bab-41b5-8d44-a03d80a01061 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:36.664552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 106/217] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:54:36.669365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3acf60-3baf-4dce-b06a-73c05e13d90d None admin] RBAC: Authorizing `identity:get_user(user_id=0ffd6cf4fc554f1f8bd887bbf29de1c4)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:36.671031 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3acf60-3baf-4dce-b06a-73c05e13d90d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:36.672447 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16862530-dea8-4c22-86a5-b8d14a417c94 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:36.672947 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16862530-dea8-4c22-86a5-b8d14a417c94 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:36.673060 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 112/218] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:36 2022] GET /identity/v3/users/0ffd6cf4fc554f1f8bd887bbf29de1c4 => generated 297 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:36.673174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16862530-dea8-4c22-86a5-b8d14a417c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:36.681418 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3acf60-3baf-4dce-b06a-73c05e13d90d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:36.692297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-16862530-dea8-4c22-86a5-b8d14a417c94 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:36.693913 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-16862530-dea8-4c22-86a5-b8d14a417c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:36.719004 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:36.806219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 107/219] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:36.841919 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16862530-dea8-4c22-86a5-b8d14a417c94 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:36.844146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3acf60-3baf-4dce-b06a-73c05e13d90d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:36.893347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917c83e-759d-47dc-9f30-c73b8e7edfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:36.894019 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917c83e-759d-47dc-9f30-c73b8e7edfd5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:36.894352 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917c83e-759d-47dc-9f30-c73b8e7edfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:36.894660 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917c83e-759d-47dc-9f30-c73b8e7edfd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:36.930100 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:36.973625 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917c83e-759d-47dc-9f30-c73b8e7edfd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:36.978585 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917c83e-759d-47dc-9f30-c73b8e7edfd5 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:37.007941 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16862530-dea8-4c22-86a5-b8d14a417c94 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:37.066081 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96bb7b-9c3d-4fbb-9f5f-fd961cecff25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:37.067303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96bb7b-9c3d-4fbb-9f5f-fd961cecff25 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:37.067811 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96bb7b-9c3d-4fbb-9f5f-fd961cecff25 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:37.068287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96bb7b-9c3d-4fbb-9f5f-fd961cecff25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:37.087886 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96bb7b-9c3d-4fbb-9f5f-fd961cecff25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:37.089634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 113/220] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:54:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 11:54:37.096439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-4a96bb7b-9c3d-4fbb-9f5f-fd961cecff25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:54:37.096439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:37.096439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:37.096439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:37.096439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:37.096439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:37.096439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:37.096439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:37.096439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:37.096439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:37.096439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:37.096439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:37.096439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:37.096439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:37.096439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:37.096439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:37.097365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:37.097365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:37.097365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:37.097365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:37.097365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:37.097365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:37.097365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:37.097365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:37.097365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:37.097365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:37.097365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:37.097365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:37.097365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:37.097365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:37.097365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:37.097365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:37.098144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:37.098144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:37.098144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:37.098144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:37.098144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:37.098144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:37.098144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:37.098144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:37.098144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:37.098144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:37.098144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:54:37.098144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:54:37.104422 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 108/221] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:54:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:54:37.110071 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917c83e-759d-47dc-9f30-c73b8e7edfd5 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:37.111602 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96bb7b-9c3d-4fbb-9f5f-fd961cecff25 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:37.146525 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:37.211331 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:37.248702 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96bb7b-9c3d-4fbb-9f5f-fd961cecff25 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:37.258532 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917c83e-759d-47dc-9f30-c73b8e7edfd5 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:37.287003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3ebc9-216c-4f92-ba4b-7eec0af698d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:37.287685 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3ebc9-216c-4f92-ba4b-7eec0af698d6 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:37.287968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3ebc9-216c-4f92-ba4b-7eec0af698d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:37.288252 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3ebc9-216c-4f92-ba4b-7eec0af698d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:37.289118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3ebc9-216c-4f92-ba4b-7eec0af698d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:37.289541 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3ebc9-216c-4f92-ba4b-7eec0af698d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:37.290975 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3ebc9-216c-4f92-ba4b-7eec0af698d6 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:37.294527 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3b7fe-4cd1-4570-bdd5-8f295dfcd399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:37.295400 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3b7fe-4cd1-4570-bdd5-8f295dfcd399 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:37.295689 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3b7fe-4cd1-4570-bdd5-8f295dfcd399 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:37.295970 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3b7fe-4cd1-4570-bdd5-8f295dfcd399 None admin] PATH_INFO: `/v3/projects/bf999b1796e2439bb0a35f1812856355` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:37.297271 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3b7fe-4cd1-4570-bdd5-8f295dfcd399 None admin] RBAC: Authorizing `identity:get_project(project_id=bf999b1796e2439bb0a35f1812856355)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:37.298812 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3b7fe-4cd1-4570-bdd5-8f295dfcd399 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:37.300191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 109/222] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:37.300540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 114/223] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:37 2022] GET /identity/v3/projects/bf999b1796e2439bb0a35f1812856355 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:37.301509 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72357e2d-6ed6-49cf-95eb-f7cff058da49 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:37.301856 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72357e2d-6ed6-49cf-95eb-f7cff058da49 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:37.302396 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72357e2d-6ed6-49cf-95eb-f7cff058da49 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:37.303784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 110/224] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:37.306701 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3b7fe-4cd1-4570-bdd5-8f295dfcd399 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:37.307824 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72357e2d-6ed6-49cf-95eb-f7cff058da49 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:37.412272 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:37.451482 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3b7fe-4cd1-4570-bdd5-8f295dfcd399 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:37.451988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72357e2d-6ed6-49cf-95eb-f7cff058da49 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:37.484057 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:37.491901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587782f-0cdd-4c23-9ed3-e3d782cbc2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:37.493012 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587782f-0cdd-4c23-9ed3-e3d782cbc2ce None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:37.493389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587782f-0cdd-4c23-9ed3-e3d782cbc2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:37.493761 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587782f-0cdd-4c23-9ed3-e3d782cbc2ce None admin] PATH_INFO: `/v3/users/c1676f2cdcc1480fb5a832e8d7146183` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:37.494830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34115a72-af9a-45a9-931d-833fd9551a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:37.495275 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587782f-0cdd-4c23-9ed3-e3d782cbc2ce None admin] RBAC: Authorizing `identity:get_user(user_id=c1676f2cdcc1480fb5a832e8d7146183)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:37.495492 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34115a72-af9a-45a9-931d-833fd9551a63 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:37.495781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34115a72-af9a-45a9-931d-833fd9551a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:37.496587 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34115a72-af9a-45a9-931d-833fd9551a63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:37.497436 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34115a72-af9a-45a9-931d-833fd9551a63 None admin] RBAC: Adding query filter params (role.id=9a3a3371dd4d4405b2e4604acc314d43, scope.project.id=bf999b1796e2439bb0a35f1812856355, user.id=0ffd6cf4fc554f1f8bd887bbf29de1c4) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:37.497757 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34115a72-af9a-45a9-931d-833fd9551a63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:37.497876 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587782f-0cdd-4c23-9ed3-e3d782cbc2ce None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:37.499233 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34115a72-af9a-45a9-931d-833fd9551a63 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:37.499801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 115/225] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:37 2022] GET /identity/v3/users/c1676f2cdcc1480fb5a832e8d7146183 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:37.501210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7155565-f312-4590-a300-44f992113cd0 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:37.501603 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7155565-f312-4590-a300-44f992113cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:37.501976 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7155565-f312-4590-a300-44f992113cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:37.511816 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 111/226] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:54:37 2022] GET /identity/v3/role_assignments?user.id=0ffd6cf4fc554f1f8bd887bbf29de1c4&scope.project.id=bf999b1796e2439bb0a35f1812856355&role.id=9a3a3371dd4d4405b2e4604acc314d43 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:37.513231 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34115a72-af9a-45a9-931d-833fd9551a63 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:37.528644 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-b7155565-f312-4590-a300-44f992113cd0 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:37.530216 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b7155565-f312-4590-a300-44f992113cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:37.625136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 116/227] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:37.647083 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34115a72-af9a-45a9-931d-833fd9551a63 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:37.652655 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7155565-f312-4590-a300-44f992113cd0 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:37.742019 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38f73d-dfa3-4f2c-89c0-090dafb821a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:37.743825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38f73d-dfa3-4f2c-89c0-090dafb821a3 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:37.744394 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38f73d-dfa3-4f2c-89c0-090dafb821a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:37.744908 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38f73d-dfa3-4f2c-89c0-090dafb821a3 None admin] PATH_INFO: `/v3/projects/bf999b1796e2439bb0a35f1812856355` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:37.746996 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38f73d-dfa3-4f2c-89c0-090dafb821a3 None admin] RBAC: Authorizing `identity:get_project(project_id=bf999b1796e2439bb0a35f1812856355)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:37.748237 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38f73d-dfa3-4f2c-89c0-090dafb821a3 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:37.751019 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 112/228] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:37 2022] GET /identity/v3/projects/bf999b1796e2439bb0a35f1812856355 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:37.756760 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38f73d-dfa3-4f2c-89c0-090dafb821a3 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:37.790897 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:37.893083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7155565-f312-4590-a300-44f992113cd0 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:37.950848 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:37.959197 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38f73d-dfa3-4f2c-89c0-090dafb821a3 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:37.963386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5b065-7728-4090-a5f6-dbfa4b2a4d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:37.964227 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5b065-7728-4090-a5f6-dbfa4b2a4d5d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:37.964516 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5b065-7728-4090-a5f6-dbfa4b2a4d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:37.965418 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5b065-7728-4090-a5f6-dbfa4b2a4d5d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:37.988863 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5b065-7728-4090-a5f6-dbfa4b2a4d5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:37.999845 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-37a5b065-7728-4090-a5f6-dbfa4b2a4d5d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:54:37.999845 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:37.999845 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:37.999845 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:37.999845 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:37.999845 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:37.999845 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:37.999845 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:37.999845 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:37.999845 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:37.999845 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:37.999845 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:37.999845 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:37.999845 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:37.999845 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:37.999845 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:38.000734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:38.000734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:38.000734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:38.000734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:38.000734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:38.000734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:38.000734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:38.000734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:38.000734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:38.000734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:38.000734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:38.000734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:38.000734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:38.000734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:38.000734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:38.000734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:38.001503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:38.001503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:38.001503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:38.001503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:38.001503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:38.001503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:38.001503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:38.001503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:38.001503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:38.001503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:38.001503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:54:38.001503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:54:38.010166 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 117/229] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Jul 14 11:54:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:54:38.013884 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5b065-7728-4090-a5f6-dbfa4b2a4d5d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:38.040586 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ced938-281d-4b1e-ae10-3367d13d493f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:38.041552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ced938-281d-4b1e-ae10-3367d13d493f None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:38.041841 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ced938-281d-4b1e-ae10-3367d13d493f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:38.042123 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ced938-281d-4b1e-ae10-3367d13d493f None admin] PATH_INFO: `/v3/projects/bf999b1796e2439bb0a35f1812856355/users/c1676f2cdcc1480fb5a832e8d7146183/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:38.044355 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ced938-281d-4b1e-ae10-3367d13d493f None admin] RBAC: Authorizing `identity:create_grant(project_id=bf999b1796e2439bb0a35f1812856355, user_id=c1676f2cdcc1480fb5a832e8d7146183, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:38.045937 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ced938-281d-4b1e-ae10-3367d13d493f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:38.089937 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 113/230] 10.222.0.79 () {58 vars in 1439 bytes} [Thu Jul 14 11:54:37 2022] PUT /identity/v3/projects/bf999b1796e2439bb0a35f1812856355/users/c1676f2cdcc1480fb5a832e8d7146183/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:54:38.188515 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5b065-7728-4090-a5f6-dbfa4b2a4d5d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:38.244080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071d3a1-85a3-42b4-ba96-efd620ae67c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:38.244884 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071d3a1-85a3-42b4-ba96-efd620ae67c2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:38.245176 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071d3a1-85a3-42b4-ba96-efd620ae67c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:38.245548 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071d3a1-85a3-42b4-ba96-efd620ae67c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:38.246509 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071d3a1-85a3-42b4-ba96-efd620ae67c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:38.246836 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071d3a1-85a3-42b4-ba96-efd620ae67c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:38.248376 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071d3a1-85a3-42b4-ba96-efd620ae67c2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:38.259028 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 118/231] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:54:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:38.264316 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ced938-281d-4b1e-ae10-3367d13d493f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:38.380374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:38.425717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ced938-281d-4b1e-ae10-3367d13d493f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:38.466041 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befd7b0-407a-4c1b-8070-4d0bd3c2d53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:38.467413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befd7b0-407a-4c1b-8070-4d0bd3c2d53b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:38.467938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befd7b0-407a-4c1b-8070-4d0bd3c2d53b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:38.468410 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befd7b0-407a-4c1b-8070-4d0bd3c2d53b None admin] PATH_INFO: `/v3/users/c1676f2cdcc1480fb5a832e8d7146183` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:38.470316 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befd7b0-407a-4c1b-8070-4d0bd3c2d53b None admin] RBAC: Authorizing `identity:get_user(user_id=c1676f2cdcc1480fb5a832e8d7146183)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:38.472253 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befd7b0-407a-4c1b-8070-4d0bd3c2d53b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:38.474478 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 114/232] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:38 2022] GET /identity/v3/users/c1676f2cdcc1480fb5a832e8d7146183 => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:38.480148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071d3a1-85a3-42b4-ba96-efd620ae67c2 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:38.540407 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:38.611398 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071d3a1-85a3-42b4-ba96-efd620ae67c2 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:38.665945 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00118ee5-8016-44e9-b632-08b44df10d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:38.666847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00118ee5-8016-44e9-b632-08b44df10d72 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:38.667137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00118ee5-8016-44e9-b632-08b44df10d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:38.667417 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00118ee5-8016-44e9-b632-08b44df10d72 None admin] PATH_INFO: `/v3/projects/bf999b1796e2439bb0a35f1812856355` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:38.668727 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00118ee5-8016-44e9-b632-08b44df10d72 None admin] RBAC: Authorizing `identity:get_project(project_id=bf999b1796e2439bb0a35f1812856355)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:38.670186 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00118ee5-8016-44e9-b632-08b44df10d72 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:38.672254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 119/233] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:38 2022] GET /identity/v3/projects/bf999b1796e2439bb0a35f1812856355 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:38.677966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befd7b0-407a-4c1b-8070-4d0bd3c2d53b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:38.841527 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befd7b0-407a-4c1b-8070-4d0bd3c2d53b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:38.888643 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc358ff-205c-4fad-af5c-7b9849efcf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:38.889539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc358ff-205c-4fad-af5c-7b9849efcf69 None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:38.889821 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc358ff-205c-4fad-af5c-7b9849efcf69 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:38.890096 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc358ff-205c-4fad-af5c-7b9849efcf69 None admin] PATH_INFO: `/v3/projects/bf999b1796e2439bb0a35f1812856355/users/c1676f2cdcc1480fb5a832e8d7146183/roles/986e347cbb9e43e7a49dfef9be8ec9dd` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:38.892385 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc358ff-205c-4fad-af5c-7b9849efcf69 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf999b1796e2439bb0a35f1812856355, user_id=c1676f2cdcc1480fb5a832e8d7146183, role_id=986e347cbb9e43e7a49dfef9be8ec9dd)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:38.893843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc358ff-205c-4fad-af5c-7b9849efcf69 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:38.897142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:38.916955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 115/234] 10.222.0.79 () {58 vars in 1439 bytes} [Thu Jul 14 11:54:38 2022] PUT /identity/v3/projects/bf999b1796e2439bb0a35f1812856355/users/c1676f2cdcc1480fb5a832e8d7146183/roles/986e347cbb9e43e7a49dfef9be8ec9dd => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:54:39.080750 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c969096-33d4-4fb7-86d4-56fe3b41c249 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:39.081402 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c969096-33d4-4fb7-86d4-56fe3b41c249 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:39.081902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c969096-33d4-4fb7-86d4-56fe3b41c249 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:39.083907 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 120/235] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:39.100297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f913480-63b7-4a74-8595-164520e43170 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:39.100580 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f913480-63b7-4a74-8595-164520e43170 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:39.100774 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f913480-63b7-4a74-8595-164520e43170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:39.128112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-9f913480-63b7-4a74-8595-164520e43170 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:39.129356 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-9f913480-63b7-4a74-8595-164520e43170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:39.207681 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 116/236] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:54:39.231636 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c969096-33d4-4fb7-86d4-56fe3b41c249 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:39.272009 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6860ae-0bdd-4e9b-b01f-71f7814a7f13 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:39.272522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6860ae-0bdd-4e9b-b01f-71f7814a7f13 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:39.272938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6860ae-0bdd-4e9b-b01f-71f7814a7f13 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:39.274624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 117/237] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:39.282050 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f8b62-eab7-4d53-b14e-c73348125534 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:39.282656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f8b62-eab7-4d53-b14e-c73348125534 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:39.283130 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f8b62-eab7-4d53-b14e-c73348125534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:39.301714 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-a31f8b62-eab7-4d53-b14e-c73348125534 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:39.303853 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a31f8b62-eab7-4d53-b14e-c73348125534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:39.381188 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 118/238] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:54:39.387786 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c969096-33d4-4fb7-86d4-56fe3b41c249 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:39.409776 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f8b62-eab7-4d53-b14e-c73348125534 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:39.411146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:39.437830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d8ee3-76bc-416d-9bbb-6a7c497f3326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:39.438673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d8ee3-76bc-416d-9bbb-6a7c497f3326 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:39.438958 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d8ee3-76bc-416d-9bbb-6a7c497f3326 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:39.439235 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d8ee3-76bc-416d-9bbb-6a7c497f3326 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:39.443152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d8ee3-76bc-416d-9bbb-6a7c497f3326 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:39.444631 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d8ee3-76bc-416d-9bbb-6a7c497f3326 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:39.446349 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 121/239] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:54:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:39.454143 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d8ee3-76bc-416d-9bbb-6a7c497f3326 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:39.539431 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:39.578446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f8b62-eab7-4d53-b14e-c73348125534 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:39.624851 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a27b53-334e-4c28-9bef-50b3b73d2fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:39.626138 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a27b53-334e-4c28-9bef-50b3b73d2fca None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:39.626591 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a27b53-334e-4c28-9bef-50b3b73d2fca None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:39.627063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a27b53-334e-4c28-9bef-50b3b73d2fca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:39.641891 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d8ee3-76bc-416d-9bbb-6a7c497f3326 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:39.647311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a27b53-334e-4c28-9bef-50b3b73d2fca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:39.661614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-85a27b53-334e-4c28-9bef-50b3b73d2fca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:54:39.661614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:39.661614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:39.661614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:39.661614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:39.661614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:39.661614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:39.661614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:39.661614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:39.661614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:39.661614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:39.661614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:39.661614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:39.661614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:39.661614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:39.661614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:39.662575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:39.662575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:39.662575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:39.662575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:39.662575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:39.662575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:39.662575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:39.662575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:39.662575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:39.662575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:39.662575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:39.662575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:39.662575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:39.662575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:39.662575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:39.662575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:39.663347 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:39.663347 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:39.663347 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:39.663347 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:39.663347 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:39.663347 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:39.663347 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:39.663347 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:39.663347 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:39.663347 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:39.663347 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:54:39.663347 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:54:39.671189 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 119/240] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:39.677638 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a27b53-334e-4c28-9bef-50b3b73d2fca None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:39.680904 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88468a2-2d2c-4120-b329-43eab6035595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:39.681595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88468a2-2d2c-4120-b329-43eab6035595 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:39.681886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88468a2-2d2c-4120-b329-43eab6035595 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:39.682168 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88468a2-2d2c-4120-b329-43eab6035595 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:39.683015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88468a2-2d2c-4120-b329-43eab6035595 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:39.685096 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88468a2-2d2c-4120-b329-43eab6035595 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:39.720653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 122/241] 10.222.0.79 () {60 vars in 1132 bytes} [Thu Jul 14 11:54:39 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:54:39.850475 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a27b53-334e-4c28-9bef-50b3b73d2fca None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:39.875858 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:39.901561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de053e-9b52-4d1a-b993-a7c47325922d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:39.903111 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de053e-9b52-4d1a-b993-a7c47325922d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:39.903629 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de053e-9b52-4d1a-b993-a7c47325922d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:39.904107 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de053e-9b52-4d1a-b993-a7c47325922d None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:39.905059 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de053e-9b52-4d1a-b993-a7c47325922d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:39.905562 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de053e-9b52-4d1a-b993-a7c47325922d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:39.908402 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de053e-9b52-4d1a-b993-a7c47325922d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:39.919162 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 120/242] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:54:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:39.924919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88468a2-2d2c-4120-b329-43eab6035595 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:39.982639 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:40.044482 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88468a2-2d2c-4120-b329-43eab6035595 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:40.083009 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c7102-43ab-49be-bb49-6aa73f03fa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:40.083904 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c7102-43ab-49be-bb49-6aa73f03fa9e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:40.084189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c7102-43ab-49be-bb49-6aa73f03fa9e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:40.084467 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c7102-43ab-49be-bb49-6aa73f03fa9e None admin] PATH_INFO: `/v3/users/5c458fca79fc41fb89dcc457f699d896` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:40.101473 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c7102-43ab-49be-bb49-6aa73f03fa9e None admin] RBAC: Authorizing `identity:get_user(user_id=5c458fca79fc41fb89dcc457f699d896)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:40.102978 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c7102-43ab-49be-bb49-6aa73f03fa9e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:40.105063 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 123/243] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:39 2022] GET /identity/v3/users/5c458fca79fc41fb89dcc457f699d896 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:40.111474 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de053e-9b52-4d1a-b993-a7c47325922d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:40.239215 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de053e-9b52-4d1a-b993-a7c47325922d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:40.265472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303315c3-e89b-45a0-ba5f-f41d6eaf95a3 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:40.266095 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303315c3-e89b-45a0-ba5f-f41d6eaf95a3 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:40.266599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303315c3-e89b-45a0-ba5f-f41d6eaf95a3 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:40.268470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 124/244] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:40.274487 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8fb0d-384c-4223-aeb5-e0072d793d79 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:40.275117 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8fb0d-384c-4223-aeb5-e0072d793d79 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:40.275592 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8fb0d-384c-4223-aeb5-e0072d793d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:40.281293 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adc1d6-d17d-4ae7-94cc-73cedbbce39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:40.281953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adc1d6-d17d-4ae7-94cc-73cedbbce39a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:40.282241 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adc1d6-d17d-4ae7-94cc-73cedbbce39a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:40.282558 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adc1d6-d17d-4ae7-94cc-73cedbbce39a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:40.305769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-60b8fb0d-384c-4223-aeb5-e0072d793d79 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:40.307410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-60b8fb0d-384c-4223-aeb5-e0072d793d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:40.340835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:40.366066 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adc1d6-d17d-4ae7-94cc-73cedbbce39a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:40.368020 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adc1d6-d17d-4ae7-94cc-73cedbbce39a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:40.398926 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 125/245] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:40.424071 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8fb0d-384c-4223-aeb5-e0072d793d79 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:40.463084 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:40.483638 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 121/246] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:54:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:40.493119 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adc1d6-d17d-4ae7-94cc-73cedbbce39a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:40.565401 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8fb0d-384c-4223-aeb5-e0072d793d79 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:40.590372 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:40.610786 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911994e-90ae-4ba3-8c59-4762cf36a689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:40.611646 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911994e-90ae-4ba3-8c59-4762cf36a689 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:40.611935 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911994e-90ae-4ba3-8c59-4762cf36a689 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:40.612212 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911994e-90ae-4ba3-8c59-4762cf36a689 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:40.621227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adc1d6-d17d-4ae7-94cc-73cedbbce39a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:40.626863 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911994e-90ae-4ba3-8c59-4762cf36a689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:40.635089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-b911994e-90ae-4ba3-8c59-4762cf36a689 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:40.635089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:40.635089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:40.635089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:40.635089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:40.635089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:40.635089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:40.635089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:40.635089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:40.635089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:40.635089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:40.635089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:40.635089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:40.635089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:40.635089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:40.635089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:40.636165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:40.636165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:40.636165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:40.636165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:40.636165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:40.636165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:40.636165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:40.636165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:40.636165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:40.636165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:40.636165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:40.636165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:40.636165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:40.636165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:40.636165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:40.636165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:40.637071 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:40.637071 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:40.637071 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:40.637071 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:40.637071 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:40.637071 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:40.637071 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:40.637071 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:40.637071 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:40.637071 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:40.637071 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:40.637071 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:54:40.643036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 126/247] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:40.644458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911994e-90ae-4ba3-8c59-4762cf36a689 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:40.669947 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269d78e-b535-4edd-9fd4-2bef5c9ece68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:40.671696 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269d78e-b535-4edd-9fd4-2bef5c9ece68 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:40.672379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269d78e-b535-4edd-9fd4-2bef5c9ece68 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:40.672795 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269d78e-b535-4edd-9fd4-2bef5c9ece68 None admin] PATH_INFO: `/v3/projects/bf999b1796e2439bb0a35f1812856355` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:40.675033 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269d78e-b535-4edd-9fd4-2bef5c9ece68 None admin] RBAC: Authorizing `identity:get_project(project_id=bf999b1796e2439bb0a35f1812856355)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:40.677030 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269d78e-b535-4edd-9fd4-2bef5c9ece68 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:40.680167 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 122/248] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:40 2022] GET /identity/v3/projects/bf999b1796e2439bb0a35f1812856355 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:40.686696 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269d78e-b535-4edd-9fd4-2bef5c9ece68 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:40.759868 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:40.771548 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911994e-90ae-4ba3-8c59-4762cf36a689 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:40.800980 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269d78e-b535-4edd-9fd4-2bef5c9ece68 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:40.811998 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d908e36-e715-4478-bf10-af28c9be9ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:40.812322 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d908e36-e715-4478-bf10-af28c9be9ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:40.812542 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d908e36-e715-4478-bf10-af28c9be9ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:40.812814 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d908e36-e715-4478-bf10-af28c9be9ac9 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:40.813591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d908e36-e715-4478-bf10-af28c9be9ac9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:40.813906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d908e36-e715-4478-bf10-af28c9be9ac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:40.815504 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d908e36-e715-4478-bf10-af28c9be9ac9 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:40.834531 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 127/249] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:54:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:40.837072 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d908e36-e715-4478-bf10-af28c9be9ac9 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:40.871069 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05ebff-cce7-4fda-99af-c419bf1d6823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:40.871887 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05ebff-cce7-4fda-99af-c419bf1d6823 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:40.872199 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05ebff-cce7-4fda-99af-c419bf1d6823 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:40.872346 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05ebff-cce7-4fda-99af-c419bf1d6823 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:40.874764 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05ebff-cce7-4fda-99af-c419bf1d6823 None admin] RBAC: Adding query filter params (role.id=78a510490d1e423c89a3b430c8530483, scope.project.id=bf999b1796e2439bb0a35f1812856355, user.id=5c458fca79fc41fb89dcc457f699d896) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:40.875093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05ebff-cce7-4fda-99af-c419bf1d6823 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:40.876616 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05ebff-cce7-4fda-99af-c419bf1d6823 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:40.892765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 123/250] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:54:40 2022] GET /identity/v3/role_assignments?user.id=5c458fca79fc41fb89dcc457f699d896&scope.project.id=bf999b1796e2439bb0a35f1812856355&role.id=78a510490d1e423c89a3b430c8530483 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:40.980486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d908e36-e715-4478-bf10-af28c9be9ac9 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:41.019276 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69753d-b62b-4297-88f9-6bda2dd1d859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:41.020072 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69753d-b62b-4297-88f9-6bda2dd1d859 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:41.020359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69753d-b62b-4297-88f9-6bda2dd1d859 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:41.020639 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69753d-b62b-4297-88f9-6bda2dd1d859 None admin] PATH_INFO: `/v3/users/0ffd6cf4fc554f1f8bd887bbf29de1c4` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:41.022002 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69753d-b62b-4297-88f9-6bda2dd1d859 None admin] RBAC: Authorizing `identity:get_user(user_id=0ffd6cf4fc554f1f8bd887bbf29de1c4)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:41.023748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69753d-b62b-4297-88f9-6bda2dd1d859 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:41.025413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155de41-ed2c-4a72-a0b2-98dc12eea9c1 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:41.025712 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155de41-ed2c-4a72-a0b2-98dc12eea9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:41.025991 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155de41-ed2c-4a72-a0b2-98dc12eea9c1 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:41.028318 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 124/252] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:54:41.028477 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 128/252] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:40 2022] GET /identity/v3/users/0ffd6cf4fc554f1f8bd887bbf29de1c4 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:41.035879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155de41-ed2c-4a72-a0b2-98dc12eea9c1 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:41.040677 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52b6c5-bedf-43f3-a922-62f83d010a92 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:41.040968 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52b6c5-bedf-43f3-a922-62f83d010a92 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:41.041237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52b6c5-bedf-43f3-a922-62f83d010a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:41.069205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6b52b6c5-bedf-43f3-a922-62f83d010a92 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:41.072053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6b52b6c5-bedf-43f3-a922-62f83d010a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:41.086914 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:41.121754 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:41.230106 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 129/253] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:54:41.266020 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52b6c5-bedf-43f3-a922-62f83d010a92 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:41.276406 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155de41-ed2c-4a72-a0b2-98dc12eea9c1 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:41.334086 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a729e4-7fce-452c-b403-163616cfb18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:41.335302 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a729e4-7fce-452c-b403-163616cfb18b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:41.335736 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a729e4-7fce-452c-b403-163616cfb18b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:41.336159 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a729e4-7fce-452c-b403-163616cfb18b None admin] PATH_INFO: `/v3/projects/bf999b1796e2439bb0a35f1812856355` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:41.337604 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a729e4-7fce-452c-b403-163616cfb18b None admin] RBAC: Authorizing `identity:get_project(project_id=bf999b1796e2439bb0a35f1812856355)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:41.339325 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a729e4-7fce-452c-b403-163616cfb18b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:41.341714 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 125/254] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:41 2022] GET /identity/v3/projects/bf999b1796e2439bb0a35f1812856355 => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:41.348363 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a729e4-7fce-452c-b403-163616cfb18b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:41.440119 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52b6c5-bedf-43f3-a922-62f83d010a92 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:41.482911 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:41.502009 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef048eac-b798-4033-817e-6008c44149f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:41.502848 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef048eac-b798-4033-817e-6008c44149f3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:41.503136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef048eac-b798-4033-817e-6008c44149f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:41.503413 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef048eac-b798-4033-817e-6008c44149f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:41.523635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef048eac-b798-4033-817e-6008c44149f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:41.533256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a729e4-7fce-452c-b403-163616cfb18b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:41.537093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-ef048eac-b798-4033-817e-6008c44149f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:54:41.537093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:41.537093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:41.537093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:41.537093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:41.537093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:41.537093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:41.537093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:41.537093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:41.537093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:41.537093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:41.537093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:41.537093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:41.537093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:41.537093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:41.537093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:41.537946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:41.537946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:41.537946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:41.537946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:41.537946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:41.537946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:41.537946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:41.537946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:41.537946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:41.537946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:41.537946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:41.537946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:41.537946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:41.537946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:41.537946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:41.537946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:41.538745 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:41.538745 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:41.538745 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:41.538745 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:41.538745 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:41.538745 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:41.538745 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:41.538745 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:41.538745 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:41.538745 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:41.538745 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:54:41.538745 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:54:41.544883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 130/255] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:54:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:54:41.551481 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef048eac-b798-4033-817e-6008c44149f3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:41.595743 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:41.613806 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71717a01-faef-4523-a577-24008a9fde4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:41.614803 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71717a01-faef-4523-a577-24008a9fde4a None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:41.615093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71717a01-faef-4523-a577-24008a9fde4a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:41.615376 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71717a01-faef-4523-a577-24008a9fde4a None admin] PATH_INFO: `/v3/projects/bf999b1796e2439bb0a35f1812856355/users/0ffd6cf4fc554f1f8bd887bbf29de1c4/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:41.620680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71717a01-faef-4523-a577-24008a9fde4a None admin] RBAC: Authorizing `identity:create_grant(project_id=bf999b1796e2439bb0a35f1812856355, user_id=0ffd6cf4fc554f1f8bd887bbf29de1c4, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:41.622910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71717a01-faef-4523-a577-24008a9fde4a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:41.655872 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 126/256] 10.222.0.79 () {58 vars in 1439 bytes} [Thu Jul 14 11:54:41 2022] PUT /identity/v3/projects/bf999b1796e2439bb0a35f1812856355/users/0ffd6cf4fc554f1f8bd887bbf29de1c4/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:54:41.743621 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef048eac-b798-4033-817e-6008c44149f3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:41.800798 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21b2e0-3c00-4398-b311-a5b9fa489722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:41.801426 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21b2e0-3c00-4398-b311-a5b9fa489722 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:41.801683 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21b2e0-3c00-4398-b311-a5b9fa489722 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:41.801960 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21b2e0-3c00-4398-b311-a5b9fa489722 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:41.803017 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21b2e0-3c00-4398-b311-a5b9fa489722 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:41.803325 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21b2e0-3c00-4398-b311-a5b9fa489722 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:41.804756 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21b2e0-3c00-4398-b311-a5b9fa489722 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:41.818371 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 131/257] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:41.824861 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71717a01-faef-4523-a577-24008a9fde4a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:41.964915 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71717a01-faef-4523-a577-24008a9fde4a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:42.011142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0284bcf-7189-48fd-a335-ea6cd56a6b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:42.013001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0284bcf-7189-48fd-a335-ea6cd56a6b93 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:42.013492 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0284bcf-7189-48fd-a335-ea6cd56a6b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:42.014018 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0284bcf-7189-48fd-a335-ea6cd56a6b93 None admin] PATH_INFO: `/v3/users/c1676f2cdcc1480fb5a832e8d7146183` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:42.019255 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0284bcf-7189-48fd-a335-ea6cd56a6b93 None admin] RBAC: Authorizing `identity:get_user(user_id=c1676f2cdcc1480fb5a832e8d7146183)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:42.020990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0284bcf-7189-48fd-a335-ea6cd56a6b93 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:42.023397 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 127/258] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:41 2022] GET /identity/v3/users/c1676f2cdcc1480fb5a832e8d7146183 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:42.029375 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21b2e0-3c00-4398-b311-a5b9fa489722 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:42.077402 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4baced-b547-4e03-af21-9111c6d6b782 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:42.077705 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4baced-b547-4e03-af21-9111c6d6b782 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:42.077887 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4baced-b547-4e03-af21-9111c6d6b782 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:42.079368 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 128/259] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:42.092462 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf95c16-16d1-483a-a71a-f3c80cad9e5e None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:42.092781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf95c16-16d1-483a-a71a-f3c80cad9e5e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:42.093015 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf95c16-16d1-483a-a71a-f3c80cad9e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:42.112711 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:42.120414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-7cf95c16-16d1-483a-a71a-f3c80cad9e5e None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:42.122702 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-7cf95c16-16d1-483a-a71a-f3c80cad9e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:42.194883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:42.205163 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 129/260] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:54:42.230674 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf95c16-16d1-483a-a71a-f3c80cad9e5e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:42.256807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21b2e0-3c00-4398-b311-a5b9fa489722 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:42.347933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351e562-5d6d-4f49-88b2-453e84418b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:42.348958 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351e562-5d6d-4f49-88b2-453e84418b5a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:42.349450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351e562-5d6d-4f49-88b2-453e84418b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:42.349951 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351e562-5d6d-4f49-88b2-453e84418b5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:42.401335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf95c16-16d1-483a-a71a-f3c80cad9e5e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:42.450367 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2660225-9ba2-4b59-b824-846b607a6c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:42.451209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2660225-9ba2-4b59-b824-846b607a6c40 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:42.451491 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2660225-9ba2-4b59-b824-846b607a6c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:42.451765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2660225-9ba2-4b59-b824-846b607a6c40 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:42.457313 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:42.466662 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2660225-9ba2-4b59-b824-846b607a6c40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:42.475875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-c2660225-9ba2-4b59-b824-846b607a6c40 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:54:42.475875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:42.475875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:42.475875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:42.475875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:42.475875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:42.475875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:42.475875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:42.475875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:42.475875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:42.475875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:42.475875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:42.475875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:42.475875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:42.475875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:42.475875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:42.476777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:42.476777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:42.476777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:42.476777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:42.476777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:42.476777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:42.476777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:42.476777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:42.476777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:42.476777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:42.476777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:42.476777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:42.476777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:42.476777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:42.476777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:42.476777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:42.477566 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:42.477566 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:42.477566 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:42.477566 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:42.477566 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:42.477566 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:42.477566 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:42.477566 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:42.477566 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:42.477566 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:42.477566 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:54:42.477566 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:54:42.477566 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 130/261] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Jul 14 11:54:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:42.483880 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2660225-9ba2-4b59-b824-846b607a6c40 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:42.535465 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351e562-5d6d-4f49-88b2-453e84418b5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:42.537314 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351e562-5d6d-4f49-88b2-453e84418b5a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:42.678865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:42.685511 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2660225-9ba2-4b59-b824-846b607a6c40 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:42.734244 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 132/262] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:54:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:42.746521 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351e562-5d6d-4f49-88b2-453e84418b5a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:42.789368 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad66b70-5960-49ea-83c0-ca35b1c6677b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:42.790056 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad66b70-5960-49ea-83c0-ca35b1c6677b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:42.790341 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad66b70-5960-49ea-83c0-ca35b1c6677b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:42.790646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad66b70-5960-49ea-83c0-ca35b1c6677b None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:42.791412 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad66b70-5960-49ea-83c0-ca35b1c6677b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:42.791725 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad66b70-5960-49ea-83c0-ca35b1c6677b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:42.793717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad66b70-5960-49ea-83c0-ca35b1c6677b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:42.802724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 131/263] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:54:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:42.809687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad66b70-5960-49ea-83c0-ca35b1c6677b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:42.918437 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351e562-5d6d-4f49-88b2-453e84418b5a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:42.964465 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:42.995276 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356132c-f58a-4583-a3e3-25d07207cab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:42.996708 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356132c-f58a-4583-a3e3-25d07207cab5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:42.996999 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356132c-f58a-4583-a3e3-25d07207cab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:42.997280 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356132c-f58a-4583-a3e3-25d07207cab5 None admin] PATH_INFO: `/v3/projects/bf999b1796e2439bb0a35f1812856355` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:42.998624 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356132c-f58a-4583-a3e3-25d07207cab5 None admin] RBAC: Authorizing `identity:get_project(project_id=bf999b1796e2439bb0a35f1812856355)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:43.000098 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356132c-f58a-4583-a3e3-25d07207cab5 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:43.002052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 133/264] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:42 2022] GET /identity/v3/projects/bf999b1796e2439bb0a35f1812856355 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:43.008078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356132c-f58a-4583-a3e3-25d07207cab5 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:43.046969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad66b70-5960-49ea-83c0-ca35b1c6677b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:43.082890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:43.135305 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ad2db-2f29-4321-857e-8e1cd5e9c41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:43.136178 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ad2db-2f29-4321-857e-8e1cd5e9c41b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:43.136463 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ad2db-2f29-4321-857e-8e1cd5e9c41b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:43.137260 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ad2db-2f29-4321-857e-8e1cd5e9c41b None admin] PATH_INFO: `/v3/users/c1676f2cdcc1480fb5a832e8d7146183` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:43.138609 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ad2db-2f29-4321-857e-8e1cd5e9c41b None admin] RBAC: Authorizing `identity:get_user(user_id=c1676f2cdcc1480fb5a832e8d7146183)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:43.140091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ad2db-2f29-4321-857e-8e1cd5e9c41b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:43.141760 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 132/265] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:42 2022] GET /identity/v3/users/c1676f2cdcc1480fb5a832e8d7146183 => generated 283 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:43.145738 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356132c-f58a-4583-a3e3-25d07207cab5 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:43.151529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ad2db-2f29-4321-857e-8e1cd5e9c41b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:43.189632 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fd81a-1d03-452a-9509-1ae6484411ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:43.190694 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fd81a-1d03-452a-9509-1ae6484411ff None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:43.191185 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fd81a-1d03-452a-9509-1ae6484411ff None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:43.191869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fd81a-1d03-452a-9509-1ae6484411ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:43.193983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fd81a-1d03-452a-9509-1ae6484411ff None admin] RBAC: Adding query filter params (role.id=eff4f9bbb7064bc1a0f9fc55a05fea51, scope.project.id=bf999b1796e2439bb0a35f1812856355, user.id=c1676f2cdcc1480fb5a832e8d7146183) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:43.194729 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fd81a-1d03-452a-9509-1ae6484411ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:43.197468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fd81a-1d03-452a-9509-1ae6484411ff None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:43.205312 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 134/266] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:54:43 2022] GET /identity/v3/role_assignments?user.id=c1676f2cdcc1480fb5a832e8d7146183&scope.project.id=bf999b1796e2439bb0a35f1812856355&role.id=eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:43.291035 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ad2db-2f29-4321-857e-8e1cd5e9c41b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:43.329096 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:43.343324 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad9538-446c-4f68-a98b-3e112831b774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:43.344010 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad9538-446c-4f68-a98b-3e112831b774 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:43.344294 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad9538-446c-4f68-a98b-3e112831b774 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:43.344571 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad9538-446c-4f68-a98b-3e112831b774 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:43.437539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad9538-446c-4f68-a98b-3e112831b774 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:43.439117 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad9538-446c-4f68-a98b-3e112831b774 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:43.544065 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa87de-4a7c-4300-8329-ed670eb8bbad None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:43.544789 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa87de-4a7c-4300-8329-ed670eb8bbad None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:43.545282 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa87de-4a7c-4300-8329-ed670eb8bbad None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:43.546927 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 135/267] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:54:43.550939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 133/268] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:54:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:43.552839 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3f923-138c-44e5-b6a7-64e04406b971 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:43.553353 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3f923-138c-44e5-b6a7-64e04406b971 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:43.553860 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3f923-138c-44e5-b6a7-64e04406b971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:43.556588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad9538-446c-4f68-a98b-3e112831b774 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:43.577224 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-86b3f923-138c-44e5-b6a7-64e04406b971 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:43.579030 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-86b3f923-138c-44e5-b6a7-64e04406b971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:43.584936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:43.664916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 136/269] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:54:43.700599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad9538-446c-4f68-a98b-3e112831b774 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:43.706723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0750f1-88a0-440f-85bc-45f38e65f750 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:43.707361 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0750f1-88a0-440f-85bc-45f38e65f750 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:43.707850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0750f1-88a0-440f-85bc-45f38e65f750 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:43.709459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 137/270] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:54:43.715438 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b472061-5189-45e0-ab0c-51b27af27e5f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:43.716057 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b472061-5189-45e0-ab0c-51b27af27e5f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:43.716571 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b472061-5189-45e0-ab0c-51b27af27e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:43.748934 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-0b472061-5189-45e0-ab0c-51b27af27e5f None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:43.750701 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0b472061-5189-45e0-ab0c-51b27af27e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:43.762778 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392af3b7-dbe6-42ed-bb38-dad0966960e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:43.763661 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392af3b7-dbe6-42ed-bb38-dad0966960e9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:43.763943 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392af3b7-dbe6-42ed-bb38-dad0966960e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:43.764203 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392af3b7-dbe6-42ed-bb38-dad0966960e9 None admin] PATH_INFO: `/v3/projects/bf999b1796e2439bb0a35f1812856355` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:43.767824 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392af3b7-dbe6-42ed-bb38-dad0966960e9 None admin] RBAC: Authorizing `identity:get_project(project_id=bf999b1796e2439bb0a35f1812856355)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:43.770281 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392af3b7-dbe6-42ed-bb38-dad0966960e9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:43.773538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 134/271] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:43 2022] GET /identity/v3/projects/bf999b1796e2439bb0a35f1812856355 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:43.774771 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392af3b7-dbe6-42ed-bb38-dad0966960e9 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:43.795013 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:43.865853 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 138/272] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:54:43.866582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b472061-5189-45e0-ab0c-51b27af27e5f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:43.908624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:43.918245 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392af3b7-dbe6-42ed-bb38-dad0966960e9 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:43.957770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242eadb3-79de-4c43-ba86-59eb561b7ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:43.958443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242eadb3-79de-4c43-ba86-59eb561b7ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:43.958724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242eadb3-79de-4c43-ba86-59eb561b7ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:43.958952 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242eadb3-79de-4c43-ba86-59eb561b7ee3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:43.971282 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242eadb3-79de-4c43-ba86-59eb561b7ee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:43.979600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-242eadb3-79de-4c43-ba86-59eb561b7ee3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:43.979600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:43.979600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:43.979600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:43.979600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:43.979600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:43.979600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:43.979600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:43.979600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:43.979600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:43.979600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:43.979600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:43.979600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:43.979600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:43.979600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:43.979600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:43.980655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:43.980655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:43.980655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:43.980655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:43.980655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:43.980655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:43.980655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:43.980655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:43.980655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:43.980655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:43.980655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:43.980655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:43.980655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:43.980655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:43.980655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:43.980655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:43.981495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:43.981495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:43.981495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:43.981495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:43.981495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:43.981495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:43.981495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:43.981495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:43.981495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:43.981495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:43.981495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:43.981495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:54:43.981495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 135/273] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:43.987021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f97aae-5624-47ea-ad46-9394618b982e None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:43.987314 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f97aae-5624-47ea-ad46-9394618b982e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:43.987596 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f97aae-5624-47ea-ad46-9394618b982e None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:43.993166 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b472061-5189-45e0-ab0c-51b27af27e5f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:43.993673 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 136/274] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:43.993673 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f97aae-5624-47ea-ad46-9394618b982e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:44.039335 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca378c-59e8-417e-bef7-2b79e1da2248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:44.040181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca378c-59e8-417e-bef7-2b79e1da2248 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:44.040653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca378c-59e8-417e-bef7-2b79e1da2248 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:44.040939 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca378c-59e8-417e-bef7-2b79e1da2248 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:44.041949 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca378c-59e8-417e-bef7-2b79e1da2248 None admin] RBAC: Adding query filter params (role.id=986e347cbb9e43e7a49dfef9be8ec9dd, scope.project.id=bf999b1796e2439bb0a35f1812856355, user.id=c1676f2cdcc1480fb5a832e8d7146183) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:44.042272 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca378c-59e8-417e-bef7-2b79e1da2248 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:44.044375 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca378c-59e8-417e-bef7-2b79e1da2248 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:44.062926 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 139/275] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:54:43 2022] GET /identity/v3/role_assignments?user.id=c1676f2cdcc1480fb5a832e8d7146183&scope.project.id=bf999b1796e2439bb0a35f1812856355&role.id=986e347cbb9e43e7a49dfef9be8ec9dd => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:44.062926 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca378c-59e8-417e-bef7-2b79e1da2248 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:44.106282 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:44.121219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f97aae-5624-47ea-ad46-9394618b982e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:44.163659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b62dd4-c32f-469c-9e49-4a5f261ce17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:44.164471 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b62dd4-c32f-469c-9e49-4a5f261ce17c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:44.164808 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b62dd4-c32f-469c-9e49-4a5f261ce17c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:44.165161 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b62dd4-c32f-469c-9e49-4a5f261ce17c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:44.166520 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b62dd4-c32f-469c-9e49-4a5f261ce17c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:44.168233 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b62dd4-c32f-469c-9e49-4a5f261ce17c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:44.170142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 137/276] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:54:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:44.176421 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d2971-348a-4dd3-ab2e-07bf7ec17c6c None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:44.176932 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d2971-348a-4dd3-ab2e-07bf7ec17c6c None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:44.177472 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d2971-348a-4dd3-ab2e-07bf7ec17c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:44.197505 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-e71d2971-348a-4dd3-ab2e-07bf7ec17c6c None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:44.198777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e71d2971-348a-4dd3-ab2e-07bf7ec17c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:44.205113 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca378c-59e8-417e-bef7-2b79e1da2248 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:44.230356 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:44.251672 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c2dc2-0dbb-45fb-b3d6-a4c16d8cb4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:44.252373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c2dc2-0dbb-45fb-b3d6-a4c16d8cb4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:44.252662 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c2dc2-0dbb-45fb-b3d6-a4c16d8cb4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:44.252944 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c2dc2-0dbb-45fb-b3d6-a4c16d8cb4f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:44.253727 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c2dc2-0dbb-45fb-b3d6-a4c16d8cb4f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:44.254043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c2dc2-0dbb-45fb-b3d6-a4c16d8cb4f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:44.255514 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c2dc2-0dbb-45fb-b3d6-a4c16d8cb4f3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:44.265073 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 140/277] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:54:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:44.270775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c2dc2-0dbb-45fb-b3d6-a4c16d8cb4f3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:44.336192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 138/278] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:44.336829 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d2971-348a-4dd3-ab2e-07bf7ec17c6c None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:44.397146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:44.409126 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c2dc2-0dbb-45fb-b3d6-a4c16d8cb4f3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:44.446944 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763d8d3-4f7f-4c4d-8884-a14c5be44d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:44.447616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763d8d3-4f7f-4c4d-8884-a14c5be44d6c None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:44.447904 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763d8d3-4f7f-4c4d-8884-a14c5be44d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:44.448179 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763d8d3-4f7f-4c4d-8884-a14c5be44d6c None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:44.448669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d2971-348a-4dd3-ab2e-07bf7ec17c6c None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:44.448890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763d8d3-4f7f-4c4d-8884-a14c5be44d6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:44.451131 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763d8d3-4f7f-4c4d-8884-a14c5be44d6c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:44.473403 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 141/279] 10.222.0.79 () {60 vars in 1132 bytes} [Thu Jul 14 11:54:44 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:54:44.475485 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763d8d3-4f7f-4c4d-8884-a14c5be44d6c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:44.497470 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5b9c5-ad20-4513-8a54-b693cdbafae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:44.498721 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5b9c5-ad20-4513-8a54-b693cdbafae0 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:44.499009 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5b9c5-ad20-4513-8a54-b693cdbafae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:44.499286 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5b9c5-ad20-4513-8a54-b693cdbafae0 None admin] PATH_INFO: `/v3/users/f53026f4cf064aaab64112a65473ae71` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:44.519169 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5b9c5-ad20-4513-8a54-b693cdbafae0 None admin] RBAC: Authorizing `identity:get_user(user_id=f53026f4cf064aaab64112a65473ae71)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:44.521639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5b9c5-ad20-4513-8a54-b693cdbafae0 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:44.523992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 139/280] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:44 2022] GET /identity/v3/users/f53026f4cf064aaab64112a65473ae71 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:44.530225 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5b9c5-ad20-4513-8a54-b693cdbafae0 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:44.586983 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:44.623889 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763d8d3-4f7f-4c4d-8884-a14c5be44d6c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:44.653580 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5b9c5-ad20-4513-8a54-b693cdbafae0 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:44.675795 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73011c-32f5-4673-8f35-079295ecbe18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:44.676650 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73011c-32f5-4673-8f35-079295ecbe18 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:44.676895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73011c-32f5-4673-8f35-079295ecbe18 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:44.677425 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73011c-32f5-4673-8f35-079295ecbe18 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:44.693552 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73011c-32f5-4673-8f35-079295ecbe18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:44.696313 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f89e64-aa39-4cdc-bcd7-7d140ac9f212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:44.697026 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f89e64-aa39-4cdc-bcd7-7d140ac9f212 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:44.697317 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f89e64-aa39-4cdc-bcd7-7d140ac9f212 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:44.697595 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f89e64-aa39-4cdc-bcd7-7d140ac9f212 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:44.698432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f89e64-aa39-4cdc-bcd7-7d140ac9f212 None admin] RBAC: Adding query filter params (role.id=9a3a3371dd4d4405b2e4604acc314d43, user.id=f53026f4cf064aaab64112a65473ae71, scope.system=all) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:44.698793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f89e64-aa39-4cdc-bcd7-7d140ac9f212 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:44.706539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f89e64-aa39-4cdc-bcd7-7d140ac9f212 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:44.706724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-8a73011c-32f5-4673-8f35-079295ecbe18 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:54:44.706724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:44.706724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:44.706724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:44.706724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:44.706724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:44.706724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:44.706724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:44.706724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:44.706724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:44.706724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:44.706724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:44.706724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:44.706724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:44.706724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:44.706724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:44.708205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:44.708205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:44.708205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:44.708205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:44.708205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:44.708205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:44.708205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:44.708205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:44.708205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:44.708205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:44.708205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:44.708205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:44.708205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:44.708205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:44.708205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:44.708205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:44.709775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:44.709775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:44.709775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:44.709775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:44.709775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:44.709775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:44.709775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:44.709775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:44.709775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:44.709775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:44.709775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:54:44.709775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:54:44.709775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 142/281] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:44.711174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 140/282] 10.222.0.79 () {56 vars in 1308 bytes} [Thu Jul 14 11:54:44 2022] GET /identity/v3/role_assignments?user.id=f53026f4cf064aaab64112a65473ae71&scope.system=all&role.id=9a3a3371dd4d4405b2e4604acc314d43 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:44.717745 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73011c-32f5-4673-8f35-079295ecbe18 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:44.735189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:44.743274 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a3cc9-3736-491c-9e5a-c33e87f56516 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:44.744671 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a3cc9-3736-491c-9e5a-c33e87f56516 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:44.746103 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a3cc9-3736-491c-9e5a-c33e87f56516 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:44.748101 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 141/283] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:54:44.755627 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a18746-fa41-445f-abfe-deeba3a3b5b2 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:44.755912 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a18746-fa41-445f-abfe-deeba3a3b5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:44.756192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a18746-fa41-445f-abfe-deeba3a3b5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:44.775900 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-13a18746-fa41-445f-abfe-deeba3a3b5b2 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:44.777187 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-13a18746-fa41-445f-abfe-deeba3a3b5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:44.865897 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73011c-32f5-4673-8f35-079295ecbe18 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:44.877565 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 142/284] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:54:44.904601 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a18746-fa41-445f-abfe-deeba3a3b5b2 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:44.908773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:44.918738 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048b58f-d058-4fbc-a50b-a1035a1ddaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:44.920051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048b58f-d058-4fbc-a50b-a1035a1ddaa4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:44.920711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048b58f-d058-4fbc-a50b-a1035a1ddaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:44.921283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048b58f-d058-4fbc-a50b-a1035a1ddaa4 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:44.922231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048b58f-d058-4fbc-a50b-a1035a1ddaa4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:44.922869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048b58f-d058-4fbc-a50b-a1035a1ddaa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:44.925125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048b58f-d058-4fbc-a50b-a1035a1ddaa4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:44.937211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 143/285] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:54:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:44.942699 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048b58f-d058-4fbc-a50b-a1035a1ddaa4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:45.038379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a18746-fa41-445f-abfe-deeba3a3b5b2 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:45.043718 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:45.096374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048b58f-d058-4fbc-a50b-a1035a1ddaa4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:45.098475 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e4a6c-a188-4884-b5ea-be0ad7fc485c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:45.099304 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e4a6c-a188-4884-b5ea-be0ad7fc485c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:45.099589 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e4a6c-a188-4884-b5ea-be0ad7fc485c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:45.099867 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e4a6c-a188-4884-b5ea-be0ad7fc485c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:45.112121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e4a6c-a188-4884-b5ea-be0ad7fc485c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:45.120156 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-1b8e4a6c-a188-4884-b5ea-be0ad7fc485c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:45.120156 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:45.120156 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:45.120156 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:45.120156 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:45.120156 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:45.120156 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:45.120156 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:45.120156 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:45.120156 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:45.120156 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:45.120156 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:45.120156 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:45.120156 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:45.120156 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:45.120156 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:45.122071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:45.122071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:45.122071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:45.122071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:45.122071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:45.122071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:45.122071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:45.122071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:45.122071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:45.122071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:45.122071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:45.122071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:45.122071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:45.122071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:45.122071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:45.122071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:45.122891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:45.122891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:45.122891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:45.122891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:45.122891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:45.122891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:45.122891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:45.122891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:45.122891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:45.122891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:45.122891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:45.122891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:54:45.122891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 143/286] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:54:45.131740 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e4a6c-a188-4884-b5ea-be0ad7fc485c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:45.198978 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:45.203879 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7797ac-fb0f-4ec0-930d-34b7c0551305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:45.204786 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7797ac-fb0f-4ec0-930d-34b7c0551305 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:45.205074 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7797ac-fb0f-4ec0-930d-34b7c0551305 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:45.205350 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7797ac-fb0f-4ec0-930d-34b7c0551305 None admin] PATH_INFO: `/v3/users/5c458fca79fc41fb89dcc457f699d896` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:45.208830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7797ac-fb0f-4ec0-930d-34b7c0551305 None admin] RBAC: Authorizing `identity:get_user(user_id=5c458fca79fc41fb89dcc457f699d896)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:45.210325 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7797ac-fb0f-4ec0-930d-34b7c0551305 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:45.219007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 144/287] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:44 2022] GET /identity/v3/users/5c458fca79fc41fb89dcc457f699d896 => generated 297 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:45.219969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7797ac-fb0f-4ec0-930d-34b7c0551305 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:45.250583 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e4a6c-a188-4884-b5ea-be0ad7fc485c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:45.305986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25282a02-24be-40ec-9144-0c66a414d251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:45.306704 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25282a02-24be-40ec-9144-0c66a414d251 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:45.306995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25282a02-24be-40ec-9144-0c66a414d251 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:45.307276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25282a02-24be-40ec-9144-0c66a414d251 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:45.308045 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25282a02-24be-40ec-9144-0c66a414d251 None admin] RBAC: Adding query filter params (name=member) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:45.308414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25282a02-24be-40ec-9144-0c66a414d251 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:45.310351 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25282a02-24be-40ec-9144-0c66a414d251 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:45.319552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 144/288] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:54:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:45.325119 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25282a02-24be-40ec-9144-0c66a414d251 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:45.428565 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7797ac-fb0f-4ec0-930d-34b7c0551305 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:45.442113 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25282a02-24be-40ec-9144-0c66a414d251 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:45.470933 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:45.479206 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0c011-0d84-49ef-9af3-6edbc0c6b275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:45.481342 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0c011-0d84-49ef-9af3-6edbc0c6b275 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:45.481809 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0c011-0d84-49ef-9af3-6edbc0c6b275 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:45.482229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0c011-0d84-49ef-9af3-6edbc0c6b275 None admin] PATH_INFO: `/v3/users/0ffd6cf4fc554f1f8bd887bbf29de1c4` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:45.483719 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0c011-0d84-49ef-9af3-6edbc0c6b275 None admin] RBAC: Authorizing `identity:get_user(user_id=0ffd6cf4fc554f1f8bd887bbf29de1c4)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:45.486073 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0c011-0d84-49ef-9af3-6edbc0c6b275 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:45.487982 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 145/289] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:45 2022] GET /identity/v3/users/0ffd6cf4fc554f1f8bd887bbf29de1c4 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:45.498260 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0c011-0d84-49ef-9af3-6edbc0c6b275 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:45.514517 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b14f8-c02a-4860-bde6-43a80dfd9477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:45.514517 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b14f8-c02a-4860-bde6-43a80dfd9477 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:45.514517 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b14f8-c02a-4860-bde6-43a80dfd9477 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:45.514517 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b14f8-c02a-4860-bde6-43a80dfd9477 None admin] PATH_INFO: `/v3/projects/bf999b1796e2439bb0a35f1812856355` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:45.514913 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b14f8-c02a-4860-bde6-43a80dfd9477 None admin] RBAC: Authorizing `identity:get_project(project_id=bf999b1796e2439bb0a35f1812856355)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:45.514913 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b14f8-c02a-4860-bde6-43a80dfd9477 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:45.515523 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 145/290] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:45 2022] GET /identity/v3/projects/bf999b1796e2439bb0a35f1812856355 => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:45.520957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b14f8-c02a-4860-bde6-43a80dfd9477 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:45.534894 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:45.648433 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b14f8-c02a-4860-bde6-43a80dfd9477 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:45.716130 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0c011-0d84-49ef-9af3-6edbc0c6b275 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:45.723099 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555140c-7faa-45f8-8320-a0a1c47526a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:45.724089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555140c-7faa-45f8-8320-a0a1c47526a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:45.724375 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555140c-7faa-45f8-8320-a0a1c47526a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:45.724650 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555140c-7faa-45f8-8320-a0a1c47526a9 None admin] PATH_INFO: `/v3/projects/bf999b1796e2439bb0a35f1812856355/users/5c458fca79fc41fb89dcc457f699d896/roles/78a510490d1e423c89a3b430c8530483` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:45.726867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555140c-7faa-45f8-8320-a0a1c47526a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf999b1796e2439bb0a35f1812856355, user_id=5c458fca79fc41fb89dcc457f699d896, role_id=78a510490d1e423c89a3b430c8530483)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:45.728305 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555140c-7faa-45f8-8320-a0a1c47526a9 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:45.755177 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573b7c1-e4df-4fc2-ae86-d93993f40dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:45.756007 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573b7c1-e4df-4fc2-ae86-d93993f40dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:45.756371 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573b7c1-e4df-4fc2-ae86-d93993f40dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:45.756663 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573b7c1-e4df-4fc2-ae86-d93993f40dd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:45.771244 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 146/291] 10.222.0.79 () {58 vars in 1439 bytes} [Thu Jul 14 11:54:45 2022] PUT /identity/v3/projects/bf999b1796e2439bb0a35f1812856355/users/5c458fca79fc41fb89dcc457f699d896/roles/78a510490d1e423c89a3b430c8530483 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:54:45.827968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:45.836121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573b7c1-e4df-4fc2-ae86-d93993f40dd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:45.837638 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573b7c1-e4df-4fc2-ae86-d93993f40dd5 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:45.960011 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 146/292] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:54:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:45.965892 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555140c-7faa-45f8-8320-a0a1c47526a9 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:46.040622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:46.090713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555140c-7faa-45f8-8320-a0a1c47526a9 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:46.137667 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02359b-571a-4e71-9075-15430038b982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:46.138574 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02359b-571a-4e71-9075-15430038b982 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:46.138861 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02359b-571a-4e71-9075-15430038b982 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:46.139141 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02359b-571a-4e71-9075-15430038b982 None admin] PATH_INFO: `/v3/projects/bf999b1796e2439bb0a35f1812856355` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:46.140371 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02359b-571a-4e71-9075-15430038b982 None admin] RBAC: Authorizing `identity:get_project(project_id=bf999b1796e2439bb0a35f1812856355)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:46.141815 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02359b-571a-4e71-9075-15430038b982 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:46.143621 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 147/293] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:45 2022] GET /identity/v3/projects/bf999b1796e2439bb0a35f1812856355 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:46.149550 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573b7c1-e4df-4fc2-ae86-d93993f40dd5 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:46.299034 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:46.323032 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573b7c1-e4df-4fc2-ae86-d93993f40dd5 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:46.377881 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41b968-ac39-4b08-96ae-c0e33c5b85ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:46.378946 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41b968-ac39-4b08-96ae-c0e33c5b85ac None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:46.379440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41b968-ac39-4b08-96ae-c0e33c5b85ac None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:46.379963 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41b968-ac39-4b08-96ae-c0e33c5b85ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:46.381003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41b968-ac39-4b08-96ae-c0e33c5b85ac None admin] RBAC: Adding query filter params (role.id=9a3a3371dd4d4405b2e4604acc314d43, scope.project.id=bf999b1796e2439bb0a35f1812856355, user.id=0ffd6cf4fc554f1f8bd887bbf29de1c4) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:46.381523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41b968-ac39-4b08-96ae-c0e33c5b85ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:46.383199 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41b968-ac39-4b08-96ae-c0e33c5b85ac None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:46.396296 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 147/294] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:54:46 2022] GET /identity/v3/role_assignments?user.id=0ffd6cf4fc554f1f8bd887bbf29de1c4&scope.project.id=bf999b1796e2439bb0a35f1812856355&role.id=9a3a3371dd4d4405b2e4604acc314d43 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:47.134931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcc453-58d4-45d2-89fa-0b4a049288d6 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:47.135417 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcc453-58d4-45d2-89fa-0b4a049288d6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:47.135417 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcc453-58d4-45d2-89fa-0b4a049288d6 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:47.137192 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 148/295] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:47.142714 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97d850-3f66-4ead-9d96-7e9ba0d659c3 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:47.143010 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97d850-3f66-4ead-9d96-7e9ba0d659c3 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:47.143290 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97d850-3f66-4ead-9d96-7e9ba0d659c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:47.164437 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-9d97d850-3f66-4ead-9d96-7e9ba0d659c3 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:47.165675 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-9d97d850-3f66-4ead-9d96-7e9ba0d659c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:47.245316 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 148/296] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:47.268165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bcc453-58d4-45d2-89fa-0b4a049288d6 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:47.307936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633d7fa-4516-4377-83e6-108499efd775 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:47.308541 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633d7fa-4516-4377-83e6-108499efd775 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:47.309045 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633d7fa-4516-4377-83e6-108499efd775 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:47.312130 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 149/297] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:47.321772 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2a5cc-814a-431b-a09f-6726f990992f None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:47.322305 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2a5cc-814a-431b-a09f-6726f990992f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:47.322878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2a5cc-814a-431b-a09f-6726f990992f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:47.353304 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-4ed2a5cc-814a-431b-a09f-6726f990992f None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:47.356219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-4ed2a5cc-814a-431b-a09f-6726f990992f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:47.399793 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bcc453-58d4-45d2-89fa-0b4a049288d6 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:47.440444 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec93a3-16f7-46cc-b94e-9b11be13073c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:47.441252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec93a3-16f7-46cc-b94e-9b11be13073c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:47.441536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec93a3-16f7-46cc-b94e-9b11be13073c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:47.441814 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec93a3-16f7-46cc-b94e-9b11be13073c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:47.444112 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:47.455208 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec93a3-16f7-46cc-b94e-9b11be13073c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:47.466620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 150/298] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:47.466620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330a54e-fff6-4991-9cd0-ec487624e702 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:47.466620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330a54e-fff6-4991-9cd0-ec487624e702 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:47.466620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330a54e-fff6-4991-9cd0-ec487624e702 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:47.466620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 151/299] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:47.467051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-78ec93a3-16f7-46cc-b94e-9b11be13073c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:47.467051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:47.467051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:47.467051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:47.467051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:47.467051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:47.467051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:47.467051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:47.467051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:47.467051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:47.467051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:47.467051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:47.467051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:47.467051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:47.467051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:47.467051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:47.467819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:47.467819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:47.467819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:47.467819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:47.467819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:47.467819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:47.467819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:47.467819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:47.467819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:47.467819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:47.467819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:47.467819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:47.467819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:47.467819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:47.467819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:47.467819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:47.468578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:47.468578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:47.468578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:47.468578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:47.468578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:47.468578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:47.468578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:47.468578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:47.468578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:47.468578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:47.468578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:47.468578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:54:47.468578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 149/300] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:47.470831 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec93a3-16f7-46cc-b94e-9b11be13073c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:47.471484 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322748b7-d493-4cea-a2de-21178f2f5ee7 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:47.471912 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322748b7-d493-4cea-a2de-21178f2f5ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:47.472327 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322748b7-d493-4cea-a2de-21178f2f5ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:47.492421 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-322748b7-d493-4cea-a2de-21178f2f5ee7 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:47.493610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-322748b7-d493-4cea-a2de-21178f2f5ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:47.508493 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:47.567765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 152/301] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:47.578688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322748b7-d493-4cea-a2de-21178f2f5ee7 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:47.585260 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec93a3-16f7-46cc-b94e-9b11be13073c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:47.622932 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0ac71-d129-4856-9620-d96dc8117ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:47.623617 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0ac71-d129-4856-9620-d96dc8117ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:47.623901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0ac71-d129-4856-9620-d96dc8117ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:47.624174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0ac71-d129-4856-9620-d96dc8117ea0 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:47.624933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0ac71-d129-4856-9620-d96dc8117ea0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:47.625243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0ac71-d129-4856-9620-d96dc8117ea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:47.626661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0ac71-d129-4856-9620-d96dc8117ea0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:47.636102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 150/302] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:54:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:47.643802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0ac71-d129-4856-9620-d96dc8117ea0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:47.688405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322748b7-d493-4cea-a2de-21178f2f5ee7 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:47.711639 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:47.727541 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7a69e-266b-4feb-b070-abaa269f39e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:47.728351 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7a69e-266b-4feb-b070-abaa269f39e5 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:47.731903 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7a69e-266b-4feb-b070-abaa269f39e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:47.731903 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7a69e-266b-4feb-b070-abaa269f39e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:47.733180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7a69e-266b-4feb-b070-abaa269f39e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:47.735147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7a69e-266b-4feb-b070-abaa269f39e5 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:47.737727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 153/303] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:54:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:47.743006 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7a69e-266b-4feb-b070-abaa269f39e5 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:47.758868 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0ac71-d129-4856-9620-d96dc8117ea0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:47.762522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:47.796019 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7012ab7-5eae-4b13-8439-2a2fd99e571c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:47.796902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7012ab7-5eae-4b13-8439-2a2fd99e571c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:47.797190 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7012ab7-5eae-4b13-8439-2a2fd99e571c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:47.797470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7012ab7-5eae-4b13-8439-2a2fd99e571c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:47.809247 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7012ab7-5eae-4b13-8439-2a2fd99e571c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:47.817790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f7012ab7-5eae-4b13-8439-2a2fd99e571c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:54:47.817790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:47.817790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:47.817790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:47.817790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:47.817790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:47.817790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:47.817790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:47.817790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:47.817790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:47.817790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:47.817790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:47.817790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:47.817790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:47.817790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:47.817790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:47.818865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:47.818865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:47.818865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:47.818865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:47.818865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:47.818865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:47.818865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:47.818865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:47.818865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:47.818865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:47.818865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:47.818865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:47.818865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:47.818865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:47.818865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:47.818865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:47.819654 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:47.819654 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:47.819654 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:47.819654 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:47.819654 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:47.819654 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:47.819654 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:47.819654 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:47.819654 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:47.819654 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:47.819654 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:54:47.819654 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:54:47.826515 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 151/304] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:47.826515 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7012ab7-5eae-4b13-8439-2a2fd99e571c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:47.849311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7a69e-266b-4feb-b070-abaa269f39e5 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:47.887772 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f15567-1751-4b51-b092-f102a74faa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:47.888493 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f15567-1751-4b51-b092-f102a74faa53 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:47.888778 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f15567-1751-4b51-b092-f102a74faa53 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:47.889065 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f15567-1751-4b51-b092-f102a74faa53 None admin] PATH_INFO: `/v3/users/f53026f4cf064aaab64112a65473ae71` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:47.890254 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f15567-1751-4b51-b092-f102a74faa53 None admin] RBAC: Authorizing `identity:get_user(user_id=f53026f4cf064aaab64112a65473ae71)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:47.891754 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f15567-1751-4b51-b092-f102a74faa53 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:47.893552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 154/305] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:47 2022] GET /identity/v3/users/f53026f4cf064aaab64112a65473ae71 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:47.894131 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f15567-1751-4b51-b092-f102a74faa53 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:47.942969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7012ab7-5eae-4b13-8439-2a2fd99e571c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:47.960070 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:47.981342 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b2185-6fbb-4983-81fe-26a42f9d8bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:47.982027 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b2185-6fbb-4983-81fe-26a42f9d8bc1 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:47.982401 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b2185-6fbb-4983-81fe-26a42f9d8bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:47.982623 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b2185-6fbb-4983-81fe-26a42f9d8bc1 None admin] PATH_INFO: `/v3/groups` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:47.983316 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b2185-6fbb-4983-81fe-26a42f9d8bc1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:47.984796 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b2185-6fbb-4983-81fe-26a42f9d8bc1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:47.992667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:48.004485 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 152/306] 10.222.0.79 () {60 vars in 1134 bytes} [Thu Jul 14 11:54:47 2022] POST /identity/v3/groups => generated 229 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:54:48.012125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b2185-6fbb-4983-81fe-26a42f9d8bc1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:48.013134 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f15567-1751-4b51-b092-f102a74faa53 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:48.054145 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8ede2-997c-4697-add3-1073dd54ab4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:48.054952 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8ede2-997c-4697-add3-1073dd54ab4c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:48.055178 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8ede2-997c-4697-add3-1073dd54ab4c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:48.055520 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8ede2-997c-4697-add3-1073dd54ab4c None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:48.056472 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8ede2-997c-4697-add3-1073dd54ab4c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:48.056813 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8ede2-997c-4697-add3-1073dd54ab4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:48.059028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8ede2-997c-4697-add3-1073dd54ab4c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:48.068668 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 155/307] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:54:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:48.073006 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c537238-e746-499c-ab39-0cb3309668c5 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:48.073973 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c537238-e746-499c-ab39-0cb3309668c5 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:48.074985 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c537238-e746-499c-ab39-0cb3309668c5 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:48.081910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 156/308] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:48.081910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c537238-e746-499c-ab39-0cb3309668c5 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:48.137544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b2185-6fbb-4983-81fe-26a42f9d8bc1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:48.178001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38a855-fd9e-4a49-a9ef-843d44c04f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:48.178911 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38a855-fd9e-4a49-a9ef-843d44c04f36 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:48.179192 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38a855-fd9e-4a49-a9ef-843d44c04f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:48.179469 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38a855-fd9e-4a49-a9ef-843d44c04f36 None admin] PATH_INFO: `/v3/system/users/f53026f4cf064aaab64112a65473ae71/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:48.180978 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38a855-fd9e-4a49-a9ef-843d44c04f36 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f53026f4cf064aaab64112a65473ae71, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:48.182384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38a855-fd9e-4a49-a9ef-843d44c04f36 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:48.195670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 153/309] 10.222.0.79 () {58 vars in 1334 bytes} [Thu Jul 14 11:54:48 2022] PUT /identity/v3/system/users/f53026f4cf064aaab64112a65473ae71/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:54:48.198324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a7062-3d4d-4a6a-ae39-9789db411cb4 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:48.199528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a7062-3d4d-4a6a-ae39-9789db411cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:48.200008 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a7062-3d4d-4a6a-ae39-9789db411cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:48.205096 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c537238-e746-499c-ab39-0cb3309668c5 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:48.226067 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-de8a7062-3d4d-4a6a-ae39-9789db411cb4 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:48.227527 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-de8a7062-3d4d-4a6a-ae39-9789db411cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:48.263868 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482e03f-6136-4b1a-88f9-e0dadf1b75e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:48.265364 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482e03f-6136-4b1a-88f9-e0dadf1b75e2 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:48.266359 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482e03f-6136-4b1a-88f9-e0dadf1b75e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:48.267209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482e03f-6136-4b1a-88f9-e0dadf1b75e2 None admin] PATH_INFO: `/v3/users/9a2574f1e73c4a23bd5c8dd6982536e8` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:48.272129 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:48.288458 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482e03f-6136-4b1a-88f9-e0dadf1b75e2 None admin] RBAC: Authorizing `identity:get_user(user_id=9a2574f1e73c4a23bd5c8dd6982536e8)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:48.291076 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482e03f-6136-4b1a-88f9-e0dadf1b75e2 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:48.294394 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 157/310] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:48 2022] GET /identity/v3/users/9a2574f1e73c4a23bd5c8dd6982536e8 => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:48.300668 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482e03f-6136-4b1a-88f9-e0dadf1b75e2 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:48.309589 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:48.333724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 154/311] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:48.356851 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a7062-3d4d-4a6a-ae39-9789db411cb4 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:48.448354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482e03f-6136-4b1a-88f9-e0dadf1b75e2 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:48.492881 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d53c6d-3667-4afa-a59a-0e5eb9a3e5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:48.493596 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d53c6d-3667-4afa-a59a-0e5eb9a3e5db None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:48.493795 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a7062-3d4d-4a6a-ae39-9789db411cb4 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:48.493897 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d53c6d-3667-4afa-a59a-0e5eb9a3e5db None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:48.494150 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d53c6d-3667-4afa-a59a-0e5eb9a3e5db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:48.495030 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d53c6d-3667-4afa-a59a-0e5eb9a3e5db None admin] RBAC: Adding query filter params (role.id=78a510490d1e423c89a3b430c8530483, user.id=9a2574f1e73c4a23bd5c8dd6982536e8, scope.system=all) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:48.495610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d53c6d-3667-4afa-a59a-0e5eb9a3e5db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:48.498655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d53c6d-3667-4afa-a59a-0e5eb9a3e5db None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:48.506320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 158/312] 10.222.0.79 () {56 vars in 1308 bytes} [Thu Jul 14 11:54:48 2022] GET /identity/v3/role_assignments?user.id=9a2574f1e73c4a23bd5c8dd6982536e8&scope.system=all&role.id=78a510490d1e423c89a3b430c8530483 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:48.538071 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1b738-4bf6-44b7-9b66-4e6750edb679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:48.538932 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1b738-4bf6-44b7-9b66-4e6750edb679 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:48.539219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1b738-4bf6-44b7-9b66-4e6750edb679 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:48.539497 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1b738-4bf6-44b7-9b66-4e6750edb679 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:48.552600 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1b738-4bf6-44b7-9b66-4e6750edb679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:48.561187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-e9e1b738-4bf6-44b7-9b66-4e6750edb679 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:54:48.561187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:48.561187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:48.561187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:48.561187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:48.561187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:48.561187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:48.561187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:48.561187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:48.561187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:48.561187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:48.561187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:48.561187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:48.561187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:48.561187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:48.561187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:48.562137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:48.562137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:48.562137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:48.562137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:48.562137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:48.562137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:48.562137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:48.562137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:48.562137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:48.562137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:48.562137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:48.562137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:48.562137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:48.562137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:48.562137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:48.562137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:48.562931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:48.562931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:48.562931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:48.562931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:48.562931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:48.562931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:48.562931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:48.562931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:48.562931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:48.562931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:48.562931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:54:48.562931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:54:48.562931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 155/313] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:54:48.570241 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d53c6d-3667-4afa-a59a-0e5eb9a3e5db None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:48.647061 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:48.690518 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d53c6d-3667-4afa-a59a-0e5eb9a3e5db None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:48.726885 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653aba6-28b1-49df-8cb6-1731b343dbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:48.727484 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653aba6-28b1-49df-8cb6-1731b343dbc0 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:48.727772 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653aba6-28b1-49df-8cb6-1731b343dbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:48.733702 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653aba6-28b1-49df-8cb6-1731b343dbc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:48.734937 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653aba6-28b1-49df-8cb6-1731b343dbc0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:48.735267 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653aba6-28b1-49df-8cb6-1731b343dbc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:48.744789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653aba6-28b1-49df-8cb6-1731b343dbc0 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:48.756233 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 159/314] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:54:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:48.763622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1b738-4bf6-44b7-9b66-4e6750edb679 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:48.796259 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:48.872752 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1b738-4bf6-44b7-9b66-4e6750edb679 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:48.910379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b1b23-0069-4c95-b6ca-ae699256a68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:48.911314 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b1b23-0069-4c95-b6ca-ae699256a68a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:48.911600 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b1b23-0069-4c95-b6ca-ae699256a68a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:48.911876 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b1b23-0069-4c95-b6ca-ae699256a68a None admin] PATH_INFO: `/v3/users/5c458fca79fc41fb89dcc457f699d896` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:48.913099 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b1b23-0069-4c95-b6ca-ae699256a68a None admin] RBAC: Authorizing `identity:get_user(user_id=5c458fca79fc41fb89dcc457f699d896)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:48.914579 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b1b23-0069-4c95-b6ca-ae699256a68a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:48.920814 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 156/315] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:48 2022] GET /identity/v3/users/5c458fca79fc41fb89dcc457f699d896 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:48.922199 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653aba6-28b1-49df-8cb6-1731b343dbc0 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:49.036953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653aba6-28b1-49df-8cb6-1731b343dbc0 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:49.068241 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:49.075616 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d7732-651d-4cb9-b3a9-f3dfef13fdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:49.076283 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d7732-651d-4cb9-b3a9-f3dfef13fdd2 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:49.076573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d7732-651d-4cb9-b3a9-f3dfef13fdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:49.076855 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d7732-651d-4cb9-b3a9-f3dfef13fdd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:49.145608 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d7732-651d-4cb9-b3a9-f3dfef13fdd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:49.147127 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d7732-651d-4cb9-b3a9-f3dfef13fdd2 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:49.255400 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 160/316] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:54:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:49.263758 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b1b23-0069-4c95-b6ca-ae699256a68a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:49.367548 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:49.371829 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b1b23-0069-4c95-b6ca-ae699256a68a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:49.411830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c30da2-685f-4144-90c3-6cc1a23ca608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:49.412699 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c30da2-685f-4144-90c3-6cc1a23ca608 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:49.412980 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c30da2-685f-4144-90c3-6cc1a23ca608 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:49.413255 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c30da2-685f-4144-90c3-6cc1a23ca608 None admin] PATH_INFO: `/v3/projects/bf999b1796e2439bb0a35f1812856355` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:49.414562 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c30da2-685f-4144-90c3-6cc1a23ca608 None admin] RBAC: Authorizing `identity:get_project(project_id=bf999b1796e2439bb0a35f1812856355)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:49.416094 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c30da2-685f-4144-90c3-6cc1a23ca608 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:49.418426 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 157/317] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:49 2022] GET /identity/v3/projects/bf999b1796e2439bb0a35f1812856355 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:49.424149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d7732-651d-4cb9-b3a9-f3dfef13fdd2 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:49.457298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:49.536432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d7732-651d-4cb9-b3a9-f3dfef13fdd2 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:49.572865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c4f8a-a5dc-46ed-a88e-ef47ea64c1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:49.573532 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c4f8a-a5dc-46ed-a88e-ef47ea64c1fe None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:49.573841 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c4f8a-a5dc-46ed-a88e-ef47ea64c1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:49.574191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c4f8a-a5dc-46ed-a88e-ef47ea64c1fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:49.575059 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c4f8a-a5dc-46ed-a88e-ef47ea64c1fe None admin] RBAC: Adding query filter params (role.id=78a510490d1e423c89a3b430c8530483, scope.project.id=bf999b1796e2439bb0a35f1812856355, user.id=5c458fca79fc41fb89dcc457f699d896) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:49.575374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c4f8a-a5dc-46ed-a88e-ef47ea64c1fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:49.576964 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c4f8a-a5dc-46ed-a88e-ef47ea64c1fe None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:49.583918 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 161/318] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:54:49 2022] GET /identity/v3/role_assignments?user.id=5c458fca79fc41fb89dcc457f699d896&scope.project.id=bf999b1796e2439bb0a35f1812856355&role.id=78a510490d1e423c89a3b430c8530483 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:50.178238 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1431ae5-f40a-4915-9a2b-930f03d07f01 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:50.178753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1431ae5-f40a-4915-9a2b-930f03d07f01 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:50.178879 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1431ae5-f40a-4915-9a2b-930f03d07f01 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:50.180424 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 158/319] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:54:50.186115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c70f62-d629-4003-9064-627dbb01c5b0 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:50.186417 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c70f62-d629-4003-9064-627dbb01c5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:50.186723 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c70f62-d629-4003-9064-627dbb01c5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:50.204272 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-78c70f62-d629-4003-9064-627dbb01c5b0 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:50.205459 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-78c70f62-d629-4003-9064-627dbb01c5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:50.326555 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 162/320] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:50.347514 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1431ae5-f40a-4915-9a2b-930f03d07f01 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:50.470088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be978884-626e-49f8-a9d9-10baed2ed7a2 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:50.470263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be978884-626e-49f8-a9d9-10baed2ed7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:50.470591 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be978884-626e-49f8-a9d9-10baed2ed7a2 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:50.472089 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 163/321] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:54:50.477847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a16ee-f033-40fb-87ee-3bae896d1811 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:50.478179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a16ee-f033-40fb-87ee-3bae896d1811 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:50.478408 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a16ee-f033-40fb-87ee-3bae896d1811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:50.480500 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1431ae5-f40a-4915-9a2b-930f03d07f01 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:50.497614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-e15a16ee-f033-40fb-87ee-3bae896d1811 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:50.498898 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e15a16ee-f033-40fb-87ee-3bae896d1811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:50.521959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:50.532304 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8da75-fae6-4941-addc-bc1db262845f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:50.533140 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8da75-fae6-4941-addc-bc1db262845f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:50.533436 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8da75-fae6-4941-addc-bc1db262845f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:50.533718 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8da75-fae6-4941-addc-bc1db262845f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:50.535213 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8da75-fae6-4941-addc-bc1db262845f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:50.537207 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8da75-fae6-4941-addc-bc1db262845f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:50.540069 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 159/322] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:54:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:50.546684 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8da75-fae6-4941-addc-bc1db262845f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:50.590535 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 164/323] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:54:50.591052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:50.619479 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a16ee-f033-40fb-87ee-3bae896d1811 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:50.674853 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8da75-fae6-4941-addc-bc1db262845f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:50.716584 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2569af-b944-429a-bb49-511dc0215928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:50.717257 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2569af-b944-429a-bb49-511dc0215928 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:50.717545 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2569af-b944-429a-bb49-511dc0215928 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:50.717825 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2569af-b944-429a-bb49-511dc0215928 None admin] PATH_INFO: `/v3/groups` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:50.718555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2569af-b944-429a-bb49-511dc0215928 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:50.720033 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2569af-b944-429a-bb49-511dc0215928 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:50.736647 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 160/324] 10.222.0.79 () {60 vars in 1134 bytes} [Thu Jul 14 11:54:50 2022] POST /identity/v3/groups => generated 226 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:54:50.737917 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494776f-5d20-49ca-9cca-a29734c70f5b None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:50.738219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494776f-5d20-49ca-9cca-a29734c70f5b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:50.738530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494776f-5d20-49ca-9cca-a29734c70f5b None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:50.739908 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 161/325] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:50.746040 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e094a48-2578-47d8-b420-e12c0432b9d8 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:50.746318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e094a48-2578-47d8-b420-e12c0432b9d8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:50.746655 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e094a48-2578-47d8-b420-e12c0432b9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:50.767823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6e094a48-2578-47d8-b420-e12c0432b9d8 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:50.768047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a16ee-f033-40fb-87ee-3bae896d1811 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:50.769064 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6e094a48-2578-47d8-b420-e12c0432b9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:50.824914 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae9d37-6c8d-49cd-87e0-34066ad9ff86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:50.825789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae9d37-6c8d-49cd-87e0-34066ad9ff86 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:50.826427 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae9d37-6c8d-49cd-87e0-34066ad9ff86 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:50.826761 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae9d37-6c8d-49cd-87e0-34066ad9ff86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:50.843538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae9d37-6c8d-49cd-87e0-34066ad9ff86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:50.853999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-0eae9d37-6c8d-49cd-87e0-34066ad9ff86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:50.853999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:50.853999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:50.853999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:50.853999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:50.853999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:50.853999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:50.853999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:50.853999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:50.853999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:50.853999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:50.853999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:50.853999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:50.853999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:50.853999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:50.853999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:50.855042 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:50.855042 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:50.855042 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:50.855042 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:50.855042 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:50.855042 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:50.855042 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:50.855042 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:50.855042 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:50.855042 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:50.855042 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:50.855042 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:50.855042 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:50.855042 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:50.855042 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:50.855042 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:50.856830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:50.856830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:50.856830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:50.856830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:50.856830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:50.856830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:50.856830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:50.856830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:50.856830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:50.856830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:50.856830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:50.856830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:54:50.856830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 165/326] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:54:50.864664 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae9d37-6c8d-49cd-87e0-34066ad9ff86 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:50.888383 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 162/327] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:54:50.888793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:50.928373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e094a48-2578-47d8-b420-e12c0432b9d8 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:50.980112 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:51.003775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae9d37-6c8d-49cd-87e0-34066ad9ff86 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:51.058434 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338acc12-c6d1-4f49-93cc-efba59ef0000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:51.059170 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338acc12-c6d1-4f49-93cc-efba59ef0000 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:51.059486 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338acc12-c6d1-4f49-93cc-efba59ef0000 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:51.059768 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338acc12-c6d1-4f49-93cc-efba59ef0000 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:51.060542 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338acc12-c6d1-4f49-93cc-efba59ef0000 None admin] RBAC: Adding query filter params (name=member) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:51.060854 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338acc12-c6d1-4f49-93cc-efba59ef0000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:51.062978 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338acc12-c6d1-4f49-93cc-efba59ef0000 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:51.080136 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 166/328] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:54:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:51.085824 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338acc12-c6d1-4f49-93cc-efba59ef0000 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:51.100502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e094a48-2578-47d8-b420-e12c0432b9d8 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:51.168513 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bc19c-3547-4f8f-a40b-968e472118a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:51.169386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bc19c-3547-4f8f-a40b-968e472118a6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:51.169669 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bc19c-3547-4f8f-a40b-968e472118a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:51.169947 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bc19c-3547-4f8f-a40b-968e472118a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:51.187820 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254bc19c-3547-4f8f-a40b-968e472118a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:51.198121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-254bc19c-3547-4f8f-a40b-968e472118a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:54:51.198121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:51.198121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:51.198121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:51.198121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:51.198121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:51.198121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:51.198121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:51.198121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:51.198121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:51.198121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:51.198121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:51.198121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:51.198121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:51.198121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:51.198121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:51.199854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:51.199854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:51.199854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:51.199854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:51.199854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:51.199854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:51.199854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:51.199854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:51.199854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:51.199854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:51.199854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:51.199854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:51.199854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:51.199854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:51.199854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:51.199854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:51.200996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:51.200996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:51.200996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:51.200996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:51.200996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:51.200996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:51.200996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:51.200996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:51.200996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:51.200996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:51.200996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:54:51.200996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:54:51.200996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 163/329] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:54:51.206012 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bc19c-3547-4f8f-a40b-968e472118a6 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:51.241296 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:51.281201 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338acc12-c6d1-4f49-93cc-efba59ef0000 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:51.336998 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c0564-2818-47c4-a8eb-f2688fa6b4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:51.339570 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c0564-2818-47c4-a8eb-f2688fa6b4cc None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:51.339864 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c0564-2818-47c4-a8eb-f2688fa6b4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:51.340147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c0564-2818-47c4-a8eb-f2688fa6b4cc None admin] PATH_INFO: `/v3/users/f53026f4cf064aaab64112a65473ae71` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:51.343285 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c0564-2818-47c4-a8eb-f2688fa6b4cc None admin] RBAC: Authorizing `identity:get_user(user_id=f53026f4cf064aaab64112a65473ae71)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:51.345035 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c0564-2818-47c4-a8eb-f2688fa6b4cc None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:51.348013 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 167/330] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:51 2022] GET /identity/v3/users/f53026f4cf064aaab64112a65473ae71 => generated 293 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:51.353797 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c0564-2818-47c4-a8eb-f2688fa6b4cc None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:51.365288 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:51.400182 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bc19c-3547-4f8f-a40b-968e472118a6 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:51.470144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d20f5e-fb28-4e15-863c-5e97a74dd0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:51.472729 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d20f5e-fb28-4e15-863c-5e97a74dd0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:51.474068 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d20f5e-fb28-4e15-863c-5e97a74dd0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:51.474693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d20f5e-fb28-4e15-863c-5e97a74dd0f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:51.476799 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d20f5e-fb28-4e15-863c-5e97a74dd0f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:51.477605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d20f5e-fb28-4e15-863c-5e97a74dd0f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:51.481756 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d20f5e-fb28-4e15-863c-5e97a74dd0f1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:51.503051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 164/331] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:54:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:51.508162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d20f5e-fb28-4e15-863c-5e97a74dd0f1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:51.514995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c0564-2818-47c4-a8eb-f2688fa6b4cc None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:51.554762 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48411fac-db1d-4e8a-acd5-61687a837091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:51.555814 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48411fac-db1d-4e8a-acd5-61687a837091 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:51.556306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48411fac-db1d-4e8a-acd5-61687a837091 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:51.556784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48411fac-db1d-4e8a-acd5-61687a837091 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:51.557870 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48411fac-db1d-4e8a-acd5-61687a837091 None admin] RBAC: Adding query filter params (role.id=9a3a3371dd4d4405b2e4604acc314d43, user.id=f53026f4cf064aaab64112a65473ae71, scope.system=all) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:51.558985 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48411fac-db1d-4e8a-acd5-61687a837091 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:51.560704 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48411fac-db1d-4e8a-acd5-61687a837091 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:51.578203 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 168/332] 10.222.0.79 () {56 vars in 1308 bytes} [Thu Jul 14 11:54:51 2022] GET /identity/v3/role_assignments?user.id=f53026f4cf064aaab64112a65473ae71&scope.system=all&role.id=9a3a3371dd4d4405b2e4604acc314d43 => generated 510 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:51.663857 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d20f5e-fb28-4e15-863c-5e97a74dd0f1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:51.721075 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78f899-f4c5-4446-80a9-ae7d4775b03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:51.721986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78f899-f4c5-4446-80a9-ae7d4775b03e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:51.722269 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78f899-f4c5-4446-80a9-ae7d4775b03e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:51.722564 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78f899-f4c5-4446-80a9-ae7d4775b03e None admin] PATH_INFO: `/v3/users/9a2574f1e73c4a23bd5c8dd6982536e8` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:51.727525 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78f899-f4c5-4446-80a9-ae7d4775b03e None admin] RBAC: Authorizing `identity:get_user(user_id=9a2574f1e73c4a23bd5c8dd6982536e8)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:51.729081 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78f899-f4c5-4446-80a9-ae7d4775b03e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:51.731332 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 165/333] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:51 2022] GET /identity/v3/users/9a2574f1e73c4a23bd5c8dd6982536e8 => generated 293 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:51.742297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48411fac-db1d-4e8a-acd5-61687a837091 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:51.750012 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:51.876518 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48411fac-db1d-4e8a-acd5-61687a837091 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:51.924982 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d11e1-0e92-40fb-bbee-e5de181c40b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:51.926341 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d11e1-0e92-40fb-bbee-e5de181c40b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:51.926807 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d11e1-0e92-40fb-bbee-e5de181c40b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:51.927558 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d11e1-0e92-40fb-bbee-e5de181c40b9 None admin] PATH_INFO: `/v3/system/users/9a2574f1e73c4a23bd5c8dd6982536e8/roles/78a510490d1e423c89a3b430c8530483` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:51.930000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d11e1-0e92-40fb-bbee-e5de181c40b9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9a2574f1e73c4a23bd5c8dd6982536e8, role_id=78a510490d1e423c89a3b430c8530483)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:51.931666 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d11e1-0e92-40fb-bbee-e5de181c40b9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:51.948424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 169/334] 10.222.0.79 () {58 vars in 1334 bytes} [Thu Jul 14 11:54:51 2022] PUT /identity/v3/system/users/9a2574f1e73c4a23bd5c8dd6982536e8/roles/78a510490d1e423c89a3b430c8530483 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:54:53.518119 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830ec2a-900d-49e7-a38f-f72c1b6f9524 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:53.518809 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830ec2a-900d-49e7-a38f-f72c1b6f9524 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:53.519032 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830ec2a-900d-49e7-a38f-f72c1b6f9524 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:53.520872 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 166/335] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:53.527485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4af29-c3a6-464c-821f-86a14d00a2a2 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:53.528011 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4af29-c3a6-464c-821f-86a14d00a2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:53.528011 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4af29-c3a6-464c-821f-86a14d00a2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:53.547773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-35c4af29-c3a6-464c-821f-86a14d00a2a2 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:53.548989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-35c4af29-c3a6-464c-821f-86a14d00a2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:53.624582 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:53.639671 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 170/336] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:54:53.680570 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830ec2a-900d-49e7-a38f-f72c1b6f9524 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:53.699389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:53.819443 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830ec2a-900d-49e7-a38f-f72c1b6f9524 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:53.865846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b949157-4639-4019-ba1c-e3bda12c40ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:53.866702 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b949157-4639-4019-ba1c-e3bda12c40ed None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:53.866992 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b949157-4639-4019-ba1c-e3bda12c40ed None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:53.867274 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b949157-4639-4019-ba1c-e3bda12c40ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:53.882690 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b949157-4639-4019-ba1c-e3bda12c40ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:53.891575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-3b949157-4639-4019-ba1c-e3bda12c40ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:54:53.891575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:53.891575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:53.891575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:53.891575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:53.891575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:53.891575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:53.891575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:53.891575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:53.891575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:53.891575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:53.891575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:53.891575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:53.891575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:53.891575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:53.891575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:53.892553 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:53.892553 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:53.892553 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:53.892553 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:53.892553 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:53.892553 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:53.892553 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:53.892553 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:53.892553 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:53.892553 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:53.892553 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:53.892553 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:53.892553 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:53.892553 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:53.892553 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:53.892553 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:53.893847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:53.893847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:53.893847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:53.893847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:53.893847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:53.893847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:53.893847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:53.893847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:53.893847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:53.893847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:53.893847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:54:53.893847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:54:53.893847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 167/337] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Jul 14 11:54:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:53.899860 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4af29-c3a6-464c-821f-86a14d00a2a2 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:54.025848 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4af29-c3a6-464c-821f-86a14d00a2a2 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:54.039910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f85ef-bda9-42f9-b333-33d2e70a0419 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:54.040242 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f85ef-bda9-42f9-b333-33d2e70a0419 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:54.040478 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f85ef-bda9-42f9-b333-33d2e70a0419 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:54.041885 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 168/338] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:54.048955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f7dc0-7211-41aa-a0b4-4a9b993959e8 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:54.049250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f7dc0-7211-41aa-a0b4-4a9b993959e8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:54.049532 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f7dc0-7211-41aa-a0b4-4a9b993959e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:54.071515 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a34f7dc0-7211-41aa-a0b4-4a9b993959e8 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:54.072980 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a34f7dc0-7211-41aa-a0b4-4a9b993959e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:54.099785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5a5e6-8d22-4e53-a363-e12d619ce6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:54.100096 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5a5e6-8d22-4e53-a363-e12d619ce6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:54.100386 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5a5e6-8d22-4e53-a363-e12d619ce6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:54.100666 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5a5e6-8d22-4e53-a363-e12d619ce6d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:54.101582 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5a5e6-8d22-4e53-a363-e12d619ce6d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:54.101824 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5a5e6-8d22-4e53-a363-e12d619ce6d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:54.103257 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5a5e6-8d22-4e53-a363-e12d619ce6d9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:54.117102 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 171/339] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:54:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:54.134841 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5a5e6-8d22-4e53-a363-e12d619ce6d9 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:54.163439 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 169/340] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:54:54.191846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f7dc0-7211-41aa-a0b4-4a9b993959e8 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:54.195249 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:54.265839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:54.356203 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5a5e6-8d22-4e53-a363-e12d619ce6d9 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:54.401502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f7dc0-7211-41aa-a0b4-4a9b993959e8 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:54.411395 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064e82e-5aea-4d4e-8c96-c4bef2bcb7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:54.412069 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064e82e-5aea-4d4e-8c96-c4bef2bcb7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:54.412352 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064e82e-5aea-4d4e-8c96-c4bef2bcb7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:54.412632 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064e82e-5aea-4d4e-8c96-c4bef2bcb7c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:54.447863 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6bd573-b05d-42c7-a35f-a5bf6242b5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:54.448725 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bd573-b05d-42c7-a35f-a5bf6242b5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:54.449666 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bd573-b05d-42c7-a35f-a5bf6242b5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:54.450122 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bd573-b05d-42c7-a35f-a5bf6242b5e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:54.469009 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6bd573-b05d-42c7-a35f-a5bf6242b5e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:54.477374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-4a6bd573-b05d-42c7-a35f-a5bf6242b5e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:54.477374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:54.477374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:54.477374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:54.477374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:54.477374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:54.477374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:54.477374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:54.477374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:54.477374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:54.477374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:54.477374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:54.477374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:54.477374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:54.477374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:54.477374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:54.478326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:54.478326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:54.478326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:54.478326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:54.478326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:54.478326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:54.478326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:54.478326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:54.478326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:54.478326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:54.478326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:54.478326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:54.478326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:54.478326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:54.478326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:54.478326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:54.479154 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:54.479154 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:54.479154 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:54.479154 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:54.479154 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:54.479154 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:54.479154 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:54.479154 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:54.479154 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:54.479154 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:54.479154 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:54.479154 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:54:54.479154 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 170/341] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:54.481140 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63d0d3-7699-4d52-b40d-1e08d7f9352c None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:54.481272 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63d0d3-7699-4d52-b40d-1e08d7f9352c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:54.481508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63d0d3-7699-4d52-b40d-1e08d7f9352c None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:54.487764 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 171/342] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:54.488892 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63d0d3-7699-4d52-b40d-1e08d7f9352c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:54.558860 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064e82e-5aea-4d4e-8c96-c4bef2bcb7c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:54.560356 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064e82e-5aea-4d4e-8c96-c4bef2bcb7c6 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:54.597796 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:54.677964 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63d0d3-7699-4d52-b40d-1e08d7f9352c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:54.687758 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:54.758388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba339c-2b4c-4ffd-b9c2-a338e7d12a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:54.759097 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba339c-2b4c-4ffd-b9c2-a338e7d12a56 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:54.759386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba339c-2b4c-4ffd-b9c2-a338e7d12a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:54.759667 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba339c-2b4c-4ffd-b9c2-a338e7d12a56 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:54.760486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba339c-2b4c-4ffd-b9c2-a338e7d12a56 None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:54.760805 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba339c-2b4c-4ffd-b9c2-a338e7d12a56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:54.764383 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba339c-2b4c-4ffd-b9c2-a338e7d12a56 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:54.775231 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 172/343] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:54:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 11:54:54.778225 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654f36d-9f63-475c-bf70-a372e5c72b07 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:54.778536 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654f36d-9f63-475c-bf70-a372e5c72b07 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:54.778825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654f36d-9f63-475c-bf70-a372e5c72b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:54.782280 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 172/344] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:54:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:54.784861 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba339c-2b4c-4ffd-b9c2-a338e7d12a56 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:54.818266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-4654f36d-9f63-475c-bf70-a372e5c72b07 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:54.820395 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-4654f36d-9f63-475c-bf70-a372e5c72b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:54.952716 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 173/345] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:54.958010 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654f36d-9f63-475c-bf70-a372e5c72b07 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:55.016263 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba339c-2b4c-4ffd-b9c2-a338e7d12a56 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:55.051357 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:55.062218 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cc8d2-5cac-45d6-9117-fe3db55d811d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:55.063153 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cc8d2-5cac-45d6-9117-fe3db55d811d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:55.063437 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cc8d2-5cac-45d6-9117-fe3db55d811d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:55.063939 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cc8d2-5cac-45d6-9117-fe3db55d811d None admin] PATH_INFO: `/v3/projects/05ae476a690b4d899f0bd474f195f9ea` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:55.065447 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4cc8d2-5cac-45d6-9117-fe3db55d811d None admin] RBAC: Authorizing `identity:get_project(project_id=05ae476a690b4d899f0bd474f195f9ea)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:55.067350 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4cc8d2-5cac-45d6-9117-fe3db55d811d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:55.073906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 173/346] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:54 2022] GET /identity/v3/projects/05ae476a690b4d899f0bd474f195f9ea => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:55.075688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e17d0e-735d-4f5b-a084-5fc6c94abb1f None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:55.076096 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e17d0e-735d-4f5b-a084-5fc6c94abb1f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:55.076484 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e17d0e-735d-4f5b-a084-5fc6c94abb1f None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:55.078111 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 174/347] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:55.082258 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e17d0e-735d-4f5b-a084-5fc6c94abb1f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:55.115179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:55.132725 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654f36d-9f63-475c-bf70-a372e5c72b07 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:55.186154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc8716-58e8-4696-9e39-50a605ee47cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:55.186740 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc8716-58e8-4696-9e39-50a605ee47cc None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:55.187075 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc8716-58e8-4696-9e39-50a605ee47cc None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:55.187349 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc8716-58e8-4696-9e39-50a605ee47cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:55.230820 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e17d0e-735d-4f5b-a084-5fc6c94abb1f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:55.280800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc8716-58e8-4696-9e39-50a605ee47cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:55.282871 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc8716-58e8-4696-9e39-50a605ee47cc None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:55.283930 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b93b54-1ba2-4000-b01d-50d96e592dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:55.284934 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b93b54-1ba2-4000-b01d-50d96e592dec None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:55.285324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b93b54-1ba2-4000-b01d-50d96e592dec None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:55.285708 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b93b54-1ba2-4000-b01d-50d96e592dec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:55.297276 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b93b54-1ba2-4000-b01d-50d96e592dec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:55.306716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-66b93b54-1ba2-4000-b01d-50d96e592dec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:55.306716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:55.306716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:55.306716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:55.306716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:55.306716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:55.306716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:55.306716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:55.306716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:55.306716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:55.306716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:55.306716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:55.306716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:55.306716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:55.306716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:55.306716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:55.307933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:55.307933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:55.307933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:55.307933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:55.307933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:55.307933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:55.307933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:55.307933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:55.307933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:55.307933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:55.307933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:55.307933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:55.307933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:55.307933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:55.307933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:55.307933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:55.308955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:55.308955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:55.308955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:55.308955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:55.308955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:55.308955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:55.308955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:55.308955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:55.308955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:55.308955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:55.308955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:55.308955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:54:55.312906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 175/348] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:55.312906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b93b54-1ba2-4000-b01d-50d96e592dec None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:55.385645 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:55.401743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 174/349] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:54:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:55.403938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238e357-f12f-4b94-976d-488edf898787 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:55.404400 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238e357-f12f-4b94-976d-488edf898787 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:55.404831 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238e357-f12f-4b94-976d-488edf898787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:55.407511 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:55.422175 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-3238e357-f12f-4b94-976d-488edf898787 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:55.424363 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-3238e357-f12f-4b94-976d-488edf898787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:55.494812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 175/350] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:55.496523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238e357-f12f-4b94-976d-488edf898787 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:55.501847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b93b54-1ba2-4000-b01d-50d96e592dec None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:55.574272 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1cfd7f-64f9-4edb-9144-a3c83b181f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:55.575333 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cfd7f-64f9-4edb-9144-a3c83b181f91 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:55.575743 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cfd7f-64f9-4edb-9144-a3c83b181f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:55.576123 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cfd7f-64f9-4edb-9144-a3c83b181f91 None admin] PATH_INFO: `/v3/groups/f5ade39976cf461283cc28b9dddfaef1` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:55.583259 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1cfd7f-64f9-4edb-9144-a3c83b181f91 None admin] RBAC: Authorizing `identity:get_group(group_id=f5ade39976cf461283cc28b9dddfaef1)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:55.585192 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1cfd7f-64f9-4edb-9144-a3c83b181f91 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:55.587396 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 176/351] 10.222.0.79 () {56 vars in 1180 bytes} [Thu Jul 14 11:54:55 2022] GET /identity/v3/groups/f5ade39976cf461283cc28b9dddfaef1 => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:55.588514 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1cfd7f-64f9-4edb-9144-a3c83b181f91 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:55.606414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238e357-f12f-4b94-976d-488edf898787 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:55.627210 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:55.654940 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b6f7e-0043-4934-80b7-0276dd82dde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:55.656063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b6f7e-0043-4934-80b7-0276dd82dde0 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:55.656530 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b6f7e-0043-4934-80b7-0276dd82dde0 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:55.657021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b6f7e-0043-4934-80b7-0276dd82dde0 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:55.657944 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b6f7e-0043-4934-80b7-0276dd82dde0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:55.658363 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b6f7e-0043-4934-80b7-0276dd82dde0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:55.660122 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b6f7e-0043-4934-80b7-0276dd82dde0 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:55.672889 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 176/352] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:54:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:55.673100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b6f7e-0043-4934-80b7-0276dd82dde0 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:55.744143 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1cfd7f-64f9-4edb-9144-a3c83b181f91 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:55.780019 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:55.797292 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9685c0-e794-4163-af1a-d84a9528118a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:55.799091 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9685c0-e794-4163-af1a-d84a9528118a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:55.799876 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9685c0-e794-4163-af1a-d84a9528118a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:55.800355 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9685c0-e794-4163-af1a-d84a9528118a None admin] PATH_INFO: `/v3/projects/05ae476a690b4d899f0bd474f195f9ea` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:55.802694 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9685c0-e794-4163-af1a-d84a9528118a None admin] RBAC: Authorizing `identity:get_project(project_id=05ae476a690b4d899f0bd474f195f9ea)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:55.804439 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9685c0-e794-4163-af1a-d84a9528118a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:55.804858 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b6f7e-0043-4934-80b7-0276dd82dde0 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:55.806810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 177/353] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:55 2022] GET /identity/v3/projects/05ae476a690b4d899f0bd474f195f9ea => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:55.809224 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9685c0-e794-4163-af1a-d84a9528118a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:55.850791 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afbc8e-34b7-4424-b813-89a256f238ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:55.851687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afbc8e-34b7-4424-b813-89a256f238ad None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:55.852046 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afbc8e-34b7-4424-b813-89a256f238ad None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:55.852392 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afbc8e-34b7-4424-b813-89a256f238ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:55.865676 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63afbc8e-34b7-4424-b813-89a256f238ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:55.874977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-63afbc8e-34b7-4424-b813-89a256f238ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:54:55.874977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:55.874977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:55.874977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:55.874977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:55.874977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:55.874977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:55.874977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:55.874977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:55.874977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:55.874977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:55.874977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:55.874977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:55.874977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:55.874977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:55.874977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:55.875939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:55.875939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:55.875939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:55.875939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:55.875939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:55.875939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:55.875939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:55.875939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:55.875939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:55.875939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:55.875939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:55.875939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:55.875939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:55.875939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:55.875939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:55.875939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:55.876814 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:55.876814 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:55.876814 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:55.876814 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:55.876814 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:55.876814 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:55.876814 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:55.876814 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:55.876814 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:55.876814 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:55.876814 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:54:55.876814 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:54:55.876814 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 177/354] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:55.879792 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3ab76-8efc-4c55-bc87-30f5b0d1736e None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:55.880084 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3ab76-8efc-4c55-bc87-30f5b0d1736e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:55.880364 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3ab76-8efc-4c55-bc87-30f5b0d1736e None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:55.882472 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 178/355] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:55.883465 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3ab76-8efc-4c55-bc87-30f5b0d1736e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:55.940624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:55.941628 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9685c0-e794-4163-af1a-d84a9528118a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:55.983098 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00a443-43e9-4c53-9d18-a0502ee7d306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:55.983776 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00a443-43e9-4c53-9d18-a0502ee7d306 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:55.984065 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00a443-43e9-4c53-9d18-a0502ee7d306 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:55.984347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00a443-43e9-4c53-9d18-a0502ee7d306 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:55.985196 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00a443-43e9-4c53-9d18-a0502ee7d306 None admin] RBAC: Adding query filter params (group.id=f5ade39976cf461283cc28b9dddfaef1, role.id=986e347cbb9e43e7a49dfef9be8ec9dd, scope.project.id=05ae476a690b4d899f0bd474f195f9ea) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:55.985515 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00a443-43e9-4c53-9d18-a0502ee7d306 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:55.988145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00a443-43e9-4c53-9d18-a0502ee7d306 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:55.994273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 178/356] 10.222.0.79 () {56 vars in 1376 bytes} [Thu Jul 14 11:54:55 2022] GET /identity/v3/role_assignments?group.id=f5ade39976cf461283cc28b9dddfaef1&scope.project.id=05ae476a690b4d899f0bd474f195f9ea&role.id=986e347cbb9e43e7a49dfef9be8ec9dd => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:55.995166 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00a443-43e9-4c53-9d18-a0502ee7d306 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:56.023518 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3ab76-8efc-4c55-bc87-30f5b0d1736e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:56.069612 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:56.073017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0870f8-c9c1-4fc4-944d-80721bb95f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:56.074390 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0870f8-c9c1-4fc4-944d-80721bb95f49 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:56.074720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0870f8-c9c1-4fc4-944d-80721bb95f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:56.075007 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0870f8-c9c1-4fc4-944d-80721bb95f49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:56.148698 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00a443-43e9-4c53-9d18-a0502ee7d306 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:56.179535 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0870f8-c9c1-4fc4-944d-80721bb95f49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:56.181242 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0870f8-c9c1-4fc4-944d-80721bb95f49 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:56.192092 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd283a2f-6a71-4f91-a4fe-af481f7348fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:56.193055 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd283a2f-6a71-4f91-a4fe-af481f7348fb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:56.193428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd283a2f-6a71-4f91-a4fe-af481f7348fb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:56.193786 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd283a2f-6a71-4f91-a4fe-af481f7348fb None admin] PATH_INFO: `/v3/groups/f5ade39976cf461283cc28b9dddfaef1` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:56.195234 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd283a2f-6a71-4f91-a4fe-af481f7348fb None admin] RBAC: Authorizing `identity:get_group(group_id=f5ade39976cf461283cc28b9dddfaef1)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:56.196768 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd283a2f-6a71-4f91-a4fe-af481f7348fb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:56.198630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 179/357] 10.222.0.79 () {56 vars in 1180 bytes} [Thu Jul 14 11:54:55 2022] GET /identity/v3/groups/f5ade39976cf461283cc28b9dddfaef1 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:56.204046 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764e875-5db3-4bac-8e10-297fd14ec3e6 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:56.204641 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764e875-5db3-4bac-8e10-297fd14ec3e6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:56.205146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764e875-5db3-4bac-8e10-297fd14ec3e6 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:56.206735 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 180/358] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:54:56.208012 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764e875-5db3-4bac-8e10-297fd14ec3e6 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:56.237206 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:56.318883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 179/359] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:54:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:56.320364 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3fdf2-6984-4e56-bef0-01609f881ced None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:56.320607 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3fdf2-6984-4e56-bef0-01609f881ced None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:56.320890 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3fdf2-6984-4e56-bef0-01609f881ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:56.336609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764e875-5db3-4bac-8e10-297fd14ec3e6 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:56.343560 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-44f3fdf2-6984-4e56-bef0-01609f881ced None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:56.344783 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-44f3fdf2-6984-4e56-bef0-01609f881ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:56.362306 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:56.395063 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320f5f2-a3d9-4067-a2a9-1e8ffdd7a96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:56.395921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320f5f2-a3d9-4067-a2a9-1e8ffdd7a96b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:56.396311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320f5f2-a3d9-4067-a2a9-1e8ffdd7a96b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:56.396688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320f5f2-a3d9-4067-a2a9-1e8ffdd7a96b None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:56.397631 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320f5f2-a3d9-4067-a2a9-1e8ffdd7a96b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:56.397949 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320f5f2-a3d9-4067-a2a9-1e8ffdd7a96b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:56.399382 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320f5f2-a3d9-4067-a2a9-1e8ffdd7a96b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:56.410279 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 181/360] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:54:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:56.415642 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320f5f2-a3d9-4067-a2a9-1e8ffdd7a96b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:56.440017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 180/361] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:56.441601 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cabc69-b979-42bc-b6a4-89b6d2a55f4f None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:56.442036 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cabc69-b979-42bc-b6a4-89b6d2a55f4f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:56.442387 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cabc69-b979-42bc-b6a4-89b6d2a55f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:56.461794 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-72cabc69-b979-42bc-b6a4-89b6d2a55f4f None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:56.463292 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-72cabc69-b979-42bc-b6a4-89b6d2a55f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:56.542256 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320f5f2-a3d9-4067-a2a9-1e8ffdd7a96b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:56.556509 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:56.563148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 181/362] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:56.564025 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cabc69-b979-42bc-b6a4-89b6d2a55f4f None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:56.589499 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cb3e2-770a-4da1-a5cd-74ab39b53e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:56.590248 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cb3e2-770a-4da1-a5cd-74ab39b53e89 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:56.590559 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cb3e2-770a-4da1-a5cd-74ab39b53e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:56.590846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cb3e2-770a-4da1-a5cd-74ab39b53e89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:56.591702 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5cb3e2-770a-4da1-a5cd-74ab39b53e89 None admin] RBAC: Adding query filter params (group.id=f5ade39976cf461283cc28b9dddfaef1, role.id=9a3a3371dd4d4405b2e4604acc314d43, scope.project.id=05ae476a690b4d899f0bd474f195f9ea) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:56.592023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5cb3e2-770a-4da1-a5cd-74ab39b53e89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:56.593506 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5cb3e2-770a-4da1-a5cd-74ab39b53e89 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:56.599982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 182/363] 10.222.0.79 () {56 vars in 1376 bytes} [Thu Jul 14 11:54:56 2022] GET /identity/v3/role_assignments?group.id=f5ade39976cf461283cc28b9dddfaef1&scope.project.id=05ae476a690b4d899f0bd474f195f9ea&role.id=9a3a3371dd4d4405b2e4604acc314d43 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:56.600747 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cb3e2-770a-4da1-a5cd-74ab39b53e89 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:56.674582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:56.705749 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cabc69-b979-42bc-b6a4-89b6d2a55f4f None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:56.747029 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cb3e2-770a-4da1-a5cd-74ab39b53e89 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:56.752160 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d063bf-cbe6-4d36-b779-ab9367f2eb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:56.753059 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d063bf-cbe6-4d36-b779-ab9367f2eb5a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:56.753348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d063bf-cbe6-4d36-b779-ab9367f2eb5a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:56.753629 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d063bf-cbe6-4d36-b779-ab9367f2eb5a None admin] PATH_INFO: `/v3/projects/bf999b1796e2439bb0a35f1812856355` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:56.754944 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d063bf-cbe6-4d36-b779-ab9367f2eb5a None admin] RBAC: Authorizing `identity:get_project(project_id=bf999b1796e2439bb0a35f1812856355)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:56.757065 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d063bf-cbe6-4d36-b779-ab9367f2eb5a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:56.759107 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 182/364] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:56 2022] GET /identity/v3/projects/bf999b1796e2439bb0a35f1812856355 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:56.763519 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d063bf-cbe6-4d36-b779-ab9367f2eb5a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:56.807832 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f6945-68e1-4f6f-b8cd-8937dc454007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:56.808903 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f6945-68e1-4f6f-b8cd-8937dc454007 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:56.809203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f6945-68e1-4f6f-b8cd-8937dc454007 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:56.809491 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f6945-68e1-4f6f-b8cd-8937dc454007 None admin] PATH_INFO: `/v3/users/9a2574f1e73c4a23bd5c8dd6982536e8` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:56.811119 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f6945-68e1-4f6f-b8cd-8937dc454007 None admin] RBAC: Authorizing `identity:get_user(user_id=9a2574f1e73c4a23bd5c8dd6982536e8)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:56.813047 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f6945-68e1-4f6f-b8cd-8937dc454007 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:56.815029 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 183/365] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:54:56 2022] GET /identity/v3/users/9a2574f1e73c4a23bd5c8dd6982536e8 => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:56.815862 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f6945-68e1-4f6f-b8cd-8937dc454007 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:56.861007 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:56.899496 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d063bf-cbe6-4d36-b779-ab9367f2eb5a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:56.941213 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e35df-f195-4c11-b290-64a26ac109d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:56.942073 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e35df-f195-4c11-b290-64a26ac109d4 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:56.942313 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e35df-f195-4c11-b290-64a26ac109d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:56.942621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e35df-f195-4c11-b290-64a26ac109d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:56.954760 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e35df-f195-4c11-b290-64a26ac109d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:56.956449 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f6945-68e1-4f6f-b8cd-8937dc454007 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:56.963088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-5d9e35df-f195-4c11-b290-64a26ac109d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:54:56.963088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:56.963088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:56.963088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:56.963088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:56.963088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:56.963088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:56.963088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:56.963088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:56.963088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:56.963088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:56.963088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:56.963088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:56.963088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:56.963088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:56.963088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:56.964027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:56.964027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:56.964027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:56.964027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:56.964027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:56.964027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:56.964027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:56.964027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:56.964027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:56.964027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:56.964027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:56.964027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:56.964027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:56.964027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:56.964027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:56.964027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:56.965360 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:56.965360 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:56.965360 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:56.965360 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:56.965360 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:56.965360 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:56.965360 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:56.965360 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:56.965360 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:56.965360 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:56.965360 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:54:56.965360 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:54:56.970000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 183/366] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Jul 14 11:54:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:56.971102 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e35df-f195-4c11-b290-64a26ac109d4 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:56.976762 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:57.021320 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f811f-0394-49e2-a3ff-84fed8afb24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:57.022117 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f811f-0394-49e2-a3ff-84fed8afb24f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:57.022402 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f811f-0394-49e2-a3ff-84fed8afb24f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:57.022702 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f811f-0394-49e2-a3ff-84fed8afb24f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:57.044435 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f811f-0394-49e2-a3ff-84fed8afb24f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:57.055540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-ae9f811f-0394-49e2-a3ff-84fed8afb24f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:54:57.055540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:57.055540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:57.055540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:57.055540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:57.055540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:57.055540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:57.055540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:57.055540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:57.055540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:57.055540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:57.055540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:57.055540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:57.055540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:57.055540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:57.055540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:57.056453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:57.056453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:57.056453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:57.056453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:57.056453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:57.056453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:57.056453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:57.056453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:57.056453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:57.056453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:57.056453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:57.056453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:57.056453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:57.056453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:57.056453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:57.056453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:57.057221 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:57.057221 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:57.057221 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:57.057221 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:57.057221 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:57.057221 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:57.057221 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:57.057221 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:57.057221 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:57.057221 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:57.057221 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:54:57.057221 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:54:57.060636 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 184/367] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:54:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:57.061902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f811f-0394-49e2-a3ff-84fed8afb24f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:57.134324 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e35df-f195-4c11-b290-64a26ac109d4 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:57.178311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:57.190442 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15c1b4-5beb-41a7-9e85-d9b282a48670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:57.191575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15c1b4-5beb-41a7-9e85-d9b282a48670 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:57.192175 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15c1b4-5beb-41a7-9e85-d9b282a48670 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:57.192714 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15c1b4-5beb-41a7-9e85-d9b282a48670 None admin] PATH_INFO: `/v3/groups/f5ade39976cf461283cc28b9dddfaef1` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:57.194377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15c1b4-5beb-41a7-9e85-d9b282a48670 None admin] RBAC: Authorizing `identity:get_group(group_id=f5ade39976cf461283cc28b9dddfaef1)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:57.196834 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15c1b4-5beb-41a7-9e85-d9b282a48670 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:57.200548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 184/368] 10.222.0.79 () {56 vars in 1180 bytes} [Thu Jul 14 11:54:56 2022] GET /identity/v3/groups/f5ade39976cf461283cc28b9dddfaef1 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:57.201790 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15c1b4-5beb-41a7-9e85-d9b282a48670 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:57.206172 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f811f-0394-49e2-a3ff-84fed8afb24f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:57.252043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1fb54-068a-4f44-bddc-37a47dc49dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:57.252784 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1fb54-068a-4f44-bddc-37a47dc49dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:57.253186 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1fb54-068a-4f44-bddc-37a47dc49dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:57.254091 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1fb54-068a-4f44-bddc-37a47dc49dc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:57.254521 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1fb54-068a-4f44-bddc-37a47dc49dc0 None admin] RBAC: Adding query filter params (role.id=78a510490d1e423c89a3b430c8530483, user.id=9a2574f1e73c4a23bd5c8dd6982536e8, scope.system=all) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:57.254957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1fb54-068a-4f44-bddc-37a47dc49dc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:57.256500 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1fb54-068a-4f44-bddc-37a47dc49dc0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:57.271556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 185/369] 10.222.0.79 () {56 vars in 1308 bytes} [Thu Jul 14 11:54:57 2022] GET /identity/v3/role_assignments?user.id=9a2574f1e73c4a23bd5c8dd6982536e8&scope.system=all&role.id=78a510490d1e423c89a3b430c8530483 => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:57.275595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1fb54-068a-4f44-bddc-37a47dc49dc0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:57.336928 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15c1b4-5beb-41a7-9e85-d9b282a48670 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:57.345297 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:57.382656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba4853-f7b4-4d53-9e0d-15be20e1f965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:57.383589 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba4853-f7b4-4d53-9e0d-15be20e1f965 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:57.384592 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba4853-f7b4-4d53-9e0d-15be20e1f965 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:57.385022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba4853-f7b4-4d53-9e0d-15be20e1f965 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:57.386151 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba4853-f7b4-4d53-9e0d-15be20e1f965 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:57.386783 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba4853-f7b4-4d53-9e0d-15be20e1f965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:57.388525 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba4853-f7b4-4d53-9e0d-15be20e1f965 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:57.402445 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 185/370] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:54:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:57.404250 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba4853-f7b4-4d53-9e0d-15be20e1f965 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:57.480523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:57.492695 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1fb54-068a-4f44-bddc-37a47dc49dc0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:57.536329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba4853-f7b4-4d53-9e0d-15be20e1f965 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:57.539206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955706a8-e0cc-46f7-9391-a403d2facae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:57.540265 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955706a8-e0cc-46f7-9391-a403d2facae7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:57.540375 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955706a8-e0cc-46f7-9391-a403d2facae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:57.540576 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955706a8-e0cc-46f7-9391-a403d2facae7 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:57.541339 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955706a8-e0cc-46f7-9391-a403d2facae7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:57.541650 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955706a8-e0cc-46f7-9391-a403d2facae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:57.543714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955706a8-e0cc-46f7-9391-a403d2facae7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:57.554708 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 186/371] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:57.559530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955706a8-e0cc-46f7-9391-a403d2facae7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:57.580921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbf1db-8230-40c3-b63b-64b8475ea6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:57.582309 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbf1db-8230-40c3-b63b-64b8475ea6bb None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:57.582824 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbf1db-8230-40c3-b63b-64b8475ea6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:57.583454 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbf1db-8230-40c3-b63b-64b8475ea6bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:57.585209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbf1db-8230-40c3-b63b-64b8475ea6bb None admin] RBAC: Adding query filter params (group.id=f5ade39976cf461283cc28b9dddfaef1, role.id=9a3a3371dd4d4405b2e4604acc314d43, scope.project.id=bf999b1796e2439bb0a35f1812856355) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:57.585771 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbf1db-8230-40c3-b63b-64b8475ea6bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:57.587847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbf1db-8230-40c3-b63b-64b8475ea6bb None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:57.595854 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 186/372] 10.222.0.79 () {56 vars in 1376 bytes} [Thu Jul 14 11:54:57 2022] GET /identity/v3/role_assignments?group.id=f5ade39976cf461283cc28b9dddfaef1&scope.project.id=bf999b1796e2439bb0a35f1812856355&role.id=9a3a3371dd4d4405b2e4604acc314d43 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:57.597666 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbf1db-8230-40c3-b63b-64b8475ea6bb None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:57.684618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:57.697398 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955706a8-e0cc-46f7-9391-a403d2facae7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:57.739603 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbf1db-8230-40c3-b63b-64b8475ea6bb None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:57.752829 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee846c-0a0f-4e27-ac2b-5dd3e645078c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:57.754259 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee846c-0a0f-4e27-ac2b-5dd3e645078c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:57.754777 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee846c-0a0f-4e27-ac2b-5dd3e645078c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:57.755270 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee846c-0a0f-4e27-ac2b-5dd3e645078c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:57.767542 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:57.783345 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ce5ba-1b52-43a5-92f6-23c5b3d1b127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:57.784067 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ce5ba-1b52-43a5-92f6-23c5b3d1b127 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:57.784354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ce5ba-1b52-43a5-92f6-23c5b3d1b127 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:57.784634 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ce5ba-1b52-43a5-92f6-23c5b3d1b127 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:57.846035 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee846c-0a0f-4e27-ac2b-5dd3e645078c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:57.848101 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee846c-0a0f-4e27-ac2b-5dd3e645078c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:57.869043 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ce5ba-1b52-43a5-92f6-23c5b3d1b127 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:57.871310 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ce5ba-1b52-43a5-92f6-23c5b3d1b127 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:57.955223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:57.967611 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 187/373] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:54:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:57.974774 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee846c-0a0f-4e27-ac2b-5dd3e645078c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:57.994086 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 187/374] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:54:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:58.001017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ce5ba-1b52-43a5-92f6-23c5b3d1b127 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:58.029904 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:58.092036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee846c-0a0f-4e27-ac2b-5dd3e645078c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:58.115916 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ce5ba-1b52-43a5-92f6-23c5b3d1b127 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:58.134050 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30a5c4-7c14-496b-93f1-fb237be89356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:58.135340 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30a5c4-7c14-496b-93f1-fb237be89356 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:58.135923 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30a5c4-7c14-496b-93f1-fb237be89356 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:58.136428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30a5c4-7c14-496b-93f1-fb237be89356 None admin] PATH_INFO: `/v3/projects/bf999b1796e2439bb0a35f1812856355` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:58.137980 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30a5c4-7c14-496b-93f1-fb237be89356 None admin] RBAC: Authorizing `identity:get_project(project_id=bf999b1796e2439bb0a35f1812856355)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:58.139689 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30a5c4-7c14-496b-93f1-fb237be89356 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:58.141773 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 188/375] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:57 2022] GET /identity/v3/projects/bf999b1796e2439bb0a35f1812856355 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:58.159222 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30a5c4-7c14-496b-93f1-fb237be89356 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:58.161057 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647906b0-e891-4c46-8aa8-ec7db476a1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:58.162036 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647906b0-e891-4c46-8aa8-ec7db476a1df None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:58.162405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647906b0-e891-4c46-8aa8-ec7db476a1df None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:58.166619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647906b0-e891-4c46-8aa8-ec7db476a1df None admin] PATH_INFO: `/v3/projects/3fccb5bf2b21430990bb49d29dadf01f` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:58.168660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647906b0-e891-4c46-8aa8-ec7db476a1df None admin] RBAC: Authorizing `identity:get_project(project_id=3fccb5bf2b21430990bb49d29dadf01f)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:58.170270 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647906b0-e891-4c46-8aa8-ec7db476a1df None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:58.172465 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 188/376] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:57 2022] GET /identity/v3/projects/3fccb5bf2b21430990bb49d29dadf01f => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:58.182487 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647906b0-e891-4c46-8aa8-ec7db476a1df None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:58.291635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:58.327389 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:58.342011 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647906b0-e891-4c46-8aa8-ec7db476a1df None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:58.348329 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30a5c4-7c14-496b-93f1-fb237be89356 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:58.393139 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f03101-6264-4802-8df0-9ce91ab4cf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:58.394230 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f03101-6264-4802-8df0-9ce91ab4cf21 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:58.394701 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f03101-6264-4802-8df0-9ce91ab4cf21 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:58.395057 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f03101-6264-4802-8df0-9ce91ab4cf21 None admin] PATH_INFO: `/v3/groups/8f4e7cbab47a4381beb52affbe2c232f` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:58.397660 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b19ad-58ef-4d97-bf7e-56e8373a6301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:58.398646 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b19ad-58ef-4d97-bf7e-56e8373a6301 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:58.399075 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b19ad-58ef-4d97-bf7e-56e8373a6301 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:58.399362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b19ad-58ef-4d97-bf7e-56e8373a6301 None admin] PATH_INFO: `/v3/groups/f5ade39976cf461283cc28b9dddfaef1` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:58.400704 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b19ad-58ef-4d97-bf7e-56e8373a6301 None admin] RBAC: Authorizing `identity:get_group(group_id=f5ade39976cf461283cc28b9dddfaef1)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:58.403313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b19ad-58ef-4d97-bf7e-56e8373a6301 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:58.404956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f03101-6264-4802-8df0-9ce91ab4cf21 None admin] RBAC: Authorizing `identity:get_group(group_id=8f4e7cbab47a4381beb52affbe2c232f)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:58.405333 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 189/377] 10.222.0.79 () {56 vars in 1180 bytes} [Thu Jul 14 11:54:58 2022] GET /identity/v3/groups/f5ade39976cf461283cc28b9dddfaef1 => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:58.406885 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f03101-6264-4802-8df0-9ce91ab4cf21 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:58.408732 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 189/378] 10.222.0.79 () {56 vars in 1180 bytes} [Thu Jul 14 11:54:58 2022] GET /identity/v3/groups/8f4e7cbab47a4381beb52affbe2c232f => generated 229 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:58.411046 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b19ad-58ef-4d97-bf7e-56e8373a6301 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:58.414775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f03101-6264-4802-8df0-9ce91ab4cf21 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:58.535037 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b19ad-58ef-4d97-bf7e-56e8373a6301 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:58.567001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:58.577499 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edcf46-e98b-4870-94d9-41734707027d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:58.578183 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edcf46-e98b-4870-94d9-41734707027d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:58.578470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edcf46-e98b-4870-94d9-41734707027d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:58.578778 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edcf46-e98b-4870-94d9-41734707027d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:58.579632 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edcf46-e98b-4870-94d9-41734707027d None admin] RBAC: Adding query filter params (group.id=f5ade39976cf461283cc28b9dddfaef1, role.id=986e347cbb9e43e7a49dfef9be8ec9dd, scope.project.id=bf999b1796e2439bb0a35f1812856355) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:58.579949 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edcf46-e98b-4870-94d9-41734707027d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:58.581716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edcf46-e98b-4870-94d9-41734707027d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:58.589076 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 190/379] 10.222.0.79 () {56 vars in 1376 bytes} [Thu Jul 14 11:54:58 2022] GET /identity/v3/role_assignments?group.id=f5ade39976cf461283cc28b9dddfaef1&scope.project.id=bf999b1796e2439bb0a35f1812856355&role.id=986e347cbb9e43e7a49dfef9be8ec9dd => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:58.622686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f03101-6264-4802-8df0-9ce91ab4cf21 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:58.680818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03264d-8124-4248-9f8c-132437d53a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:58.681868 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03264d-8124-4248-9f8c-132437d53a05 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:58.682351 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03264d-8124-4248-9f8c-132437d53a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:58.682867 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03264d-8124-4248-9f8c-132437d53a05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:58.683982 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03264d-8124-4248-9f8c-132437d53a05 None admin] RBAC: Adding query filter params (group.id=8f4e7cbab47a4381beb52affbe2c232f, role.id=eff4f9bbb7064bc1a0f9fc55a05fea51, scope.project.id=3fccb5bf2b21430990bb49d29dadf01f) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:58.684514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03264d-8124-4248-9f8c-132437d53a05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:58.686217 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03264d-8124-4248-9f8c-132437d53a05 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:58.700025 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a484047-4aca-48bc-8847-c91c0b019cf9 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:58.700229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a484047-4aca-48bc-8847-c91c0b019cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:58.700488 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a484047-4aca-48bc-8847-c91c0b019cf9 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:58.700583 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 190/380] 10.222.0.79 () {56 vars in 1376 bytes} [Thu Jul 14 11:54:58 2022] GET /identity/v3/role_assignments?group.id=8f4e7cbab47a4381beb52affbe2c232f&scope.project.id=3fccb5bf2b21430990bb49d29dadf01f&role.id=eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 260 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:58.701972 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 191/381] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:54:58.708558 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b6ac7-e62e-47d1-8882-d633257c51fe None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:58.709284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b6ac7-e62e-47d1-8882-d633257c51fe None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:58.709765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b6ac7-e62e-47d1-8882-d633257c51fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:58.735424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-291b6ac7-e62e-47d1-8882-d633257c51fe None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:58.742717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-291b6ac7-e62e-47d1-8882-d633257c51fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:58.759501 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:58.823154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 191/382] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:58.846833 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a484047-4aca-48bc-8847-c91c0b019cf9 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:58.962748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a484047-4aca-48bc-8847-c91c0b019cf9 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:59.012751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6757491-861e-4d0c-8d16-df7285e20322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:59.013569 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6757491-861e-4d0c-8d16-df7285e20322 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:59.013901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6757491-861e-4d0c-8d16-df7285e20322 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:59.014177 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6757491-861e-4d0c-8d16-df7285e20322 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:59.030030 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6757491-861e-4d0c-8d16-df7285e20322 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:59.038612 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-b6757491-861e-4d0c-8d16-df7285e20322 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:54:59.038612 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:59.038612 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:59.038612 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:59.038612 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:59.038612 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:59.038612 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:59.038612 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:59.038612 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:59.038612 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:59.038612 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:59.038612 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:59.038612 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:59.038612 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:59.038612 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:59.038612 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:59.039544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:59.039544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:59.039544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:59.039544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:59.039544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:59.039544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:59.039544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:59.039544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:59.039544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:59.039544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:59.039544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:59.039544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:59.039544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:59.039544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:59.039544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:59.039544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:59.040319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:59.040319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:59.040319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:59.040319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:59.040319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:59.040319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:59.040319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:59.040319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:59.040319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:59.040319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:59.040319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:54:59.040319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:54:59.040319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 192/383] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Jul 14 11:54:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:54:59.046670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b6ac7-e62e-47d1-8882-d633257c51fe None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:59.146358 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807ba2d-9a2e-44e2-bc8f-ed90cebe420a None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:59.146684 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807ba2d-9a2e-44e2-bc8f-ed90cebe420a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:59.146868 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807ba2d-9a2e-44e2-bc8f-ed90cebe420a None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:59.148241 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 193/384] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:54:59.154171 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cb00e-8930-463e-882f-0f48e0d677b2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:59.154450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cb00e-8930-463e-882f-0f48e0d677b2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:59.154769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cb00e-8930-463e-882f-0f48e0d677b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:59.164044 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b6ac7-e62e-47d1-8882-d633257c51fe None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:59.175887 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-366cb00e-8930-463e-882f-0f48e0d677b2 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:54:59.178024 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-366cb00e-8930-463e-882f-0f48e0d677b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:54:59.207379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c26f73-9641-420f-86fe-4bb6791dbaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:59.208437 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c26f73-9641-420f-86fe-4bb6791dbaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:59.208797 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c26f73-9641-420f-86fe-4bb6791dbaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:59.209305 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c26f73-9641-420f-86fe-4bb6791dbaf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:59.210511 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c26f73-9641-420f-86fe-4bb6791dbaf9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:59.211142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c26f73-9641-420f-86fe-4bb6791dbaf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:59.213029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c26f73-9641-420f-86fe-4bb6791dbaf9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:59.224591 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 192/385] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:54:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:59.231543 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c26f73-9641-420f-86fe-4bb6791dbaf9 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:59.251114 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:59.251608 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:59.282663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 194/386] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:54:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:54:59.309074 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366cb00e-8930-463e-882f-0f48e0d677b2 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:59.405624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c26f73-9641-420f-86fe-4bb6791dbaf9 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:59.479796 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb138e-bff5-488b-b39d-80790146fae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:59.480679 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb138e-bff5-488b-b39d-80790146fae7 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:59.480966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb138e-bff5-488b-b39d-80790146fae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:59.481246 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb138e-bff5-488b-b39d-80790146fae7 None admin] PATH_INFO: `/v3/groups/f5ade39976cf461283cc28b9dddfaef1` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:59.483901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366cb00e-8930-463e-882f-0f48e0d677b2 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:59.487310 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb138e-bff5-488b-b39d-80790146fae7 None admin] RBAC: Authorizing `identity:get_group(group_id=f5ade39976cf461283cc28b9dddfaef1)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:59.488843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb138e-bff5-488b-b39d-80790146fae7 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:59.490860 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 193/387] 10.222.0.79 () {56 vars in 1180 bytes} [Thu Jul 14 11:54:59 2022] GET /identity/v3/groups/f5ade39976cf461283cc28b9dddfaef1 => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:59.516795 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb138e-bff5-488b-b39d-80790146fae7 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:59.526568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fe2d4-adc6-4601-af09-803a83e0c4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:59.527925 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fe2d4-adc6-4601-af09-803a83e0c4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:59.528210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fe2d4-adc6-4601-af09-803a83e0c4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:59.528486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fe2d4-adc6-4601-af09-803a83e0c4c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:59.541310 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6fe2d4-adc6-4601-af09-803a83e0c4c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:54:59.550924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-8f6fe2d4-adc6-4601-af09-803a83e0c4c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:59.550924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:54:59.550924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:54:59.550924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:54:59.550924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:54:59.550924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:54:59.550924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:54:59.550924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:54:59.550924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:54:59.550924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:54:59.550924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:54:59.550924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:54:59.550924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:54:59.550924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:54:59.550924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:54:59.550924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:54:59.551807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:54:59.551807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:54:59.551807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:54:59.551807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:54:59.551807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:54:59.551807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:54:59.551807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:54:59.551807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:54:59.551807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:54:59.551807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:54:59.551807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:54:59.551807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:54:59.551807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:54:59.551807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:54:59.551807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:54:59.551807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:54:59.552867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:54:59.552867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:54:59.552867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:54:59.552867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:54:59.552867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:54:59.552867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:54:59.552867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:54:59.552867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:54:59.552867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:54:59.552867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:54:59.552867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:54:59.552867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:54:59.552867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 195/388] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:54:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:54:59.558921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fe2d4-adc6-4601-af09-803a83e0c4c8 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:59.608814 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:59.680575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fe2d4-adc6-4601-af09-803a83e0c4c8 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:59.702888 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:59.720966 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9214fab-5274-45dc-b50a-cfea60cf968c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:59.721866 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9214fab-5274-45dc-b50a-cfea60cf968c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:59.722347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9214fab-5274-45dc-b50a-cfea60cf968c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:59.722788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9214fab-5274-45dc-b50a-cfea60cf968c None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:59.723550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9214fab-5274-45dc-b50a-cfea60cf968c None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:54:59.723859 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9214fab-5274-45dc-b50a-cfea60cf968c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:59.725246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9214fab-5274-45dc-b50a-cfea60cf968c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:59.733558 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb138e-bff5-488b-b39d-80790146fae7 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:59.745546 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 196/389] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:54:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:59.750978 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9214fab-5274-45dc-b50a-cfea60cf968c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:59.788548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5900377-0916-4756-96d5-9e56655df8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:59.789423 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5900377-0916-4756-96d5-9e56655df8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:59.789715 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5900377-0916-4756-96d5-9e56655df8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:59.789997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5900377-0916-4756-96d5-9e56655df8f0 None admin] PATH_INFO: `/v3/projects/05ae476a690b4d899f0bd474f195f9ea` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:59.793790 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5900377-0916-4756-96d5-9e56655df8f0 None admin] RBAC: Authorizing `identity:get_project(project_id=05ae476a690b4d899f0bd474f195f9ea)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:59.795384 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5900377-0916-4756-96d5-9e56655df8f0 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:59.797451 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 194/390] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:59 2022] GET /identity/v3/projects/05ae476a690b4d899f0bd474f195f9ea => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:54:59.816605 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5900377-0916-4756-96d5-9e56655df8f0 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:59.864518 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9214fab-5274-45dc-b50a-cfea60cf968c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:54:59.867013 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:59.907325 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18214470-7987-4cd8-97f0-c90ff175b579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:54:59.908392 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18214470-7987-4cd8-97f0-c90ff175b579 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:54:59.908681 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18214470-7987-4cd8-97f0-c90ff175b579 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:54:59.909085 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18214470-7987-4cd8-97f0-c90ff175b579 None admin] PATH_INFO: `/v3/groups/f5ade39976cf461283cc28b9dddfaef1` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:54:59.910540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18214470-7987-4cd8-97f0-c90ff175b579 None admin] RBAC: Authorizing `identity:get_group(group_id=f5ade39976cf461283cc28b9dddfaef1)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:54:59.912235 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18214470-7987-4cd8-97f0-c90ff175b579 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:54:59.914235 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 197/391] 10.222.0.79 () {56 vars in 1180 bytes} [Thu Jul 14 11:54:59 2022] GET /identity/v3/groups/f5ade39976cf461283cc28b9dddfaef1 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:54:59.921094 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18214470-7987-4cd8-97f0-c90ff175b579 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:54:59.984320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5900377-0916-4756-96d5-9e56655df8f0 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:00.032206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18214470-7987-4cd8-97f0-c90ff175b579 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:00.032535 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd12522-243b-44ec-b149-b1762a824d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:00.033378 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd12522-243b-44ec-b149-b1762a824d7d None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:00.033668 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd12522-243b-44ec-b149-b1762a824d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:00.033951 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd12522-243b-44ec-b149-b1762a824d7d None admin] PATH_INFO: `/v3/projects/05ae476a690b4d899f0bd474f195f9ea/groups/f5ade39976cf461283cc28b9dddfaef1/roles/986e347cbb9e43e7a49dfef9be8ec9dd` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:00.040434 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd12522-243b-44ec-b149-b1762a824d7d None admin] RBAC: Authorizing `identity:create_grant(project_id=05ae476a690b4d899f0bd474f195f9ea, group_id=f5ade39976cf461283cc28b9dddfaef1, role_id=986e347cbb9e43e7a49dfef9be8ec9dd)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:00.041911 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd12522-243b-44ec-b149-b1762a824d7d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:00.069082 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 195/392] 10.222.0.79 () {58 vars in 1442 bytes} [Thu Jul 14 11:54:59 2022] PUT /identity/v3/projects/05ae476a690b4d899f0bd474f195f9ea/groups/f5ade39976cf461283cc28b9dddfaef1/roles/986e347cbb9e43e7a49dfef9be8ec9dd => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:55:00.070688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93233367-8bbd-41c8-ba62-d8454c092ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:00.071764 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93233367-8bbd-41c8-ba62-d8454c092ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:00.072189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93233367-8bbd-41c8-ba62-d8454c092ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:00.072602 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93233367-8bbd-41c8-ba62-d8454c092ea3 None admin] PATH_INFO: `/v3/projects/05ae476a690b4d899f0bd474f195f9ea` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:00.080233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93233367-8bbd-41c8-ba62-d8454c092ea3 None admin] RBAC: Authorizing `identity:get_project(project_id=05ae476a690b4d899f0bd474f195f9ea)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:00.082178 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93233367-8bbd-41c8-ba62-d8454c092ea3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:00.084474 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 198/393] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:54:59 2022] GET /identity/v3/projects/05ae476a690b4d899f0bd474f195f9ea => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:55:00.091018 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd12522-243b-44ec-b149-b1762a824d7d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:00.114903 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:00.243366 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd12522-243b-44ec-b149-b1762a824d7d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:00.282316 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e7a5c-e7b8-4b72-bfc4-73218f53f61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:00.283234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e7a5c-e7b8-4b72-bfc4-73218f53f61a None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:00.283524 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e7a5c-e7b8-4b72-bfc4-73218f53f61a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:00.283805 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e7a5c-e7b8-4b72-bfc4-73218f53f61a None admin] PATH_INFO: `/v3/projects/05ae476a690b4d899f0bd474f195f9ea/groups/f5ade39976cf461283cc28b9dddfaef1/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:00.285777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e7a5c-e7b8-4b72-bfc4-73218f53f61a None admin] RBAC: Authorizing `identity:create_grant(project_id=05ae476a690b4d899f0bd474f195f9ea, group_id=f5ade39976cf461283cc28b9dddfaef1, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:00.287289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e7a5c-e7b8-4b72-bfc4-73218f53f61a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:00.308819 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 196/394] 10.222.0.79 () {58 vars in 1442 bytes} [Thu Jul 14 11:55:00 2022] PUT /identity/v3/projects/05ae476a690b4d899f0bd474f195f9ea/groups/f5ade39976cf461283cc28b9dddfaef1/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:55:00.531340 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7c49c-a66a-4f2a-974e-121679962ec8 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:00.531991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7c49c-a66a-4f2a-974e-121679962ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:00.532475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7c49c-a66a-4f2a-974e-121679962ec8 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:00.534338 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 199/395] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:00.539566 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bc9f1-644e-428f-8947-3c70f1be64dc None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:00.540187 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bc9f1-644e-428f-8947-3c70f1be64dc None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:00.540678 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bc9f1-644e-428f-8947-3c70f1be64dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:00.560153 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-4e8bc9f1-644e-428f-8947-3c70f1be64dc None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:00.561681 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-4e8bc9f1-644e-428f-8947-3c70f1be64dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:00.624871 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:00.632570 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 197/396] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:00.659103 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7c49c-a66a-4f2a-974e-121679962ec8 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:00.714769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:00.799343 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7c49c-a66a-4f2a-974e-121679962ec8 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:00.839150 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67eafb4-05ce-4d93-8f71-31e0a805648d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:00.840006 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67eafb4-05ce-4d93-8f71-31e0a805648d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:00.840298 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67eafb4-05ce-4d93-8f71-31e0a805648d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:00.840572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67eafb4-05ce-4d93-8f71-31e0a805648d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:00.851997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67eafb4-05ce-4d93-8f71-31e0a805648d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:00.859955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-d67eafb4-05ce-4d93-8f71-31e0a805648d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:55:00.859955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:00.859955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:00.859955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:00.859955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:00.859955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:00.859955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:00.859955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:00.859955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:00.859955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:00.859955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:00.859955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:00.859955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:00.859955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:00.859955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:00.859955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:00.860821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:00.860821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:00.860821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:00.860821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:00.860821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:00.860821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:00.860821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:00.860821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:00.860821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:00.860821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:00.860821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:00.860821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:00.860821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:00.860821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:00.860821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:00.860821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:00.861622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:00.861622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:00.861622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:00.861622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:00.861622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:00.861622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:00.861622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:00.861622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:00.861622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:00.861622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:00.861622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:55:00.861622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:00.861622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 200/397] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:55:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:00.867420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8bc9f1-644e-428f-8947-3c70f1be64dc None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:00.973411 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8bc9f1-644e-428f-8947-3c70f1be64dc None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:01.008823 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51056067-fbbc-4425-b69e-2a7d2a9c8e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:01.009495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51056067-fbbc-4425-b69e-2a7d2a9c8e7c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:01.009778 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51056067-fbbc-4425-b69e-2a7d2a9c8e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:01.010055 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51056067-fbbc-4425-b69e-2a7d2a9c8e7c None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:01.010834 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51056067-fbbc-4425-b69e-2a7d2a9c8e7c None admin] RBAC: Adding query filter params (name=member) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:01.011684 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51056067-fbbc-4425-b69e-2a7d2a9c8e7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:01.013075 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51056067-fbbc-4425-b69e-2a7d2a9c8e7c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:01.021932 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 198/398] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:55:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:55:01.027503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67eafb4-05ce-4d93-8f71-31e0a805648d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:01.178771 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:01.181966 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67eafb4-05ce-4d93-8f71-31e0a805648d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:01.236942 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8652fb5-1bf0-4623-ba45-5e6fc45be3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:01.237885 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8652fb5-1bf0-4623-ba45-5e6fc45be3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:01.238245 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8652fb5-1bf0-4623-ba45-5e6fc45be3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:01.238550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8652fb5-1bf0-4623-ba45-5e6fc45be3d4 None admin] PATH_INFO: `/v3/groups/f5ade39976cf461283cc28b9dddfaef1` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:01.243239 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8652fb5-1bf0-4623-ba45-5e6fc45be3d4 None admin] RBAC: Authorizing `identity:get_group(group_id=f5ade39976cf461283cc28b9dddfaef1)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:01.244713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8652fb5-1bf0-4623-ba45-5e6fc45be3d4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:01.247464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 201/399] 10.222.0.79 () {56 vars in 1180 bytes} [Thu Jul 14 11:55:01 2022] GET /identity/v3/groups/f5ade39976cf461283cc28b9dddfaef1 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:01.252724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51056067-fbbc-4425-b69e-2a7d2a9c8e7c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:01.337338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:01.381983 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51056067-fbbc-4425-b69e-2a7d2a9c8e7c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:01.407389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f3b01-02c6-4109-a23d-27706102de68 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:01.407808 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f3b01-02c6-4109-a23d-27706102de68 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:01.408162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f3b01-02c6-4109-a23d-27706102de68 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:01.409605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 202/400] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:01.414901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7505ee2-1643-43a7-9ca4-658e4e0058c7 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:01.415189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7505ee2-1643-43a7-9ca4-658e4e0058c7 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:01.415468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7505ee2-1643-43a7-9ca4-658e4e0058c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:01.434829 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621827a8-45bb-4777-9d07-f05a1b5dff64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:01.435627 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621827a8-45bb-4777-9d07-f05a1b5dff64 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:01.435912 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621827a8-45bb-4777-9d07-f05a1b5dff64 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:01.436190 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621827a8-45bb-4777-9d07-f05a1b5dff64 None admin] PATH_INFO: `/v3/projects/bf999b1796e2439bb0a35f1812856355` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:01.440181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621827a8-45bb-4777-9d07-f05a1b5dff64 None admin] RBAC: Authorizing `identity:get_project(project_id=bf999b1796e2439bb0a35f1812856355)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:01.441661 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621827a8-45bb-4777-9d07-f05a1b5dff64 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:01.444476 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-b7505ee2-1643-43a7-9ca4-658e4e0058c7 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:01.445708 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b7505ee2-1643-43a7-9ca4-658e4e0058c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:01.447964 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 199/401] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:55:01 2022] GET /identity/v3/projects/bf999b1796e2439bb0a35f1812856355 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:01.450398 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621827a8-45bb-4777-9d07-f05a1b5dff64 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:01.578027 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 203/402] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:55:01.619885 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7505ee2-1643-43a7-9ca4-658e4e0058c7 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:01.640151 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621827a8-45bb-4777-9d07-f05a1b5dff64 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:01.689006 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:01.704090 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec9879-f24a-4973-a76c-6ed06cb38dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:01.704981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec9879-f24a-4973-a76c-6ed06cb38dae None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:01.705265 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec9879-f24a-4973-a76c-6ed06cb38dae None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:01.705542 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec9879-f24a-4973-a76c-6ed06cb38dae None admin] PATH_INFO: `/v3/projects/bf999b1796e2439bb0a35f1812856355/groups/f5ade39976cf461283cc28b9dddfaef1/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:01.707693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec9879-f24a-4973-a76c-6ed06cb38dae None admin] RBAC: Authorizing `identity:create_grant(project_id=bf999b1796e2439bb0a35f1812856355, group_id=f5ade39976cf461283cc28b9dddfaef1, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:01.709153 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec9879-f24a-4973-a76c-6ed06cb38dae None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:01.729657 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 200/403] 10.222.0.79 () {58 vars in 1442 bytes} [Thu Jul 14 11:55:01 2022] PUT /identity/v3/projects/bf999b1796e2439bb0a35f1812856355/groups/f5ade39976cf461283cc28b9dddfaef1/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:55:01.746725 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404056f-40f4-41b5-9327-735fb80fd707 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:01.747054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404056f-40f4-41b5-9327-735fb80fd707 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:01.747316 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404056f-40f4-41b5-9327-735fb80fd707 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:01.752771 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 201/404] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:55:01.755018 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6a806-cebe-45ee-a3b6-092759143f2a None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:01.755314 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6a806-cebe-45ee-a3b6-092759143f2a None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:01.755596 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6a806-cebe-45ee-a3b6-092759143f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:01.787567 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-a6c6a806-cebe-45ee-a3b6-092759143f2a None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:01.788838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a6c6a806-cebe-45ee-a3b6-092759143f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:01.826885 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:01.831146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7505ee2-1643-43a7-9ca4-658e4e0058c7 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:01.874506 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa289c0-3ec8-4445-8c5d-79dd78057b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:01.875399 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa289c0-3ec8-4445-8c5d-79dd78057b8f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:01.875685 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa289c0-3ec8-4445-8c5d-79dd78057b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:01.875968 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa289c0-3ec8-4445-8c5d-79dd78057b8f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:01.890178 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa289c0-3ec8-4445-8c5d-79dd78057b8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:01.901379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-ffa289c0-3ec8-4445-8c5d-79dd78057b8f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:55:01.901379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:01.901379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:01.901379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:01.901379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:01.901379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:01.901379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:01.901379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:01.901379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:01.901379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:01.901379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:01.901379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:01.901379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:01.901379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:01.901379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:01.901379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:01.903001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:01.903001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:01.903001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:01.903001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:01.903001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:01.903001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:01.903001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:01.903001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:01.903001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:01.903001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:01.903001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:01.903001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:01.903001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:01.903001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:01.903001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:01.903001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:01.903779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:01.903779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:01.903779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:01.903779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:01.903779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:01.903779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:01.903779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:01.903779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:01.903779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:01.903779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:01.903779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:55:01.903779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:01.903779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 204/405] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Jul 14 11:55:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:55:01.909639 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa289c0-3ec8-4445-8c5d-79dd78057b8f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:01.960034 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 202/406] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:55:01.998131 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6a806-cebe-45ee-a3b6-092759143f2a None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:02.047517 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa289c0-3ec8-4445-8c5d-79dd78057b8f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:02.091213 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01d0ba-54e9-43a1-8316-a4302ebbd8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:02.092446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01d0ba-54e9-43a1-8316-a4302ebbd8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:02.092446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01d0ba-54e9-43a1-8316-a4302ebbd8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:02.092446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01d0ba-54e9-43a1-8316-a4302ebbd8d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:02.093162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01d0ba-54e9-43a1-8316-a4302ebbd8d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:02.093469 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01d0ba-54e9-43a1-8316-a4302ebbd8d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:02.094860 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01d0ba-54e9-43a1-8316-a4302ebbd8d7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:02.103778 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 205/407] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:55:02.109713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01d0ba-54e9-43a1-8316-a4302ebbd8d7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:02.125679 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6a806-cebe-45ee-a3b6-092759143f2a None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:02.147001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:02.167987 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:02.175189 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca868b-f952-4f4e-9d51-6afdefbef160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:02.176239 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca868b-f952-4f4e-9d51-6afdefbef160 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:02.176810 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca868b-f952-4f4e-9d51-6afdefbef160 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:02.178144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca868b-f952-4f4e-9d51-6afdefbef160 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:02.203118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca868b-f952-4f4e-9d51-6afdefbef160 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:02.211098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-d7ca868b-f952-4f4e-9d51-6afdefbef160 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:55:02.211098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:02.211098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:02.211098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:02.211098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:02.211098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:02.211098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:02.211098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:02.211098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:02.211098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:02.211098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:02.211098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:02.211098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:02.211098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:02.211098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:02.211098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:02.212158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:02.212158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:02.212158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:02.212158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:02.212158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:02.212158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:02.212158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:02.212158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:02.212158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:02.212158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:02.212158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:02.212158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:02.212158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:02.212158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:02.212158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:02.212158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:02.213126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:02.213126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:02.213126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:02.213126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:02.213126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:02.213126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:02.213126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:02.213126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:02.213126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:02.213126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:02.213126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:55:02.213126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:02.226524 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 203/408] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:55:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:02.228983 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca868b-f952-4f4e-9d51-6afdefbef160 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:02.361532 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca868b-f952-4f4e-9d51-6afdefbef160 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:02.368966 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01d0ba-54e9-43a1-8316-a4302ebbd8d7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:02.402684 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1d69a-575c-4f73-9533-c6b129c2f314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:02.403378 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1d69a-575c-4f73-9533-c6b129c2f314 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:02.403913 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1d69a-575c-4f73-9533-c6b129c2f314 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:02.404030 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1d69a-575c-4f73-9533-c6b129c2f314 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:02.404792 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1d69a-575c-4f73-9533-c6b129c2f314 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:02.405115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1d69a-575c-4f73-9533-c6b129c2f314 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:02.406529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1d69a-575c-4f73-9533-c6b129c2f314 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:02.409200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5664b1-d11b-471e-a1db-696ab06bd57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:02.410233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5664b1-d11b-471e-a1db-696ab06bd57d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:02.410688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5664b1-d11b-471e-a1db-696ab06bd57d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:02.411134 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5664b1-d11b-471e-a1db-696ab06bd57d None admin] PATH_INFO: `/v3/groups/f5ade39976cf461283cc28b9dddfaef1` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:02.412491 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5664b1-d11b-471e-a1db-696ab06bd57d None admin] RBAC: Authorizing `identity:get_group(group_id=f5ade39976cf461283cc28b9dddfaef1)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:02.419992 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5664b1-d11b-471e-a1db-696ab06bd57d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:02.420154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 204/409] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:55:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:02.420814 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 206/410] 10.222.0.79 () {56 vars in 1180 bytes} [Thu Jul 14 11:55:02 2022] GET /identity/v3/groups/f5ade39976cf461283cc28b9dddfaef1 => generated 226 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:02.421759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1d69a-575c-4f73-9533-c6b129c2f314 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:02.427824 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5664b1-d11b-471e-a1db-696ab06bd57d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:02.506601 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:02.527814 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:02.553791 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5664b1-d11b-471e-a1db-696ab06bd57d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:02.619170 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1d69a-575c-4f73-9533-c6b129c2f314 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:02.645287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054cae0-6830-4b5f-9343-08e7d933205e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:02.646165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054cae0-6830-4b5f-9343-08e7d933205e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:02.646454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054cae0-6830-4b5f-9343-08e7d933205e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:02.646767 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054cae0-6830-4b5f-9343-08e7d933205e None admin] PATH_INFO: `/v3/projects/bf999b1796e2439bb0a35f1812856355` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:02.651233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054cae0-6830-4b5f-9343-08e7d933205e None admin] RBAC: Authorizing `identity:get_project(project_id=bf999b1796e2439bb0a35f1812856355)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:02.652779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054cae0-6830-4b5f-9343-08e7d933205e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:02.654751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 207/411] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:55:02 2022] GET /identity/v3/projects/bf999b1796e2439bb0a35f1812856355 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:02.660131 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054cae0-6830-4b5f-9343-08e7d933205e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:02.662131 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2c081-22ad-4d9b-a194-d82ca0a2f6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:02.663038 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2c081-22ad-4d9b-a194-d82ca0a2f6d8 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:02.663328 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2c081-22ad-4d9b-a194-d82ca0a2f6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:02.663608 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2c081-22ad-4d9b-a194-d82ca0a2f6d8 None admin] PATH_INFO: `/v3/groups/8f4e7cbab47a4381beb52affbe2c232f` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:02.667789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2c081-22ad-4d9b-a194-d82ca0a2f6d8 None admin] RBAC: Authorizing `identity:get_group(group_id=8f4e7cbab47a4381beb52affbe2c232f)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:02.669818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2c081-22ad-4d9b-a194-d82ca0a2f6d8 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:02.671877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 205/412] 10.222.0.79 () {56 vars in 1180 bytes} [Thu Jul 14 11:55:02 2022] GET /identity/v3/groups/8f4e7cbab47a4381beb52affbe2c232f => generated 229 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:55:02.679206 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2c081-22ad-4d9b-a194-d82ca0a2f6d8 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:02.768922 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054cae0-6830-4b5f-9343-08e7d933205e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:02.806838 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca63adc-5eaa-4ec7-b7f9-f22ccd6e7fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:02.808584 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca63adc-5eaa-4ec7-b7f9-f22ccd6e7fe2 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:02.808880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca63adc-5eaa-4ec7-b7f9-f22ccd6e7fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:02.809307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca63adc-5eaa-4ec7-b7f9-f22ccd6e7fe2 None admin] PATH_INFO: `/v3/projects/bf999b1796e2439bb0a35f1812856355/groups/f5ade39976cf461283cc28b9dddfaef1/roles/986e347cbb9e43e7a49dfef9be8ec9dd` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:02.811652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca63adc-5eaa-4ec7-b7f9-f22ccd6e7fe2 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf999b1796e2439bb0a35f1812856355, group_id=f5ade39976cf461283cc28b9dddfaef1, role_id=986e347cbb9e43e7a49dfef9be8ec9dd)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:02.813102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca63adc-5eaa-4ec7-b7f9-f22ccd6e7fe2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:02.829925 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 208/413] 10.222.0.79 () {58 vars in 1442 bytes} [Thu Jul 14 11:55:02 2022] PUT /identity/v3/projects/bf999b1796e2439bb0a35f1812856355/groups/f5ade39976cf461283cc28b9dddfaef1/roles/986e347cbb9e43e7a49dfef9be8ec9dd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:55:02.935849 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7fd07-03a9-48d1-894e-655146739136 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:02.936190 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7fd07-03a9-48d1-894e-655146739136 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:02.936423 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7fd07-03a9-48d1-894e-655146739136 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:02.938307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 209/414] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:55:02.944020 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f470ba-1490-4a71-bdab-d111bd315849 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:02.944611 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f470ba-1490-4a71-bdab-d111bd315849 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:02.945087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f470ba-1490-4a71-bdab-d111bd315849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:02.958624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2c081-22ad-4d9b-a194-d82ca0a2f6d8 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:02.963077 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-92f470ba-1490-4a71-bdab-d111bd315849 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:02.965138 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-92f470ba-1490-4a71-bdab-d111bd315849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:02.968889 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:02.990914 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:03.032239 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b9958-1fce-49be-8458-1d202a81b25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:03.033457 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b9958-1fce-49be-8458-1d202a81b25a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:03.033946 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b9958-1fce-49be-8458-1d202a81b25a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:03.034924 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b9958-1fce-49be-8458-1d202a81b25a None admin] PATH_INFO: `/v3/projects/3fccb5bf2b21430990bb49d29dadf01f` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:03.036392 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b9958-1fce-49be-8458-1d202a81b25a None admin] RBAC: Authorizing `identity:get_project(project_id=3fccb5bf2b21430990bb49d29dadf01f)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:03.038724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b9958-1fce-49be-8458-1d202a81b25a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:03.046526 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 206/415] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:55:02 2022] GET /identity/v3/projects/3fccb5bf2b21430990bb49d29dadf01f => generated 344 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:55:03.049105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b9958-1fce-49be-8458-1d202a81b25a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:03.086658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 210/416] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:55:03.092951 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2427784-8171-41d9-90ed-337ab2753b1d None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:03.093695 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2427784-8171-41d9-90ed-337ab2753b1d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:03.094136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2427784-8171-41d9-90ed-337ab2753b1d None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:03.099513 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 211/417] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:03.101293 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c243bf2-be1b-4ed1-9b80-b65193878164 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:03.101903 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c243bf2-be1b-4ed1-9b80-b65193878164 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:03.102333 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c243bf2-be1b-4ed1-9b80-b65193878164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:03.123968 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3c243bf2-be1b-4ed1-9b80-b65193878164 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:03.125461 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3c243bf2-be1b-4ed1-9b80-b65193878164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:03.197533 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b9958-1fce-49be-8458-1d202a81b25a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:03.209176 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 212/418] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:03.210424 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c243bf2-be1b-4ed1-9b80-b65193878164 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:03.235777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc7ece-1ce5-43ed-9e4f-39bcc8dfe5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:03.236972 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc7ece-1ce5-43ed-9e4f-39bcc8dfe5b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:03.237422 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc7ece-1ce5-43ed-9e4f-39bcc8dfe5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:03.237843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc7ece-1ce5-43ed-9e4f-39bcc8dfe5b1 None admin] PATH_INFO: `/v3/projects/3fccb5bf2b21430990bb49d29dadf01f/groups/8f4e7cbab47a4381beb52affbe2c232f/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:03.240465 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc7ece-1ce5-43ed-9e4f-39bcc8dfe5b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fccb5bf2b21430990bb49d29dadf01f, group_id=8f4e7cbab47a4381beb52affbe2c232f, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:03.242127 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc7ece-1ce5-43ed-9e4f-39bcc8dfe5b1 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:03.262736 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 207/419] 10.222.0.79 () {58 vars in 1442 bytes} [Thu Jul 14 11:55:03 2022] PUT /identity/v3/projects/3fccb5bf2b21430990bb49d29dadf01f/groups/8f4e7cbab47a4381beb52affbe2c232f/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:55:03.264062 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc7ece-1ce5-43ed-9e4f-39bcc8dfe5b1 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:03.339164 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:03.341930 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:03.395309 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c243bf2-be1b-4ed1-9b80-b65193878164 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:03.463080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d4f72-2d3c-4ab2-9a9e-2d0e59576bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:03.463906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d4f72-2d3c-4ab2-9a9e-2d0e59576bfb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:03.464738 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d4f72-2d3c-4ab2-9a9e-2d0e59576bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:03.465018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d4f72-2d3c-4ab2-9a9e-2d0e59576bfb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:03.476751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d4f72-2d3c-4ab2-9a9e-2d0e59576bfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:03.482276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc7ece-1ce5-43ed-9e4f-39bcc8dfe5b1 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:03.486273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-9b2d4f72-2d3c-4ab2-9a9e-2d0e59576bfb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:55:03.486273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:03.486273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:03.486273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:03.486273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:03.486273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:03.486273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:03.486273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:03.486273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:03.486273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:03.486273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:03.486273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:03.486273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:03.486273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:03.486273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:03.486273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:03.487229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:03.487229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:03.487229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:03.487229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:03.487229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:03.487229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:03.487229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:03.487229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:03.487229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:03.487229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:03.487229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:03.487229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:03.487229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:03.487229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:03.487229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:03.487229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:03.488720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:03.488720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:03.488720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:03.488720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:03.488720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:03.488720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:03.488720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:03.488720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:03.488720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:03.488720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:03.488720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:55:03.488720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:03.488720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 213/420] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Jul 14 11:55:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:03.493242 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d4f72-2d3c-4ab2-9a9e-2d0e59576bfb None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:03.527005 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198dbce-e041-4ac2-b530-12f8b728b9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:03.528845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198dbce-e041-4ac2-b530-12f8b728b9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:03.529584 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198dbce-e041-4ac2-b530-12f8b728b9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:03.530063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198dbce-e041-4ac2-b530-12f8b728b9f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:03.545714 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198dbce-e041-4ac2-b530-12f8b728b9f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:03.553785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-1198dbce-e041-4ac2-b530-12f8b728b9f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:55:03.553785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:03.553785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:03.553785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:03.553785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:03.553785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:03.553785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:03.553785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:03.553785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:03.553785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:03.553785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:03.553785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:03.553785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:03.553785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:03.553785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:03.553785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:03.554767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:03.554767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:03.554767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:03.554767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:03.554767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:03.554767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:03.554767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:03.554767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:03.554767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:03.554767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:03.554767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:03.554767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:03.554767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:03.554767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:03.554767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:03.554767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:03.556027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:03.556027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:03.556027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:03.556027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:03.556027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:03.556027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:03.556027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:03.556027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:03.556027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:03.556027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:03.556027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:55:03.556027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:03.556027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 208/421] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:55:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:55:03.562281 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198dbce-e041-4ac2-b530-12f8b728b9f9 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:03.642072 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d4f72-2d3c-4ab2-9a9e-2d0e59576bfb None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:03.712997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4e82c-70c6-4f99-8f4e-18a511c1e6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:03.714981 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4e82c-70c6-4f99-8f4e-18a511c1e6ff None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:03.715656 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4e82c-70c6-4f99-8f4e-18a511c1e6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:03.717302 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4e82c-70c6-4f99-8f4e-18a511c1e6ff None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:03.718310 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4e82c-70c6-4f99-8f4e-18a511c1e6ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:03.719042 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4e82c-70c6-4f99-8f4e-18a511c1e6ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:03.721356 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4e82c-70c6-4f99-8f4e-18a511c1e6ff None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:03.727296 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:03.745865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:03.752942 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 214/422] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:55:03.755318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4e82c-70c6-4f99-8f4e-18a511c1e6ff None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:03.759757 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198dbce-e041-4ac2-b530-12f8b728b9f9 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:03.832999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b4327-ca2c-4322-bfd9-a1639130f527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:03.833712 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b4327-ca2c-4322-bfd9-a1639130f527 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:03.834009 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b4327-ca2c-4322-bfd9-a1639130f527 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:03.834276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b4327-ca2c-4322-bfd9-a1639130f527 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:03.835071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b4327-ca2c-4322-bfd9-a1639130f527 None admin] RBAC: Adding query filter params (name=member) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:03.835387 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b4327-ca2c-4322-bfd9-a1639130f527 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:03.836768 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b4327-ca2c-4322-bfd9-a1639130f527 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:03.845770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 209/423] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:55:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:03.850977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b4327-ca2c-4322-bfd9-a1639130f527 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:03.944624 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4e82c-70c6-4f99-8f4e-18a511c1e6ff None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:03.982698 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b4327-ca2c-4322-bfd9-a1639130f527 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:04.021740 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad426671-020d-4c21-88b7-742ae717d14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:04.023148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad426671-020d-4c21-88b7-742ae717d14a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:04.023662 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad426671-020d-4c21-88b7-742ae717d14a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:04.024140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad426671-020d-4c21-88b7-742ae717d14a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:04.054918 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:04.083287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99194c6c-a347-4ed4-994a-a55cb8819558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:04.083890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99194c6c-a347-4ed4-994a-a55cb8819558 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:04.084179 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99194c6c-a347-4ed4-994a-a55cb8819558 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:04.084458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99194c6c-a347-4ed4-994a-a55cb8819558 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:04.102186 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad426671-020d-4c21-88b7-742ae717d14a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:04.104225 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad426671-020d-4c21-88b7-742ae717d14a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:04.164328 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:04.171286 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99194c6c-a347-4ed4-994a-a55cb8819558 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:04.173149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99194c6c-a347-4ed4-994a-a55cb8819558 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:04.250446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 210/424] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:55:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:04.250446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664b385-d186-4147-8a72-b400f9a4d474 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:04.250446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664b385-d186-4147-8a72-b400f9a4d474 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:04.250446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664b385-d186-4147-8a72-b400f9a4d474 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:04.250446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 211/425] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:04.254534 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664b385-d186-4147-8a72-b400f9a4d474 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:04.292882 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 215/426] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:55:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:04.299225 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3ab67-5dc9-4186-827f-8ed3e909e619 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:04.299935 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3ab67-5dc9-4186-827f-8ed3e909e619 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:04.300715 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3ab67-5dc9-4186-827f-8ed3e909e619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:04.319251 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e7f3ab67-5dc9-4186-827f-8ed3e909e619 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:04.320737 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e7f3ab67-5dc9-4186-827f-8ed3e909e619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:04.331608 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:04.402480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 216/427] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:04.403662 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3ab67-5dc9-4186-827f-8ed3e909e619 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:04.406787 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664b385-d186-4147-8a72-b400f9a4d474 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:04.444067 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:04.458299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaddf46-839e-4901-bacf-583a67dd39ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:04.459198 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaddf46-839e-4901-bacf-583a67dd39ff None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:04.459488 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaddf46-839e-4901-bacf-583a67dd39ff None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:04.460218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaddf46-839e-4901-bacf-583a67dd39ff None admin] PATH_INFO: `/v3/projects/05ae476a690b4d899f0bd474f195f9ea` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:04.461432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaddf46-839e-4901-bacf-583a67dd39ff None admin] RBAC: Authorizing `identity:get_project(project_id=05ae476a690b4d899f0bd474f195f9ea)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:04.463283 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaddf46-839e-4901-bacf-583a67dd39ff None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:04.470696 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 212/428] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:55:04 2022] GET /identity/v3/projects/05ae476a690b4d899f0bd474f195f9ea => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:04.470696 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaddf46-839e-4901-bacf-583a67dd39ff None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:04.544441 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3ab67-5dc9-4186-827f-8ed3e909e619 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:04.581856 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaddf46-839e-4901-bacf-583a67dd39ff None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:04.590378 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a330d04-d934-47bb-a207-fa9956ed4a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:04.591284 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a330d04-d934-47bb-a207-fa9956ed4a55 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:04.591570 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a330d04-d934-47bb-a207-fa9956ed4a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:04.591847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a330d04-d934-47bb-a207-fa9956ed4a55 None admin] PATH_INFO: `/v3/projects/05ae476a690b4d899f0bd474f195f9ea` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:04.593537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a330d04-d934-47bb-a207-fa9956ed4a55 None admin] RBAC: Authorizing `identity:get_project(project_id=05ae476a690b4d899f0bd474f195f9ea)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:04.595424 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a330d04-d934-47bb-a207-fa9956ed4a55 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:04.602331 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 217/429] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:55:04 2022] GET /identity/v3/projects/05ae476a690b4d899f0bd474f195f9ea => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:04.602331 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a330d04-d934-47bb-a207-fa9956ed4a55 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:04.616976 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:04.631255 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b52a7a-7cde-4384-9ea4-b89402e4b575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:04.632380 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b52a7a-7cde-4384-9ea4-b89402e4b575 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:04.632838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b52a7a-7cde-4384-9ea4-b89402e4b575 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:04.633286 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b52a7a-7cde-4384-9ea4-b89402e4b575 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:04.647984 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b52a7a-7cde-4384-9ea4-b89402e4b575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:04.658957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-b1b52a7a-7cde-4384-9ea4-b89402e4b575 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:55:04.658957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:04.658957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:04.658957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:04.658957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:04.658957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:04.658957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:04.658957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:04.658957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:04.658957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:04.658957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:04.658957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:04.658957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:04.658957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:04.658957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:04.658957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:04.660091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:04.660091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:04.660091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:04.660091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:04.660091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:04.660091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:04.660091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:04.660091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:04.660091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:04.660091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:04.660091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:04.660091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:04.660091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:04.660091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:04.660091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:04.660091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:04.661047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:04.661047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:04.661047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:04.661047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:04.661047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:04.661047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:04.661047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:04.661047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:04.661047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:04.661047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:04.661047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:55:04.661047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:04.661992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 213/430] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:55:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:04.663493 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b52a7a-7cde-4384-9ea4-b89402e4b575 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:04.724418 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:04.736965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a330d04-d934-47bb-a207-fa9956ed4a55 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:04.784292 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50346e43-e9c1-4489-81df-fb9d201e5c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:04.785322 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50346e43-e9c1-4489-81df-fb9d201e5c91 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:04.785738 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50346e43-e9c1-4489-81df-fb9d201e5c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:04.786343 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50346e43-e9c1-4489-81df-fb9d201e5c91 None admin] PATH_INFO: `/v3/groups/f5ade39976cf461283cc28b9dddfaef1` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:04.788387 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50346e43-e9c1-4489-81df-fb9d201e5c91 None admin] RBAC: Authorizing `identity:get_group(group_id=f5ade39976cf461283cc28b9dddfaef1)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:04.789951 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50346e43-e9c1-4489-81df-fb9d201e5c91 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:04.790267 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b52a7a-7cde-4384-9ea4-b89402e4b575 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:04.796229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 218/431] 10.222.0.79 () {56 vars in 1180 bytes} [Thu Jul 14 11:55:04 2022] GET /identity/v3/groups/f5ade39976cf461283cc28b9dddfaef1 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:04.796229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50346e43-e9c1-4489-81df-fb9d201e5c91 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:04.843789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a59beb-3da2-4c6c-a873-3bef3c600aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:04.845069 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a59beb-3da2-4c6c-a873-3bef3c600aac None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:04.845765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a59beb-3da2-4c6c-a873-3bef3c600aac None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:04.846146 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a59beb-3da2-4c6c-a873-3bef3c600aac None admin] PATH_INFO: `/v3/groups/f5ade39976cf461283cc28b9dddfaef1` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:04.847719 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a59beb-3da2-4c6c-a873-3bef3c600aac None admin] RBAC: Authorizing `identity:get_group(group_id=f5ade39976cf461283cc28b9dddfaef1)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:04.849778 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a59beb-3da2-4c6c-a873-3bef3c600aac None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:04.857104 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 214/432] 10.222.0.79 () {56 vars in 1180 bytes} [Thu Jul 14 11:55:04 2022] GET /identity/v3/groups/f5ade39976cf461283cc28b9dddfaef1 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:04.857104 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a59beb-3da2-4c6c-a873-3bef3c600aac None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:04.908004 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50346e43-e9c1-4489-81df-fb9d201e5c91 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:04.915030 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:04.948211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5f73f-2516-41f9-b150-76e410cac6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:04.949402 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5f73f-2516-41f9-b150-76e410cac6ca None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:04.949889 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5f73f-2516-41f9-b150-76e410cac6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:04.950383 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5f73f-2516-41f9-b150-76e410cac6ca None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:04.951457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5f73f-2516-41f9-b150-76e410cac6ca None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:04.951981 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5f73f-2516-41f9-b150-76e410cac6ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:04.953591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5f73f-2516-41f9-b150-76e410cac6ca None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:04.963115 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 219/433] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:55:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:04.964595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5f73f-2516-41f9-b150-76e410cac6ca None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:04.967785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a59beb-3da2-4c6c-a873-3bef3c600aac None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:04.996352 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:05.006786 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913f5fe-9538-4632-81f9-4be0c8e2cff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:05.007476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913f5fe-9538-4632-81f9-4be0c8e2cff1 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:05.008541 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913f5fe-9538-4632-81f9-4be0c8e2cff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:05.008541 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913f5fe-9538-4632-81f9-4be0c8e2cff1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:05.008930 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913f5fe-9538-4632-81f9-4be0c8e2cff1 None admin] RBAC: Adding query filter params (group.id=f5ade39976cf461283cc28b9dddfaef1, role.id=9a3a3371dd4d4405b2e4604acc314d43, scope.project.id=05ae476a690b4d899f0bd474f195f9ea) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:05.009251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913f5fe-9538-4632-81f9-4be0c8e2cff1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:05.010718 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913f5fe-9538-4632-81f9-4be0c8e2cff1 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:05.017214 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 215/434] 10.222.0.79 () {56 vars in 1376 bytes} [Thu Jul 14 11:55:04 2022] GET /identity/v3/role_assignments?group.id=f5ade39976cf461283cc28b9dddfaef1&scope.project.id=05ae476a690b4d899f0bd474f195f9ea&role.id=9a3a3371dd4d4405b2e4604acc314d43 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:05.022879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913f5fe-9538-4632-81f9-4be0c8e2cff1 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:05.083016 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5f73f-2516-41f9-b150-76e410cac6ca None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:05.138472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96304fae-45da-46e3-803c-aeb4c0330f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:05.139191 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96304fae-45da-46e3-803c-aeb4c0330f87 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:05.139487 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96304fae-45da-46e3-803c-aeb4c0330f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:05.139775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96304fae-45da-46e3-803c-aeb4c0330f87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:05.140635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96304fae-45da-46e3-803c-aeb4c0330f87 None admin] RBAC: Adding query filter params (group.id=f5ade39976cf461283cc28b9dddfaef1, role.id=986e347cbb9e43e7a49dfef9be8ec9dd, scope.project.id=05ae476a690b4d899f0bd474f195f9ea) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:05.140955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96304fae-45da-46e3-803c-aeb4c0330f87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:05.142474 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96304fae-45da-46e3-803c-aeb4c0330f87 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:05.149511 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 220/435] 10.222.0.79 () {56 vars in 1376 bytes} [Thu Jul 14 11:55:04 2022] GET /identity/v3/role_assignments?group.id=f5ade39976cf461283cc28b9dddfaef1&scope.project.id=05ae476a690b4d899f0bd474f195f9ea&role.id=986e347cbb9e43e7a49dfef9be8ec9dd => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:05.150954 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31671e-6c7c-417d-978d-9081af1e04fc None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:05.151250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31671e-6c7c-417d-978d-9081af1e04fc None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:05.152256 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31671e-6c7c-417d-978d-9081af1e04fc None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:05.158119 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 221/436] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:05.159613 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def20aac-9b9d-4f63-86eb-d025c14f9b72 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:05.159912 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def20aac-9b9d-4f63-86eb-d025c14f9b72 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:05.160201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def20aac-9b9d-4f63-86eb-d025c14f9b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:05.205354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913f5fe-9538-4632-81f9-4be0c8e2cff1 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:05.224201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-def20aac-9b9d-4f63-86eb-d025c14f9b72 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:05.226411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-def20aac-9b9d-4f63-86eb-d025c14f9b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:05.249393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:05.294131 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6e92f-5e5d-4547-92bc-c1317b21b68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:05.295265 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6e92f-5e5d-4547-92bc-c1317b21b68e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:05.295825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6e92f-5e5d-4547-92bc-c1317b21b68e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:05.296332 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6e92f-5e5d-4547-92bc-c1317b21b68e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:05.367043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 222/437] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:05.384502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6e92f-5e5d-4547-92bc-c1317b21b68e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:05.386599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6e92f-5e5d-4547-92bc-c1317b21b68e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:05.410068 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def20aac-9b9d-4f63-86eb-d025c14f9b72 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:05.440100 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:05.548759 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def20aac-9b9d-4f63-86eb-d025c14f9b72 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:05.555502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 216/438] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:55:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:05.560785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6e92f-5e5d-4547-92bc-c1317b21b68e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:05.582956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:05.596494 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd63c5-fa39-44c5-9648-cf0fa0c2a793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:05.597415 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd63c5-fa39-44c5-9648-cf0fa0c2a793 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:05.597608 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd63c5-fa39-44c5-9648-cf0fa0c2a793 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:05.598235 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd63c5-fa39-44c5-9648-cf0fa0c2a793 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:05.617596 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd63c5-fa39-44c5-9648-cf0fa0c2a793 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:05.625852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-10cd63c5-fa39-44c5-9648-cf0fa0c2a793 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:55:05.625852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:05.625852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:05.625852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:05.625852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:05.625852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:05.625852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:05.625852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:05.625852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:05.625852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:05.625852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:05.625852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:05.625852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:05.625852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:05.625852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:05.625852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:05.626810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:05.626810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:05.626810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:05.626810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:05.626810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:05.626810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:05.626810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:05.626810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:05.626810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:05.626810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:05.626810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:05.626810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:05.626810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:05.626810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:05.626810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:05.626810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:05.628004 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:05.628004 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:05.628004 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:05.628004 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:05.628004 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:05.628004 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:05.628004 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:05.628004 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:05.628004 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:05.628004 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:05.628004 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:55:05.628004 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:05.628004 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 223/439] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Jul 14 11:55:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:55:05.628864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d9714-25ff-47b6-a7e5-3367266b9692 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:05.628955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d9714-25ff-47b6-a7e5-3367266b9692 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:05.629360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d9714-25ff-47b6-a7e5-3367266b9692 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:05.630699 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 224/440] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:05.635098 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d9714-25ff-47b6-a7e5-3367266b9692 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:05.684532 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6e92f-5e5d-4547-92bc-c1317b21b68e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:05.728006 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca955f2-8229-4c90-a750-2c5228db9802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:05.728919 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca955f2-8229-4c90-a750-2c5228db9802 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:05.730194 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca955f2-8229-4c90-a750-2c5228db9802 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:05.730194 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca955f2-8229-4c90-a750-2c5228db9802 None admin] PATH_INFO: `/v3/projects/bf999b1796e2439bb0a35f1812856355` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:05.730775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca955f2-8229-4c90-a750-2c5228db9802 None admin] RBAC: Authorizing `identity:get_project(project_id=bf999b1796e2439bb0a35f1812856355)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:05.732243 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca955f2-8229-4c90-a750-2c5228db9802 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:05.733972 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 217/441] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:55:05 2022] GET /identity/v3/projects/bf999b1796e2439bb0a35f1812856355 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:05.735182 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b0f4a-9711-416c-9bcb-0147a32e754e None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:05.735487 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b0f4a-9711-416c-9bcb-0147a32e754e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:05.735758 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b0f4a-9711-416c-9bcb-0147a32e754e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:05.738150 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:05.759112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-ae9b0f4a-9711-416c-9bcb-0147a32e754e None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:05.760332 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ae9b0f4a-9711-416c-9bcb-0147a32e754e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:05.770921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d9714-25ff-47b6-a7e5-3367266b9692 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:05.812487 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304027c8-9ad2-42e7-886b-93677819d765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:05.812487 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304027c8-9ad2-42e7-886b-93677819d765 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:05.812487 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304027c8-9ad2-42e7-886b-93677819d765 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:05.812487 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304027c8-9ad2-42e7-886b-93677819d765 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:05.813156 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304027c8-9ad2-42e7-886b-93677819d765 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:05.813937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304027c8-9ad2-42e7-886b-93677819d765 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:05.816445 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304027c8-9ad2-42e7-886b-93677819d765 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:05.825934 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 225/442] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:55:05.831255 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304027c8-9ad2-42e7-886b-93677819d765 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:05.843875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 218/443] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:05.844575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b0f4a-9711-416c-9bcb-0147a32e754e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:05.859423 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:05.936768 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304027c8-9ad2-42e7-886b-93677819d765 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:05.946709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b0f4a-9711-416c-9bcb-0147a32e754e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:05.970923 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183f9ef-c0bb-4b6e-93f8-927f9f74f132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:05.971771 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183f9ef-c0bb-4b6e-93f8-927f9f74f132 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:05.972054 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183f9ef-c0bb-4b6e-93f8-927f9f74f132 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:05.972329 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183f9ef-c0bb-4b6e-93f8-927f9f74f132 None admin] PATH_INFO: `/v3/groups/f5ade39976cf461283cc28b9dddfaef1` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:05.973501 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183f9ef-c0bb-4b6e-93f8-927f9f74f132 None admin] RBAC: Authorizing `identity:get_group(group_id=f5ade39976cf461283cc28b9dddfaef1)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:05.974968 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183f9ef-c0bb-4b6e-93f8-927f9f74f132 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:05.976582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 226/444] 10.222.0.79 () {56 vars in 1180 bytes} [Thu Jul 14 11:55:05 2022] GET /identity/v3/groups/f5ade39976cf461283cc28b9dddfaef1 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:05.977339 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183f9ef-c0bb-4b6e-93f8-927f9f74f132 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:05.981951 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf3869-cfed-4845-83ba-42b1c3410737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:05.982631 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf3869-cfed-4845-83ba-42b1c3410737 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:05.982920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf3869-cfed-4845-83ba-42b1c3410737 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:05.983198 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf3869-cfed-4845-83ba-42b1c3410737 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:05.989600 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:06.052236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf3869-cfed-4845-83ba-42b1c3410737 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:06.053711 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf3869-cfed-4845-83ba-42b1c3410737 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:06.069220 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:06.089791 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183f9ef-c0bb-4b6e-93f8-927f9f74f132 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:06.124811 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ba1fa-235c-4722-b0fc-4c0f753148e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:06.125605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ba1fa-235c-4722-b0fc-4c0f753148e7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:06.125885 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ba1fa-235c-4722-b0fc-4c0f753148e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:06.126159 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ba1fa-235c-4722-b0fc-4c0f753148e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:06.136449 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ba1fa-235c-4722-b0fc-4c0f753148e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:06.144090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-468ba1fa-235c-4722-b0fc-4c0f753148e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:55:06.144090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:06.144090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:06.144090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:06.144090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:06.144090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:06.144090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:06.144090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:06.144090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:06.144090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:06.144090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:06.144090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:06.144090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:06.144090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:06.144090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:06.144090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:06.145010 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:06.145010 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:06.145010 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:06.145010 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:06.145010 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:06.145010 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:06.145010 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:06.145010 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:06.145010 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:06.145010 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:06.145010 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:06.145010 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:06.145010 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:06.145010 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:06.145010 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:06.145010 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:06.151169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:06.151169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:06.151169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:06.151169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:06.151169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:06.151169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:06.151169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:06.151169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:06.151169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:06.151169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:06.151169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:55:06.151169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:06.151169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 227/445] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:55:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:06.151169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ba1fa-235c-4722-b0fc-4c0f753148e7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:06.157040 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 219/446] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:55:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:06.157725 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf3869-cfed-4845-83ba-42b1c3410737 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:06.217498 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:06.250187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ba1fa-235c-4722-b0fc-4c0f753148e7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:06.264879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf3869-cfed-4845-83ba-42b1c3410737 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:06.279276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:06.283701 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdff704-a2a4-4908-b990-4edf197570e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:06.284370 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdff704-a2a4-4908-b990-4edf197570e5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:06.284654 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdff704-a2a4-4908-b990-4edf197570e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:06.284929 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdff704-a2a4-4908-b990-4edf197570e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:06.285758 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdff704-a2a4-4908-b990-4edf197570e5 None admin] RBAC: Adding query filter params (group.id=f5ade39976cf461283cc28b9dddfaef1, role.id=9a3a3371dd4d4405b2e4604acc314d43, scope.project.id=bf999b1796e2439bb0a35f1812856355) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:06.286072 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdff704-a2a4-4908-b990-4edf197570e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:06.287574 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdff704-a2a4-4908-b990-4edf197570e5 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:06.294330 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 228/447] 10.222.0.79 () {56 vars in 1376 bytes} [Thu Jul 14 11:55:06 2022] GET /identity/v3/role_assignments?group.id=f5ade39976cf461283cc28b9dddfaef1&scope.project.id=bf999b1796e2439bb0a35f1812856355&role.id=9a3a3371dd4d4405b2e4604acc314d43 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:06.295299 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdff704-a2a4-4908-b990-4edf197570e5 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:06.315742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25632453-3398-4815-a9ac-9ba76f7e3f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:06.316613 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25632453-3398-4815-a9ac-9ba76f7e3f81 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:06.317275 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25632453-3398-4815-a9ac-9ba76f7e3f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:06.317851 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25632453-3398-4815-a9ac-9ba76f7e3f81 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:06.318736 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25632453-3398-4815-a9ac-9ba76f7e3f81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:06.318997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25632453-3398-4815-a9ac-9ba76f7e3f81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:06.321171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25632453-3398-4815-a9ac-9ba76f7e3f81 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:06.331186 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 220/448] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:55:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:06.337052 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25632453-3398-4815-a9ac-9ba76f7e3f81 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:06.424678 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdff704-a2a4-4908-b990-4edf197570e5 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:06.471754 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25632453-3398-4815-a9ac-9ba76f7e3f81 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:06.474315 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28364ca6-73dc-4345-ba0f-84b8807dd0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:06.475548 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28364ca6-73dc-4345-ba0f-84b8807dd0ab None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:06.475991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28364ca6-73dc-4345-ba0f-84b8807dd0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:06.476770 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28364ca6-73dc-4345-ba0f-84b8807dd0ab None admin] PATH_INFO: `/v3/projects/bf999b1796e2439bb0a35f1812856355` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:06.478276 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28364ca6-73dc-4345-ba0f-84b8807dd0ab None admin] RBAC: Authorizing `identity:get_project(project_id=bf999b1796e2439bb0a35f1812856355)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:06.480437 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28364ca6-73dc-4345-ba0f-84b8807dd0ab None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:06.487389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 229/449] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:55:06 2022] GET /identity/v3/projects/bf999b1796e2439bb0a35f1812856355 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:06.488951 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28364ca6-73dc-4345-ba0f-84b8807dd0ab None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:06.492324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:06.518530 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de77cc6-7faa-4775-a5e5-5058561402fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:06.518768 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de77cc6-7faa-4775-a5e5-5058561402fd None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:06.518994 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de77cc6-7faa-4775-a5e5-5058561402fd None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:06.519468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de77cc6-7faa-4775-a5e5-5058561402fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:06.580057 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:06.612335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de77cc6-7faa-4775-a5e5-5058561402fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:06.613817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de77cc6-7faa-4775-a5e5-5058561402fd None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:06.614815 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28364ca6-73dc-4345-ba0f-84b8807dd0ab None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:06.653595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbcad6-c2be-4596-bbae-f2342479298a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:06.654459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbcad6-c2be-4596-bbae-f2342479298a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:06.655512 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbcad6-c2be-4596-bbae-f2342479298a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:06.655512 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbcad6-c2be-4596-bbae-f2342479298a None admin] PATH_INFO: `/v3/groups/f5ade39976cf461283cc28b9dddfaef1` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:06.656433 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbcad6-c2be-4596-bbae-f2342479298a None admin] RBAC: Authorizing `identity:get_group(group_id=f5ade39976cf461283cc28b9dddfaef1)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:06.657899 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbcad6-c2be-4596-bbae-f2342479298a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:06.659771 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 230/450] 10.222.0.79 () {56 vars in 1180 bytes} [Thu Jul 14 11:55:06 2022] GET /identity/v3/groups/f5ade39976cf461283cc28b9dddfaef1 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:55:06.665816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbcad6-c2be-4596-bbae-f2342479298a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:06.725412 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 221/451] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:55:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:06.731899 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de77cc6-7faa-4775-a5e5-5058561402fd None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:06.738345 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:06.771106 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbcad6-c2be-4596-bbae-f2342479298a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:06.804144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a49586-37b2-4f4b-b96d-2303d2615fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:06.804807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a49586-37b2-4f4b-b96d-2303d2615fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:06.805090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a49586-37b2-4f4b-b96d-2303d2615fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:06.805368 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a49586-37b2-4f4b-b96d-2303d2615fa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:06.806193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a49586-37b2-4f4b-b96d-2303d2615fa7 None admin] RBAC: Adding query filter params (group.id=f5ade39976cf461283cc28b9dddfaef1, role.id=986e347cbb9e43e7a49dfef9be8ec9dd, scope.project.id=bf999b1796e2439bb0a35f1812856355) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:06.806522 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a49586-37b2-4f4b-b96d-2303d2615fa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:06.808504 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a49586-37b2-4f4b-b96d-2303d2615fa7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:06.809122 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:06.814910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 231/452] 10.222.0.79 () {56 vars in 1376 bytes} [Thu Jul 14 11:55:06 2022] GET /identity/v3/role_assignments?group.id=f5ade39976cf461283cc28b9dddfaef1&scope.project.id=bf999b1796e2439bb0a35f1812856355&role.id=986e347cbb9e43e7a49dfef9be8ec9dd => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:55:06.833741 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de77cc6-7faa-4775-a5e5-5058561402fd None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:06.870178 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a803e-7665-410c-a424-381509e757b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:06.871662 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a803e-7665-410c-a424-381509e757b8 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:06.871948 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a803e-7665-410c-a424-381509e757b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:06.872226 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a803e-7665-410c-a424-381509e757b8 None admin] PATH_INFO: `/v3/projects/3fccb5bf2b21430990bb49d29dadf01f` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:06.873549 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a803e-7665-410c-a424-381509e757b8 None admin] RBAC: Authorizing `identity:get_project(project_id=3fccb5bf2b21430990bb49d29dadf01f)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:06.875072 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a803e-7665-410c-a424-381509e757b8 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:06.876875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 222/453] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:55:06 2022] GET /identity/v3/projects/3fccb5bf2b21430990bb49d29dadf01f => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:55:06.883016 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a49586-37b2-4f4b-b96d-2303d2615fa7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:06.990949 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a49586-37b2-4f4b-b96d-2303d2615fa7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:07.026357 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee706ce-2372-4f0d-bc20-c7cff2cb6cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:07.027243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee706ce-2372-4f0d-bc20-c7cff2cb6cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:07.027529 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee706ce-2372-4f0d-bc20-c7cff2cb6cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:07.027811 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee706ce-2372-4f0d-bc20-c7cff2cb6cb1 None admin] PATH_INFO: `/v3/groups/8f4e7cbab47a4381beb52affbe2c232f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:07.029014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee706ce-2372-4f0d-bc20-c7cff2cb6cb1 None admin] RBAC: Authorizing `identity:get_group(group_id=8f4e7cbab47a4381beb52affbe2c232f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:07.030453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee706ce-2372-4f0d-bc20-c7cff2cb6cb1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:07.032127 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 232/454] 10.222.0.79 () {56 vars in 1180 bytes} [Thu Jul 14 11:55:06 2022] GET /identity/v3/groups/8f4e7cbab47a4381beb52affbe2c232f => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:07.038160 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a803e-7665-410c-a424-381509e757b8 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:07.143099 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a803e-7665-410c-a424-381509e757b8 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:07.177712 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11eb2d-d8a0-419a-a272-a5d4b43ba6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:07.178365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11eb2d-d8a0-419a-a272-a5d4b43ba6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:07.178685 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11eb2d-d8a0-419a-a272-a5d4b43ba6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:07.178965 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11eb2d-d8a0-419a-a272-a5d4b43ba6e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:07.179794 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11eb2d-d8a0-419a-a272-a5d4b43ba6e2 None admin] RBAC: Adding query filter params (group.id=8f4e7cbab47a4381beb52affbe2c232f, role.id=eff4f9bbb7064bc1a0f9fc55a05fea51, scope.project.id=3fccb5bf2b21430990bb49d29dadf01f) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:07.180110 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11eb2d-d8a0-419a-a272-a5d4b43ba6e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:07.181545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11eb2d-d8a0-419a-a272-a5d4b43ba6e2 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:07.188110 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 223/455] 10.222.0.79 () {56 vars in 1376 bytes} [Thu Jul 14 11:55:07 2022] GET /identity/v3/role_assignments?group.id=8f4e7cbab47a4381beb52affbe2c232f&scope.project.id=3fccb5bf2b21430990bb49d29dadf01f&role.id=eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:55:09.678822 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c76ccf-fede-4780-95ef-6a02a3c10191 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:09.679340 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c76ccf-fede-4780-95ef-6a02a3c10191 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:09.679414 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c76ccf-fede-4780-95ef-6a02a3c10191 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:09.681045 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 233/456] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:09.686905 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6c321-702c-4aff-9841-863ab3a5963c None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:09.687371 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6c321-702c-4aff-9841-863ab3a5963c None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:09.687443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6c321-702c-4aff-9841-863ab3a5963c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:09.712123 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-6fc6c321-702c-4aff-9841-863ab3a5963c None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:09.713521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-6fc6c321-702c-4aff-9841-863ab3a5963c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:09.716106 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:09.820940 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 224/457] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:09.869219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c76ccf-fede-4780-95ef-6a02a3c10191 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:09.872746 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:09.894909 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b47bcb-ec4b-4946-b5d5-126d96911b6f None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:09.895541 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b47bcb-ec4b-4946-b5d5-126d96911b6f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:09.896023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b47bcb-ec4b-4946-b5d5-126d96911b6f None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:09.897861 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 225/458] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:09.902911 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d43b28-b995-48f7-bc6f-62089bf74bad None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:09.903492 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d43b28-b995-48f7-bc6f-62089bf74bad None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:09.903971 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d43b28-b995-48f7-bc6f-62089bf74bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:09.925473 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-a0d43b28-b995-48f7-bc6f-62089bf74bad None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:09.927364 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a0d43b28-b995-48f7-bc6f-62089bf74bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:10.034606 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 226/459] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:55:10.067734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d43b28-b995-48f7-bc6f-62089bf74bad None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:10.067951 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c76ccf-fede-4780-95ef-6a02a3c10191 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:10.110697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b077cf-4c81-49fa-bbde-88eb7e7f5dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:10.112472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b077cf-4c81-49fa-bbde-88eb7e7f5dff None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:10.112991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b077cf-4c81-49fa-bbde-88eb7e7f5dff None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:10.113798 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b077cf-4c81-49fa-bbde-88eb7e7f5dff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:10.129486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b077cf-4c81-49fa-bbde-88eb7e7f5dff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:10.131313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b077cf-4c81-49fa-bbde-88eb7e7f5dff None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:10.157890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f3b077cf-4c81-49fa-bbde-88eb7e7f5dff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:10.157890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:10.157890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:10.157890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:10.157890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:10.157890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:10.157890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:10.157890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:10.157890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:10.157890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:10.157890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:10.157890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:10.157890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:10.157890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:10.157890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:10.158835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:10.158835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:10.158835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:10.158835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:10.158835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:10.158835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:10.158835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:10.158835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:10.158835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:10.158835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:10.158835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:10.158835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:10.158835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:10.158835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:10.158835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:10.158835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:10.158835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:10.159649 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:10.159649 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:10.159649 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:10.159649 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:10.162574 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 234/460] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:10.164184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0f960-a9df-49d6-90ba-2ac2ac164db4 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:10.164666 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0f960-a9df-49d6-90ba-2ac2ac164db4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:10.165239 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0f960-a9df-49d6-90ba-2ac2ac164db4 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:10.168330 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 235/461] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:10.169299 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0f960-a9df-49d6-90ba-2ac2ac164db4 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:10.177072 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:10.214869 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d43b28-b995-48f7-bc6f-62089bf74bad None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:10.251350 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:10.261612 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76e44e-3ce8-4094-97a2-4d496f40b2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:10.262825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76e44e-3ce8-4094-97a2-4d496f40b2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:10.263306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76e44e-3ce8-4094-97a2-4d496f40b2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:10.264050 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76e44e-3ce8-4094-97a2-4d496f40b2a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:10.280957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76e44e-3ce8-4094-97a2-4d496f40b2a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:10.283631 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76e44e-3ce8-4094-97a2-4d496f40b2a2 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:10.302654 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0f960-a9df-49d6-90ba-2ac2ac164db4 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:10.309659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-8c76e44e-3ce8-4094-97a2-4d496f40b2a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:10.309659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:10.309659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:10.309659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:10.309659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:10.309659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:10.309659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:10.309659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:10.309659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:10.309659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:10.309659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:10.309659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:10.309659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:10.309659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:10.309659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:10.310544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:10.310544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:10.310544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:10.310544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:10.310544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:10.310544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:10.310544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:10.310544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:10.310544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:10.310544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:10.310544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:10.310544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:10.310544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:10.310544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:10.310544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:10.310544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:10.310544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:10.311361 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:10.311361 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:10.311361 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:10.311361 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:10.313918 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 227/462] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:55:10.316251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02074c30-b984-4bc8-a020-2c250ea53678 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:10.316696 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02074c30-b984-4bc8-a020-2c250ea53678 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:10.317376 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02074c30-b984-4bc8-a020-2c250ea53678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:10.340831 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-02074c30-b984-4bc8-a020-2c250ea53678 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:10.342297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-02074c30-b984-4bc8-a020-2c250ea53678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:10.342964 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86078df2-c403-42be-b42f-5187be70a7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:10.343741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86078df2-c403-42be-b42f-5187be70a7fa None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:10.344129 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86078df2-c403-42be-b42f-5187be70a7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:10.344525 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86078df2-c403-42be-b42f-5187be70a7fa None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:10.345366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86078df2-c403-42be-b42f-5187be70a7fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:10.345775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86078df2-c403-42be-b42f-5187be70a7fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:10.347298 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86078df2-c403-42be-b42f-5187be70a7fa None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:10.364557 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 236/463] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:10.365668 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86078df2-c403-42be-b42f-5187be70a7fa None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:10.439606 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 228/464] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:10.440676 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02074c30-b984-4bc8-a020-2c250ea53678 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:10.496702 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:10.501209 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86078df2-c403-42be-b42f-5187be70a7fa None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:10.517184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:10.540465 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f311a-4553-47d9-97b2-d170282fda64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:10.541134 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f311a-4553-47d9-97b2-d170282fda64 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:10.541420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f311a-4553-47d9-97b2-d170282fda64 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:10.541697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f311a-4553-47d9-97b2-d170282fda64 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:10.543116 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f311a-4553-47d9-97b2-d170282fda64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:10.543547 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f311a-4553-47d9-97b2-d170282fda64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:10.544926 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f311a-4553-47d9-97b2-d170282fda64 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:10.552419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02074c30-b984-4bc8-a020-2c250ea53678 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:10.563337 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 237/465] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:10.563337 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f311a-4553-47d9-97b2-d170282fda64 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:10.594285 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7823d0-009c-43ba-8bde-1dc5d73250f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:10.594999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7823d0-009c-43ba-8bde-1dc5d73250f3 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:10.595287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7823d0-009c-43ba-8bde-1dc5d73250f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:10.595574 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7823d0-009c-43ba-8bde-1dc5d73250f3 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:10.596287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7823d0-009c-43ba-8bde-1dc5d73250f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:10.597845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7823d0-009c-43ba-8bde-1dc5d73250f3 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:10.632862 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 229/466] 10.222.0.79 () {60 vars in 1132 bytes} [Thu Jul 14 11:55:10 2022] POST /identity/v3/users => generated 246 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:55:10.632862 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a8593-8ef5-420b-8f99-d62faf87abe1 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:10.632862 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a8593-8ef5-420b-8f99-d62faf87abe1 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:10.632862 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a8593-8ef5-420b-8f99-d62faf87abe1 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:10.638619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 230/467] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:10 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:10.640221 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a8593-8ef5-420b-8f99-d62faf87abe1 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:10.742640 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f311a-4553-47d9-97b2-d170282fda64 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:10.807638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5a466-0654-4faa-8e48-20ab88526004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:10.809032 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5a466-0654-4faa-8e48-20ab88526004 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:10.809472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5a466-0654-4faa-8e48-20ab88526004 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:10.809878 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5a466-0654-4faa-8e48-20ab88526004 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:10.825305 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5a466-0654-4faa-8e48-20ab88526004 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:10.826996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5a466-0654-4faa-8e48-20ab88526004 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:10.837359 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a8593-8ef5-420b-8f99-d62faf87abe1 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:10.847579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:10.853058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-32c5a466-0654-4faa-8e48-20ab88526004 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:10.853058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:10.853058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:10.853058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:10.853058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:10.853058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:10.853058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:10.853058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:10.853058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:10.853058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:10.853058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:10.853058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:10.853058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:10.853058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:10.853058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:10.853943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:10.853943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:10.853943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:10.853943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:10.853943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:10.853943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:10.853943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:10.853943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:10.853943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:10.853943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:10.853943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:10.853943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:10.853943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:10.853943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:10.853943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:10.853943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:10.853943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:10.855302 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:10.855302 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:10.855302 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:10.855302 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:10.855302 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 238/468] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:10.856763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be350d1-e14d-43c5-9c1c-a5ff1c600362 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:10.857905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be350d1-e14d-43c5-9c1c-a5ff1c600362 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:10.858404 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be350d1-e14d-43c5-9c1c-a5ff1c600362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:10.891950 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-8be350d1-e14d-43c5-9c1c-a5ff1c600362 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:10.893986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8be350d1-e14d-43c5-9c1c-a5ff1c600362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:10.894643 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16343d-b888-4b19-8179-d04a5fb4dab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:10.895416 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16343d-b888-4b19-8179-d04a5fb4dab1 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:10.895711 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16343d-b888-4b19-8179-d04a5fb4dab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:10.896044 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16343d-b888-4b19-8179-d04a5fb4dab1 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:10.896821 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16343d-b888-4b19-8179-d04a5fb4dab1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:10.898430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16343d-b888-4b19-8179-d04a5fb4dab1 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:10.937090 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 231/469] 10.222.0.79 () {60 vars in 1132 bytes} [Thu Jul 14 11:55:10 2022] POST /identity/v3/users => generated 248 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:55:10.938394 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16343d-b888-4b19-8179-d04a5fb4dab1 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:10.944881 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:11.055719 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 239/470] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:11.101148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be350d1-e14d-43c5-9c1c-a5ff1c600362 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:11.123268 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16343d-b888-4b19-8179-d04a5fb4dab1 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:11.184514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5f4e4-ad5e-4245-bea2-1c07b9f5e12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:11.185465 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5f4e4-ad5e-4245-bea2-1c07b9f5e12c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:11.185911 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5f4e4-ad5e-4245-bea2-1c07b9f5e12c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:11.186920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5f4e4-ad5e-4245-bea2-1c07b9f5e12c None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:11.187962 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5f4e4-ad5e-4245-bea2-1c07b9f5e12c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:11.188424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5f4e4-ad5e-4245-bea2-1c07b9f5e12c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:11.190363 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5f4e4-ad5e-4245-bea2-1c07b9f5e12c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:11.209225 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 232/471] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:11.214797 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5f4e4-ad5e-4245-bea2-1c07b9f5e12c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:11.247006 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be350d1-e14d-43c5-9c1c-a5ff1c600362 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:11.247929 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:11.296952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182e489-e2db-4f2d-bbc2-85ad61f3ba4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:11.297768 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182e489-e2db-4f2d-bbc2-85ad61f3ba4b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:11.298055 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182e489-e2db-4f2d-bbc2-85ad61f3ba4b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:11.298335 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182e489-e2db-4f2d-bbc2-85ad61f3ba4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:11.312923 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182e489-e2db-4f2d-bbc2-85ad61f3ba4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:11.313819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182e489-e2db-4f2d-bbc2-85ad61f3ba4b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:11.335751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f182e489-e2db-4f2d-bbc2-85ad61f3ba4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:11.335751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:11.335751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:11.335751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:11.335751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:11.335751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:11.335751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:11.335751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:11.335751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:11.335751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:11.335751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:11.335751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:11.335751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:11.335751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:11.335751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:11.336656 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:11.336656 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:11.336656 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:11.336656 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:11.336656 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:11.336656 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:11.336656 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:11.336656 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:11.336656 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:11.336656 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:11.336656 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:11.336656 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:11.336656 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:11.336656 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:11.336656 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:11.336656 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:11.336656 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:11.337482 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:11.337482 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:11.337482 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:11.337482 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:11.340398 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 240/472] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:55:11.342037 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d0c8f-7b16-4904-90b6-6bf3374589bb None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:11.342551 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d0c8f-7b16-4904-90b6-6bf3374589bb None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:11.343043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d0c8f-7b16-4904-90b6-6bf3374589bb None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:11.344903 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 241/473] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:11.345913 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d0c8f-7b16-4904-90b6-6bf3374589bb None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:11.358418 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5f4e4-ad5e-4245-bea2-1c07b9f5e12c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:11.360641 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:11.402142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844c516-a360-4dcd-97b8-17aec37f272e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:11.403195 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844c516-a360-4dcd-97b8-17aec37f272e None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:11.403665 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844c516-a360-4dcd-97b8-17aec37f272e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:11.404635 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844c516-a360-4dcd-97b8-17aec37f272e None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:11.405554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844c516-a360-4dcd-97b8-17aec37f272e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:11.407976 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844c516-a360-4dcd-97b8-17aec37f272e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:11.438867 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 233/474] 10.222.0.79 () {60 vars in 1132 bytes} [Thu Jul 14 11:55:11 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:55:11.440817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e8060-80cd-4c7f-9b7d-43a7aac4a523 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:11.441576 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e8060-80cd-4c7f-9b7d-43a7aac4a523 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:11.442994 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e8060-80cd-4c7f-9b7d-43a7aac4a523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:11.465289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-6c0e8060-80cd-4c7f-9b7d-43a7aac4a523 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:11.467644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-6c0e8060-80cd-4c7f-9b7d-43a7aac4a523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:11.496467 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d0c8f-7b16-4904-90b6-6bf3374589bb None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:11.591996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57f03e-059e-4cb4-8d19-aced6d536ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:11.592686 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57f03e-059e-4cb4-8d19-aced6d536ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:11.593065 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57f03e-059e-4cb4-8d19-aced6d536ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:11.593345 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57f03e-059e-4cb4-8d19-aced6d536ad9 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:11.594153 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57f03e-059e-4cb4-8d19-aced6d536ad9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:11.594470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57f03e-059e-4cb4-8d19-aced6d536ad9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:11.595896 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57f03e-059e-4cb4-8d19-aced6d536ad9 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:11.602805 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 234/475] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:11.614194 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 242/476] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:11.619877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e8060-80cd-4c7f-9b7d-43a7aac4a523 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:11.633070 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57f03e-059e-4cb4-8d19-aced6d536ad9 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:11.640693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:11.722416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:11.768801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57f03e-059e-4cb4-8d19-aced6d536ad9 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:11.778960 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e8060-80cd-4c7f-9b7d-43a7aac4a523 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:11.806813 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66c62d-e3cf-4e43-bb30-a14b121dfda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:11.807620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66c62d-e3cf-4e43-bb30-a14b121dfda3 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:11.807913 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66c62d-e3cf-4e43-bb30-a14b121dfda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:11.808197 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66c62d-e3cf-4e43-bb30-a14b121dfda3 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:11.809052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66c62d-e3cf-4e43-bb30-a14b121dfda3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:11.810540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66c62d-e3cf-4e43-bb30-a14b121dfda3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:11.816456 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6769d85-5493-49b7-9db0-740f450fdcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:11.817220 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6769d85-5493-49b7-9db0-740f450fdcf4 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:11.817544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6769d85-5493-49b7-9db0-740f450fdcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:11.817828 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6769d85-5493-49b7-9db0-740f450fdcf4 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:11.818591 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6769d85-5493-49b7-9db0-740f450fdcf4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:11.819086 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.sql.core [None req-eb66c62d-e3cf-4e43-bb30-a14b121dfda3 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 11:55:11.819086 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 14 11:55:11.819086 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [parameters: {'id': '667bd9067b5b4454814e0dd4b574e36b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 14 11:55:11.819086 dv-cinder-848900-3-smb devstack@keystone.service[80164]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80164) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 11:55:11.820052 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6769d85-5493-49b7-9db0-740f450fdcf4 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:11.838301 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-eb66c62d-e3cf-4e43-bb30-a14b121dfda3 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 14 11:55:11.838301 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:11.838301 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 11:55:11.838301 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 11:55:11.838301 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 11:55:11.838301 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 11:55:11.838301 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 11:55:11.838301 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 11:55:11.838301 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 11:55:11.838301 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application conn.query(q) Jul 14 11:55:11.838301 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 11:55:11.838301 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 11:55:11.838301 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 11:55:11.838301 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application result.read() Jul 14 11:55:11.838301 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 11:55:11.839788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 11:55:11.839788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 11:55:11.839788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 11:55:11.839788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 11:55:11.839788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 11:55:11.839788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 11:55:11.839788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 11:55:11.839788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 11:55:11.839788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:11.839788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 11:55:11.839788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:11.839788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:11.839788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 11:55:11.839788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 11:55:11.839788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 14 11:55:11.839788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return ref.to_dict() Jul 14 11:55:11.839788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 11:55:11.839788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application next(self.gen) Jul 14 11:55:11.840668 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 11:55:11.840668 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application yield resource Jul 14 11:55:11.840668 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 11:55:11.840668 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application next(self.gen) Jul 14 11:55:11.840668 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 11:55:11.840668 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 11:55:11.840668 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 11:55:11.840668 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 11:55:11.840668 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 11:55:11.840668 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise self.value Jul 14 11:55:11.840668 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 11:55:11.840668 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 11:55:11.840668 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 11:55:11.840668 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application session.commit() Jul 14 11:55:11.840668 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 11:55:11.840668 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 11:55:11.840668 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 11:55:11.841502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 11:55:11.841502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 11:55:11.841502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.session.flush() Jul 14 11:55:11.841502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 11:55:11.841502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 11:55:11.841502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 11:55:11.841502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 11:55:11.841502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 11:55:11.841502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application compat.raise_( Jul 14 11:55:11.841502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 11:55:11.841502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception Jul 14 11:55:11.841502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 11:55:11.841502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 11:55:11.841502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 11:55:11.841502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 11:55:11.841502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 11:55:11.841502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 11:55:11.842359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 11:55:11.842359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 11:55:11.842359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 11:55:11.842359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 11:55:11.842359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 11:55:11.842359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 11:55:11.842359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 11:55:11.842359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 11:55:11.842359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 11:55:11.842359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 11:55:11.842359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 11:55:11.842359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 11:55:11.842359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 11:55:11.842359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 11:55:11.842359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 11:55:11.842359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception Jul 14 11:55:11.844906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 11:55:11.844906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 11:55:11.844906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 11:55:11.844906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 11:55:11.844906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 11:55:11.844906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 11:55:11.844906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 11:55:11.844906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application conn.query(q) Jul 14 11:55:11.844906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 11:55:11.844906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 11:55:11.844906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 11:55:11.844906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application result.read() Jul 14 11:55:11.844906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 11:55:11.844906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 11:55:11.844906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 11:55:11.844906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 11:55:11.846609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 11:55:11.846609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 11:55:11.846609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 11:55:11.846609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 11:55:11.846609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 11:55:11.846609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 14 11:55:11.846609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [parameters: {'id': '667bd9067b5b4454814e0dd4b574e36b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 14 11:55:11.846609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 11:55:11.846609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:11.846609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:55:11.846609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:11.846609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:11.846609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:11.846609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:11.846609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:11.846609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:11.848406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:11.848406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:11.848406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:11.848406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:11.848406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:11.848406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:11.848406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 14 11:55:11.848406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 14 11:55:11.848406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:11.848406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:11.848406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 14 11:55:11.848406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 14 11:55:11.848406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 11:55:11.848406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 11:55:11.848406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 14 11:55:11.848406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:11.851828 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 235/477] 10.222.0.79 () {60 vars in 1132 bytes} [Thu Jul 14 11:55:11 2022] POST /identity/v3/users => generated 249 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:55:11.852631 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 243/478] 10.222.0.79 () {60 vars in 1131 bytes} [Thu Jul 14 11:55:11 2022] POST /identity/v3/roles => generated 144 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:11.859054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6769d85-5493-49b7-9db0-740f450fdcf4 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:11.941881 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:11.986968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6769d85-5493-49b7-9db0-740f450fdcf4 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:12.036210 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0ccec-f047-4a7f-af86-38bd1330dea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:12.037045 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0ccec-f047-4a7f-af86-38bd1330dea0 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:12.037329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0ccec-f047-4a7f-af86-38bd1330dea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:12.037605 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0ccec-f047-4a7f-af86-38bd1330dea0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:12.053546 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0ccec-f047-4a7f-af86-38bd1330dea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:12.062843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-7dc0ccec-f047-4a7f-af86-38bd1330dea0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:55:12.062843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:12.062843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:12.062843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:12.062843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:12.062843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:12.062843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:12.062843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:12.062843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:12.062843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:12.062843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:12.062843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:12.062843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:12.062843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:12.062843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:12.062843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:12.063743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:12.063743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:12.063743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:12.063743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:12.063743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:12.063743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:12.063743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:12.063743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:12.063743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:12.063743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:12.063743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:12.063743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:12.063743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:12.063743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:12.063743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:12.063743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:12.064549 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:12.064549 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:12.064549 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:12.064549 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:12.064549 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:12.064549 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:12.064549 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:12.064549 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:12.064549 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:12.064549 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:12.064549 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:55:12.064549 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:12.067280 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 236/479] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Jul 14 11:55:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:12.072497 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66c62d-e3cf-4e43-bb30-a14b121dfda3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:12.187307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66c62d-e3cf-4e43-bb30-a14b121dfda3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:12.219932 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:12.226932 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2c5eb-6b28-4a32-9571-fccd3c2ea256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:12.228072 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2c5eb-6b28-4a32-9571-fccd3c2ea256 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:12.228575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2c5eb-6b28-4a32-9571-fccd3c2ea256 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:12.229049 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2c5eb-6b28-4a32-9571-fccd3c2ea256 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:12.230120 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2c5eb-6b28-4a32-9571-fccd3c2ea256 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:12.230701 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2c5eb-6b28-4a32-9571-fccd3c2ea256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:12.232302 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2c5eb-6b28-4a32-9571-fccd3c2ea256 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:12.246078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 244/480] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:13.196816 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e565dde-3cfd-45ff-b06e-006f7f9b34e6 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:13.197333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e565dde-3cfd-45ff-b06e-006f7f9b34e6 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:13.197438 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e565dde-3cfd-45ff-b06e-006f7f9b34e6 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:13.199587 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 237/481] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:55:13.204966 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5d490-0eed-4d66-932c-2866c43c224e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:13.205424 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5d490-0eed-4d66-932c-2866c43c224e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:13.205605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5d490-0eed-4d66-932c-2866c43c224e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:13.231648 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-35c5d490-0eed-4d66-932c-2866c43c224e None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:13.232866 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-35c5d490-0eed-4d66-932c-2866c43c224e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:13.328496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 245/482] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:13.372199 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e565dde-3cfd-45ff-b06e-006f7f9b34e6 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:13.513554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e565dde-3cfd-45ff-b06e-006f7f9b34e6 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:13.513747 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ca14c-96f3-4b98-a6e5-0bb85a3743db None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:13.513747 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ca14c-96f3-4b98-a6e5-0bb85a3743db None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:13.513747 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ca14c-96f3-4b98-a6e5-0bb85a3743db None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:13.514425 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 246/483] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:13.521831 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c6554-717b-4563-a75d-da1526de2b74 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:13.522149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c6554-717b-4563-a75d-da1526de2b74 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:13.522384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c6554-717b-4563-a75d-da1526de2b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:13.553474 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-099c6554-717b-4563-a75d-da1526de2b74 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:13.554686 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-099c6554-717b-4563-a75d-da1526de2b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:13.560891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:13.583116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d1fe5-e705-4e4a-9876-c2e681efe89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:13.583975 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d1fe5-e705-4e4a-9876-c2e681efe89a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:13.584258 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d1fe5-e705-4e4a-9876-c2e681efe89a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:13.584525 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d1fe5-e705-4e4a-9876-c2e681efe89a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:13.597542 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d1fe5-e705-4e4a-9876-c2e681efe89a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:13.606339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-c96d1fe5-e705-4e4a-9876-c2e681efe89a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:13.606339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:13.606339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:13.606339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:13.606339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:13.606339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:13.606339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:13.606339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:13.606339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:13.606339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:13.606339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:13.606339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:13.606339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:13.606339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:13.606339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:13.606339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:13.607297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:13.607297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:13.607297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:13.607297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:13.607297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:13.607297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:13.607297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:13.607297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:13.607297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:13.607297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:13.607297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:13.607297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:13.607297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:13.607297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:13.607297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:13.607297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:13.608087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:13.608087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:13.608087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:13.608087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:13.608087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:13.608087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:13.608087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:13.608087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:13.608087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:13.608087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:13.608087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:13.608087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:13.613065 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 238/484] 10.222.0.79 () {56 vars in 1102 bytes} [Thu Jul 14 11:55:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:13.614810 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d1fe5-e705-4e4a-9876-c2e681efe89a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:13.695589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 247/485] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:55:13.723928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c6554-717b-4563-a75d-da1526de2b74 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:13.815138 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d1fe5-e705-4e4a-9876-c2e681efe89a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:13.850857 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:13.898102 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b1221-4a4c-4900-a32f-85d2f512b9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:13.898820 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b1221-4a4c-4900-a32f-85d2f512b9ce None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:13.899106 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b1221-4a4c-4900-a32f-85d2f512b9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:13.899386 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b1221-4a4c-4900-a32f-85d2f512b9ce None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:13.900196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b1221-4a4c-4900-a32f-85d2f512b9ce None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:13.900512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b1221-4a4c-4900-a32f-85d2f512b9ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:13.901969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b1221-4a4c-4900-a32f-85d2f512b9ce None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:13.920514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 239/486] 10.222.0.79 () {56 vars in 1103 bytes} [Thu Jul 14 11:55:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:55:13.939958 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b1221-4a4c-4900-a32f-85d2f512b9ce None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:13.957761 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c6554-717b-4563-a75d-da1526de2b74 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:14.002521 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a8be7-de85-4e93-8f98-c565616e9613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:14.003346 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a8be7-de85-4e93-8f98-c565616e9613 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:14.003629 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a8be7-de85-4e93-8f98-c565616e9613 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:14.003901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a8be7-de85-4e93-8f98-c565616e9613 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:14.024611 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a8be7-de85-4e93-8f98-c565616e9613 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:14.034903 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:14.038468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f10a8be7-de85-4e93-8f98-c565616e9613 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:14.038468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:14.038468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:14.038468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:14.038468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:14.038468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:14.038468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:14.038468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:14.038468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:14.038468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:14.038468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:14.038468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:14.038468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:14.038468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:14.038468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:14.038468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:14.039388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:14.039388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:14.039388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:14.039388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:14.039388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:14.039388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:14.039388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:14.039388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:14.039388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:14.039388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:14.039388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:14.039388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:14.039388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:14.039388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:14.039388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:14.039388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:14.040144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:14.040144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:14.040144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:14.040144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:14.040144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:14.040144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:14.040144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:14.040144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:14.040144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:14.040144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:14.040144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:14.040144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:14.046655 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 248/487] 10.222.0.79 () {56 vars in 1102 bytes} [Thu Jul 14 11:55:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:55:14.047890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a8be7-de85-4e93-8f98-c565616e9613 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:14.099463 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b1221-4a4c-4900-a32f-85d2f512b9ce None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:14.143829 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1e8ee-012b-4e40-8f08-e897bde9c2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:14.144617 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1e8ee-012b-4e40-8f08-e897bde9c2ae None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:14.144902 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1e8ee-012b-4e40-8f08-e897bde9c2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:14.145180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1e8ee-012b-4e40-8f08-e897bde9c2ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:14.159691 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1e8ee-012b-4e40-8f08-e897bde9c2ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:14.161563 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1e8ee-012b-4e40-8f08-e897bde9c2ae None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:14.185623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-4df1e8ee-012b-4e40-8f08-e897bde9c2ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:14.185623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:14.185623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:14.185623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:14.185623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:14.185623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:14.185623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:14.185623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:14.185623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:14.185623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:14.185623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:14.185623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:14.185623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:14.185623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:14.185623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:14.186639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:14.186639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:14.186639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:14.186639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:14.186639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:14.186639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:14.186639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:14.186639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:14.186639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:14.186639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:14.186639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:14.186639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:14.186639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:14.186639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:14.186639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:14.186639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:14.186639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:14.187463 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:14.187463 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:14.187463 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:14.187463 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:14.187665 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a8be7-de85-4e93-8f98-c565616e9613 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:14.190588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 240/488] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:55:14.191929 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46183559-b2bc-490f-91fe-8dac47ce6719 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:14.192220 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46183559-b2bc-490f-91fe-8dac47ce6719 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:14.192500 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46183559-b2bc-490f-91fe-8dac47ce6719 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:14.193993 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 241/489] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:14.195299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46183559-b2bc-490f-91fe-8dac47ce6719 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:14.210116 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:14.235569 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77cb835-36b7-4d08-9f14-1533a5f3d132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:14.236672 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cb835-36b7-4d08-9f14-1533a5f3d132 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:14.237096 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cb835-36b7-4d08-9f14-1533a5f3d132 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:14.237524 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cb835-36b7-4d08-9f14-1533a5f3d132 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:14.238544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77cb835-36b7-4d08-9f14-1533a5f3d132 None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:14.239097 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77cb835-36b7-4d08-9f14-1533a5f3d132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:14.240680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77cb835-36b7-4d08-9f14-1533a5f3d132 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:14.251138 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 249/490] 10.222.0.79 () {56 vars in 1103 bytes} [Thu Jul 14 11:55:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:14.253065 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52714c-ae3c-40f9-8a96-c0e01d67a14d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:14.253571 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52714c-ae3c-40f9-8a96-c0e01d67a14d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:14.254046 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52714c-ae3c-40f9-8a96-c0e01d67a14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:14.273245 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-9c52714c-ae3c-40f9-8a96-c0e01d67a14d None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:14.274936 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9c52714c-ae3c-40f9-8a96-c0e01d67a14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:14.306897 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:14.311878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46183559-b2bc-490f-91fe-8dac47ce6719 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:14.349588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d17c5-7091-4828-ba53-4ff420b500bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:14.350345 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d17c5-7091-4828-ba53-4ff420b500bd None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:14.350726 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d17c5-7091-4828-ba53-4ff420b500bd None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:14.351423 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d17c5-7091-4828-ba53-4ff420b500bd None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:14.351909 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d17c5-7091-4828-ba53-4ff420b500bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:14.352295 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d17c5-7091-4828-ba53-4ff420b500bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:14.353861 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d17c5-7091-4828-ba53-4ff420b500bd None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:14.366628 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 250/491] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:14.367933 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 242/492] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:14.368276 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52714c-ae3c-40f9-8a96-c0e01d67a14d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:14.383591 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d17c5-7091-4828-ba53-4ff420b500bd None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:14.482798 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52714c-ae3c-40f9-8a96-c0e01d67a14d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:14.491365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:14.502945 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d17c5-7091-4828-ba53-4ff420b500bd None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:14.524454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499d447-be3d-4052-9679-5ccf2c863194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:14.525680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499d447-be3d-4052-9679-5ccf2c863194 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:14.526160 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499d447-be3d-4052-9679-5ccf2c863194 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:14.527324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499d447-be3d-4052-9679-5ccf2c863194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:14.539605 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a330e-b1e8-4a58-80e8-13b0553193bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:14.540196 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499d447-be3d-4052-9679-5ccf2c863194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:14.540415 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a330e-b1e8-4a58-80e8-13b0553193bc None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:14.540701 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a330e-b1e8-4a58-80e8-13b0553193bc None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:14.540977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a330e-b1e8-4a58-80e8-13b0553193bc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:14.543192 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499d447-be3d-4052-9679-5ccf2c863194 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:14.550067 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a330e-b1e8-4a58-80e8-13b0553193bc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:14.551582 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a330e-b1e8-4a58-80e8-13b0553193bc None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:14.564457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-e499d447-be3d-4052-9679-5ccf2c863194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:14.564457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:14.564457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:14.564457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:14.564457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:14.564457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:14.564457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:14.564457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:14.564457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:14.564457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:14.564457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:14.564457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:14.564457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:14.564457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:14.564457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:14.565446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:14.565446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:14.565446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:14.565446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:14.565446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:14.565446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:14.565446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:14.565446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:14.565446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:14.565446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:14.565446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:14.565446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:14.565446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:14.565446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:14.565446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:14.565446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:14.565446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:14.566266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:14.566266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:14.566266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:14.566266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:14.568571 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 251/493] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:14.569702 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499d447-be3d-4052-9679-5ccf2c863194 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:14.575443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-962a330e-b1e8-4a58-80e8-13b0553193bc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:55:14.575443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:14.575443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:14.575443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:14.575443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:14.575443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:14.575443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:14.575443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:14.575443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:14.575443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:14.575443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:14.575443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:14.575443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:55:14.575443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:55:14.575443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:55:14.575443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:55:14.576646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:14.576646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:14.576646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:55:14.576646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:14.576646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:55:14.576646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:14.576646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:14.576646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:14.576646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:14.576646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:14.576646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:14.576646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:14.576646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:14.576646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:14.576646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:14.576646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:14.576646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:14.576646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:14.577818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:14.577818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:14.577818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:55:14.577818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:55:14.577818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:55:14.577818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:55:14.577818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:55:14.577818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:55:14.577818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:55:14.577818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:14.581070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 243/494] 10.222.0.79 () {56 vars in 1093 bytes} [Thu Jul 14 11:55:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:14.582067 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a330e-b1e8-4a58-80e8-13b0553193bc None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:14.604285 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:14.692104 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499d447-be3d-4052-9679-5ccf2c863194 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:14.696439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a330e-b1e8-4a58-80e8-13b0553193bc None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:14.731837 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1c9db-9a36-435b-9a59-a9cf16cad4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:14.732998 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1c9db-9a36-435b-9a59-a9cf16cad4db None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:14.733477 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1c9db-9a36-435b-9a59-a9cf16cad4db None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:14.734039 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1c9db-9a36-435b-9a59-a9cf16cad4db None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:14.735849 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92a2bf-52a5-41a1-b8eb-c12333197462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:14.736737 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92a2bf-52a5-41a1-b8eb-c12333197462 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:14.736913 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92a2bf-52a5-41a1-b8eb-c12333197462 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:14.737155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92a2bf-52a5-41a1-b8eb-c12333197462 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:14.737885 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a92a2bf-52a5-41a1-b8eb-c12333197462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:14.738192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a92a2bf-52a5-41a1-b8eb-c12333197462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:14.739635 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a92a2bf-52a5-41a1-b8eb-c12333197462 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:14.748171 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1c9db-9a36-435b-9a59-a9cf16cad4db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:14.752756 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 244/495] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:14.753674 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92a2bf-52a5-41a1-b8eb-c12333197462 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:14.758910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-4fe1c9db-9a36-435b-9a59-a9cf16cad4db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:14.758910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:14.758910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:14.758910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:14.758910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:14.758910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:14.758910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:14.758910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:14.758910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:14.758910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:14.758910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:14.758910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:14.758910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:14.758910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:14.758910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:14.758910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:14.759790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:14.759790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:14.759790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:14.759790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:14.759790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:14.759790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:14.759790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:14.759790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:14.759790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:14.759790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:14.759790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:14.759790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:14.759790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:14.759790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:14.759790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:14.759790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:14.761475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:14.761475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:14.761475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:14.761475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:14.761475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:14.761475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:14.761475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:14.761475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:14.761475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:14.761475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:14.761475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:14.761475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:14.764331 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 252/496] 10.222.0.79 () {56 vars in 1102 bytes} [Thu Jul 14 11:55:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:14.765464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1c9db-9a36-435b-9a59-a9cf16cad4db None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:14.787432 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:14.843488 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:14.866706 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92a2bf-52a5-41a1-b8eb-c12333197462 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:14.886779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1c9db-9a36-435b-9a59-a9cf16cad4db None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:14.906451 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544aae8-4015-4520-8872-3bd870ba22df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:14.907149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544aae8-4015-4520-8872-3bd870ba22df None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:14.907430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544aae8-4015-4520-8872-3bd870ba22df None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:14.907700 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544aae8-4015-4520-8872-3bd870ba22df None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:14.908651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544aae8-4015-4520-8872-3bd870ba22df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:14.908957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544aae8-4015-4520-8872-3bd870ba22df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:14.910393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544aae8-4015-4520-8872-3bd870ba22df None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:14.922108 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620c9ae-be14-4b62-ae82-22a4f2d93ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:14.923042 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620c9ae-be14-4b62-ae82-22a4f2d93ccf None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:14.923325 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620c9ae-be14-4b62-ae82-22a4f2d93ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:14.923597 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620c9ae-be14-4b62-ae82-22a4f2d93ccf None admin] PATH_INFO: `/v3/users/glance` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:14.933022 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620c9ae-be14-4b62-ae82-22a4f2d93ccf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:14.934481 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620c9ae-be14-4b62-ae82-22a4f2d93ccf None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:14.953628 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 245/497] 10.222.0.79 () {56 vars in 1133 bytes} [Thu Jul 14 11:55:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:14.953628 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544aae8-4015-4520-8872-3bd870ba22df None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:14.960200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-c620c9ae-be14-4b62-ae82-22a4f2d93ccf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 11:55:14.960200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:14.960200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:14.960200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:14.960200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:14.960200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:14.960200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:14.960200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:14.960200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:14.960200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:14.960200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:14.960200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:14.960200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:55:14.960200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:55:14.960200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:55:14.960200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:55:14.961135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:14.961135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:14.961135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:55:14.961135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:14.961135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:55:14.961135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:14.961135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:14.961135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:14.961135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:14.961135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:14.961135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:14.961135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:14.961135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:14.961135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:14.961135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:14.961135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:14.961135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:14.961135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:14.962022 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:14.962022 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:14.962022 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:55:14.962022 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:55:14.962022 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:55:14.962022 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:55:14.962022 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:55:14.962022 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:55:14.962022 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 11:55:14.962022 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:14.962022 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 253/498] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:55:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:14.963598 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec443b9-7ccf-4651-ad8a-b7e6ffa7aa8a None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:14.963598 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec443b9-7ccf-4651-ad8a-b7e6ffa7aa8a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:14.963598 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec443b9-7ccf-4651-ad8a-b7e6ffa7aa8a None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:14.968690 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 254/499] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:14.968690 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec443b9-7ccf-4651-ad8a-b7e6ffa7aa8a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:15.061198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:15.062216 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544aae8-4015-4520-8872-3bd870ba22df None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:15.084250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec443b9-7ccf-4651-ad8a-b7e6ffa7aa8a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:15.096927 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89423f-8d87-46f3-ac3b-f6e044ae1a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:15.097596 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89423f-8d87-46f3-ac3b-f6e044ae1a17 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:15.097886 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89423f-8d87-46f3-ac3b-f6e044ae1a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:15.098170 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89423f-8d87-46f3-ac3b-f6e044ae1a17 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:15.098943 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89423f-8d87-46f3-ac3b-f6e044ae1a17 None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:15.099255 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89423f-8d87-46f3-ac3b-f6e044ae1a17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:15.100644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89423f-8d87-46f3-ac3b-f6e044ae1a17 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:15.102809 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:15.109241 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 246/500] 10.222.0.79 () {56 vars in 1103 bytes} [Thu Jul 14 11:55:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:15.110071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89423f-8d87-46f3-ac3b-f6e044ae1a17 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:15.119019 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d2761-83d3-4ad5-981e-6f73f8a4f838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:15.119609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d2761-83d3-4ad5-981e-6f73f8a4f838 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:15.119888 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d2761-83d3-4ad5-981e-6f73f8a4f838 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:15.120756 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d2761-83d3-4ad5-981e-6f73f8a4f838 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:15.187580 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d2761-83d3-4ad5-981e-6f73f8a4f838 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:15.189063 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d2761-83d3-4ad5-981e-6f73f8a4f838 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:15.212837 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89423f-8d87-46f3-ac3b-f6e044ae1a17 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:15.248265 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e6c61-d1d0-4f7b-be1a-b853f997ecdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:15.248928 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e6c61-d1d0-4f7b-be1a-b853f997ecdc None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:15.249207 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e6c61-d1d0-4f7b-be1a-b853f997ecdc None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:15.249485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e6c61-d1d0-4f7b-be1a-b853f997ecdc None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:15.250303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e6c61-d1d0-4f7b-be1a-b853f997ecdc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:15.250638 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e6c61-d1d0-4f7b-be1a-b853f997ecdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:15.252067 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e6c61-d1d0-4f7b-be1a-b853f997ecdc None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:15.269612 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:15.270134 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 247/501] 10.222.0.79 () {56 vars in 1137 bytes} [Thu Jul 14 11:55:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:15.271394 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95693aa-d0f0-4574-b58b-1a264e850c6a None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:15.271742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95693aa-d0f0-4574-b58b-1a264e850c6a None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:15.272098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95693aa-d0f0-4574-b58b-1a264e850c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:15.288749 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-a95693aa-d0f0-4574-b58b-1a264e850c6a None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:15.289957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a95693aa-d0f0-4574-b58b-1a264e850c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:15.297601 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 255/502] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:55:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:15.298970 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e315d3a-26e6-416a-b34b-1526709d89a4 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:15.299260 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e315d3a-26e6-416a-b34b-1526709d89a4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:15.299537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e315d3a-26e6-416a-b34b-1526709d89a4 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:15.300826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 256/503] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:15.301530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e315d3a-26e6-416a-b34b-1526709d89a4 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:15.343197 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:15.360096 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 248/504] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:15.360951 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95693aa-d0f0-4574-b58b-1a264e850c6a None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:15.409699 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e315d3a-26e6-416a-b34b-1526709d89a4 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:15.445715 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff3d79-491e-4eb4-9549-c213d21d4248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:15.446525 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff3d79-491e-4eb4-9549-c213d21d4248 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:15.446817 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff3d79-491e-4eb4-9549-c213d21d4248 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:15.447096 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff3d79-491e-4eb4-9549-c213d21d4248 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:15.457242 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff3d79-491e-4eb4-9549-c213d21d4248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:15.458736 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff3d79-491e-4eb4-9549-c213d21d4248 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:15.464975 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95693aa-d0f0-4574-b58b-1a264e850c6a None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:15.475944 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-3cff3d79-491e-4eb4-9549-c213d21d4248 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:15.475944 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:15.475944 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:15.475944 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:15.475944 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:15.475944 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:15.475944 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:15.475944 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:15.475944 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:15.475944 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:15.475944 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:15.475944 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:15.475944 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:15.475944 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:15.475944 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:15.476962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:15.476962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:15.476962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:15.476962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:15.476962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:15.476962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:15.476962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:15.476962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:15.476962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:15.476962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:15.476962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:15.476962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:15.476962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:15.476962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:15.476962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:15.476962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:15.476962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:15.477988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:15.477988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:15.477988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:15.477988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:15.477988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 257/505] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:15.478308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff3d79-491e-4eb4-9549-c213d21d4248 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:15.501798 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de76e7-7eae-4a1a-b91e-ff1f1996ed8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:15.502446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de76e7-7eae-4a1a-b91e-ff1f1996ed8c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:15.502754 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de76e7-7eae-4a1a-b91e-ff1f1996ed8c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:15.503031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de76e7-7eae-4a1a-b91e-ff1f1996ed8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:15.509481 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:15.558356 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:15.571445 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de76e7-7eae-4a1a-b91e-ff1f1996ed8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:15.572917 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de76e7-7eae-4a1a-b91e-ff1f1996ed8c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:15.581161 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff3d79-491e-4eb4-9549-c213d21d4248 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:15.615470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faadfe2-c293-4f18-9ed5-b54689ee5662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:15.616264 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faadfe2-c293-4f18-9ed5-b54689ee5662 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:15.616544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faadfe2-c293-4f18-9ed5-b54689ee5662 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:15.616816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faadfe2-c293-4f18-9ed5-b54689ee5662 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:15.627486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faadfe2-c293-4f18-9ed5-b54689ee5662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:15.628931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faadfe2-c293-4f18-9ed5-b54689ee5662 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:15.645965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-7faadfe2-c293-4f18-9ed5-b54689ee5662 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:15.645965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:15.645965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:15.645965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:15.645965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:15.645965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:15.645965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:15.645965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:15.645965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:15.645965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:15.645965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:15.645965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:15.645965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:15.645965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:15.645965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:15.646886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:15.646886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:15.646886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:15.646886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:15.646886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:15.646886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:15.646886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:15.646886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:15.646886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:15.646886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:15.646886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:15.646886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:15.646886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:15.646886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:15.646886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:15.646886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:15.646886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:15.647726 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:15.647726 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:15.647726 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:15.647726 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:15.647726 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 258/506] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:15.648382 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c36bc-f447-4ea3-a36f-85172dfa84d5 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:15.648625 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c36bc-f447-4ea3-a36f-85172dfa84d5 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:15.648893 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c36bc-f447-4ea3-a36f-85172dfa84d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:15.665305 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-d82c36bc-f447-4ea3-a36f-85172dfa84d5 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:15.666411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d82c36bc-f447-4ea3-a36f-85172dfa84d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:15.678769 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 249/507] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:55:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:15.679615 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de76e7-7eae-4a1a-b91e-ff1f1996ed8c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:15.739598 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 259/508] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:15.740486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c36bc-f447-4ea3-a36f-85172dfa84d5 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:15.776150 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:15.784920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:15.798453 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de76e7-7eae-4a1a-b91e-ff1f1996ed8c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:15.837144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272dcf6-bed2-409b-9c7b-c67199aaf1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:15.838227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272dcf6-bed2-409b-9c7b-c67199aaf1fb None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:15.839271 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272dcf6-bed2-409b-9c7b-c67199aaf1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:15.839735 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272dcf6-bed2-409b-9c7b-c67199aaf1fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:15.850333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272dcf6-bed2-409b-9c7b-c67199aaf1fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:15.858745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-d272dcf6-bed2-409b-9c7b-c67199aaf1fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:15.858745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:15.858745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:15.858745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:15.858745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:15.858745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:15.858745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:15.858745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:15.858745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:15.858745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:15.858745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:15.858745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:15.858745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:15.858745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:15.858745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:15.858745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:15.859644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:15.859644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:15.859644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:15.859644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:15.859644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:15.859644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:15.859644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:15.859644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:15.859644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:15.859644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:15.859644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:15.859644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:15.859644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:15.859644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:15.859644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:15.859644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:15.860428 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:15.860428 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:15.860428 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:15.860428 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:15.860428 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:15.860428 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:15.860428 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:15.860428 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:15.860428 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:15.860428 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:15.860428 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:15.860428 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:15.860428 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 250/509] 10.222.0.79 () {56 vars in 1102 bytes} [Thu Jul 14 11:55:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:15.861071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272dcf6-bed2-409b-9c7b-c67199aaf1fb None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:15.887276 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c36bc-f447-4ea3-a36f-85172dfa84d5 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:15.924803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3633440-7fa5-478f-ba8c-ae4400d3b3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:15.925621 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3633440-7fa5-478f-ba8c-ae4400d3b3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:15.925973 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3633440-7fa5-478f-ba8c-ae4400d3b3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:15.926327 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3633440-7fa5-478f-ba8c-ae4400d3b3a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:15.927459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3633440-7fa5-478f-ba8c-ae4400d3b3a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:15.927774 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3633440-7fa5-478f-ba8c-ae4400d3b3a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:15.929158 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3633440-7fa5-478f-ba8c-ae4400d3b3a4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:15.943782 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 260/510] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:15.944927 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3633440-7fa5-478f-ba8c-ae4400d3b3a4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:15.981843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272dcf6-bed2-409b-9c7b-c67199aaf1fb None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:16.023225 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac9841-a131-4a4e-bd75-abad977a2481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:16.023787 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac9841-a131-4a4e-bd75-abad977a2481 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:16.024065 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac9841-a131-4a4e-bd75-abad977a2481 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:16.024343 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac9841-a131-4a4e-bd75-abad977a2481 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:16.025055 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac9841-a131-4a4e-bd75-abad977a2481 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:16.025361 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac9841-a131-4a4e-bd75-abad977a2481 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:16.026809 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac9841-a131-4a4e-bd75-abad977a2481 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:16.033002 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:16.042369 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 251/511] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:16.042369 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac9841-a131-4a4e-bd75-abad977a2481 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:16.051619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:16.068038 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3633440-7fa5-478f-ba8c-ae4400d3b3a4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:16.106145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd776b-e7a3-4e8f-bd25-d119467eac14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:16.106996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd776b-e7a3-4e8f-bd25-d119467eac14 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:16.107283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd776b-e7a3-4e8f-bd25-d119467eac14 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:16.107563 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd776b-e7a3-4e8f-bd25-d119467eac14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:16.118789 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd776b-e7a3-4e8f-bd25-d119467eac14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:16.120891 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd776b-e7a3-4e8f-bd25-d119467eac14 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:16.138283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-8ccd776b-e7a3-4e8f-bd25-d119467eac14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:16.138283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:16.138283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:16.138283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:16.138283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:16.138283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:16.138283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:16.138283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:16.138283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:16.138283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:16.138283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:16.138283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:16.138283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:16.138283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:16.138283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:16.139252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:16.139252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:16.139252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:16.139252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:16.139252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:16.139252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:16.139252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:16.139252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:16.139252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:16.139252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:16.139252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:16.139252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:16.139252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:16.139252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:16.139252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:16.139252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:16.139252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:16.140118 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:16.140118 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:16.140118 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:16.140118 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:16.140118 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 261/512] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:16.140372 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd776b-e7a3-4e8f-bd25-d119467eac14 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:16.156222 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac9841-a131-4a4e-bd75-abad977a2481 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:16.191080 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff1bbd-b525-4610-b915-3ef081af9c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:16.191790 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff1bbd-b525-4610-b915-3ef081af9c72 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:16.192070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff1bbd-b525-4610-b915-3ef081af9c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:16.192342 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff1bbd-b525-4610-b915-3ef081af9c72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:16.204070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff1bbd-b525-4610-b915-3ef081af9c72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:16.205520 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff1bbd-b525-4610-b915-3ef081af9c72 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:16.222393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-89ff1bbd-b525-4610-b915-3ef081af9c72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:16.222393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:16.222393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:16.222393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:16.222393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:16.222393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:16.222393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:16.222393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:16.222393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:16.222393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:16.222393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:16.222393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:16.222393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:16.222393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:16.222393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:16.223510 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:16.223510 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:16.223510 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:16.223510 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:16.223510 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:16.223510 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:16.223510 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:16.223510 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:16.223510 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:16.223510 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:16.223510 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:16.223510 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:16.223510 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:16.223510 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:16.223510 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:16.223510 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:16.223510 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:16.224474 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:16.224474 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:16.224474 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:16.224474 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:16.224474 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 252/513] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:16.224474 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff1bbd-b525-4610-b915-3ef081af9c72 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:16.247878 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd776b-e7a3-4e8f-bd25-d119467eac14 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:16.270422 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:16.281956 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65125ba9-4eaf-4db7-bcbc-2d425dc5dec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:16.282602 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65125ba9-4eaf-4db7-bcbc-2d425dc5dec7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:16.282893 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65125ba9-4eaf-4db7-bcbc-2d425dc5dec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:16.283172 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65125ba9-4eaf-4db7-bcbc-2d425dc5dec7 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:16.283923 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65125ba9-4eaf-4db7-bcbc-2d425dc5dec7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:16.284234 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65125ba9-4eaf-4db7-bcbc-2d425dc5dec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:16.285615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65125ba9-4eaf-4db7-bcbc-2d425dc5dec7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:16.286529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:16.294546 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 262/514] 10.222.0.79 () {56 vars in 1103 bytes} [Thu Jul 14 11:55:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:16.295366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65125ba9-4eaf-4db7-bcbc-2d425dc5dec7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:16.335196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff1bbd-b525-4610-b915-3ef081af9c72 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:16.368419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df3c29-9a6d-457e-9f1f-9ad4fb048a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:16.369209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df3c29-9a6d-457e-9f1f-9ad4fb048a56 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:16.369494 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df3c29-9a6d-457e-9f1f-9ad4fb048a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:16.369773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df3c29-9a6d-457e-9f1f-9ad4fb048a56 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:16.378090 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df3c29-9a6d-457e-9f1f-9ad4fb048a56 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:16.379580 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df3c29-9a6d-457e-9f1f-9ad4fb048a56 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:16.393770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-78df3c29-9a6d-457e-9f1f-9ad4fb048a56 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 11:55:16.393770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:16.393770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:16.393770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:16.393770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:16.393770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:16.393770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:16.393770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:16.393770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:16.393770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:16.393770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:16.393770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:16.393770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:55:16.393770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:55:16.393770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:55:16.393770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:55:16.395031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:16.395031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:16.395031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:55:16.395031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:16.395031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:55:16.395031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:16.395031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:16.395031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:16.395031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:16.395031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:16.395031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:16.395031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:16.395031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:16.395031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:16.395031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:16.395031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:16.395031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:16.395031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:16.396209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:16.396209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:16.396209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:55:16.396209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:55:16.396209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:55:16.396209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:55:16.396209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:55:16.396209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:55:16.396209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 11:55:16.396209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:16.396209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 253/515] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:55:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:16.396209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df3c29-9a6d-457e-9f1f-9ad4fb048a56 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:16.402772 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65125ba9-4eaf-4db7-bcbc-2d425dc5dec7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:16.437356 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc706692-168c-4036-93e0-b58cb0b53f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:16.438143 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc706692-168c-4036-93e0-b58cb0b53f0e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:16.438423 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc706692-168c-4036-93e0-b58cb0b53f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:16.438731 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc706692-168c-4036-93e0-b58cb0b53f0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:16.445673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc706692-168c-4036-93e0-b58cb0b53f0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:16.447085 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc706692-168c-4036-93e0-b58cb0b53f0e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:16.462307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-bc706692-168c-4036-93e0-b58cb0b53f0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:16.462307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:16.462307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:16.462307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:16.462307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:16.462307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:16.462307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:16.462307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:16.462307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:16.462307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:16.462307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:16.462307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:16.462307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:55:16.462307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:55:16.462307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:55:16.463198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:55:16.463198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:16.463198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:16.463198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:16.463198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:16.463198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:16.463198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:16.463198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:16.463198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:16.463198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:16.463198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:16.463198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:16.463198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:16.463198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:16.463198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:16.463198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:16.463198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:16.464647 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:55:16.464647 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:55:16.464647 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:55:16.464647 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:55:16.464647 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:55:16.464647 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:55:16.464647 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:16.464647 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:16.464647 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 263/516] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:16.465102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc706692-168c-4036-93e0-b58cb0b53f0e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:16.502225 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df3c29-9a6d-457e-9f1f-9ad4fb048a56 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:16.511278 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:16.519119 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:16.536399 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a520174-1017-45b6-a268-6099d18a835d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:16.537062 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a520174-1017-45b6-a268-6099d18a835d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:16.537349 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a520174-1017-45b6-a268-6099d18a835d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:16.537637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a520174-1017-45b6-a268-6099d18a835d None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:16.538385 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a520174-1017-45b6-a268-6099d18a835d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:16.538729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a520174-1017-45b6-a268-6099d18a835d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:16.540131 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a520174-1017-45b6-a268-6099d18a835d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:16.552653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 254/517] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:16.553646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a520174-1017-45b6-a268-6099d18a835d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:16.568710 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc706692-168c-4036-93e0-b58cb0b53f0e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:16.603218 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2ebbc-0880-4417-82d3-4c9cdc723ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:16.603993 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2ebbc-0880-4417-82d3-4c9cdc723ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:16.604341 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2ebbc-0880-4417-82d3-4c9cdc723ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:16.605233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2ebbc-0880-4417-82d3-4c9cdc723ff3 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:16.606017 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2ebbc-0880-4417-82d3-4c9cdc723ff3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:16.606329 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2ebbc-0880-4417-82d3-4c9cdc723ff3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:16.607748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2ebbc-0880-4417-82d3-4c9cdc723ff3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:16.619146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 264/518] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:16.620571 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2ebbc-0880-4417-82d3-4c9cdc723ff3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:16.659119 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a520174-1017-45b6-a268-6099d18a835d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:16.693908 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af6cc7-a2d8-4d30-86b8-29385bd311e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:16.694726 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af6cc7-a2d8-4d30-86b8-29385bd311e7 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:16.695014 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af6cc7-a2d8-4d30-86b8-29385bd311e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:16.695294 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af6cc7-a2d8-4d30-86b8-29385bd311e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:16.705555 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af6cc7-a2d8-4d30-86b8-29385bd311e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:16.706989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af6cc7-a2d8-4d30-86b8-29385bd311e7 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:16.721329 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2ebbc-0880-4417-82d3-4c9cdc723ff3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:16.724995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-36af6cc7-a2d8-4d30-86b8-29385bd311e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:16.724995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:16.724995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:16.724995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:16.724995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:16.724995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:16.724995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:16.724995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:16.724995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:16.724995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:16.724995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:16.724995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:16.724995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:16.724995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:16.724995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:16.725818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:16.725818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:16.725818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:16.725818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:16.725818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:16.725818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:16.725818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:16.725818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:16.725818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:16.725818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:16.725818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:16.725818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:16.725818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:16.725818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:16.725818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:16.725818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:16.725818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:16.726938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:16.726938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:16.726938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:16.726938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:16.726938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 255/519] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:16.727374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af6cc7-a2d8-4d30-86b8-29385bd311e7 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:16.728522 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:16.757418 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdf4e6-cfb1-4e18-ae85-03a2e9081d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:16.758097 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdf4e6-cfb1-4e18-ae85-03a2e9081d12 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:16.758382 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdf4e6-cfb1-4e18-ae85-03a2e9081d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:16.758710 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdf4e6-cfb1-4e18-ae85-03a2e9081d12 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:16.759543 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcdf4e6-cfb1-4e18-ae85-03a2e9081d12 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:16.759856 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcdf4e6-cfb1-4e18-ae85-03a2e9081d12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:16.760556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:16.761385 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcdf4e6-cfb1-4e18-ae85-03a2e9081d12 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:16.797951 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 265/520] 10.222.0.79 () {56 vars in 1137 bytes} [Thu Jul 14 11:55:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:16.798820 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdf4e6-cfb1-4e18-ae85-03a2e9081d12 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:16.831710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af6cc7-a2d8-4d30-86b8-29385bd311e7 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:16.864161 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef134e9d-008b-4ea0-871d-115bb098c9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:16.864822 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef134e9d-008b-4ea0-871d-115bb098c9ce None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:16.865109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef134e9d-008b-4ea0-871d-115bb098c9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:16.865389 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef134e9d-008b-4ea0-871d-115bb098c9ce None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:16.866200 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef134e9d-008b-4ea0-871d-115bb098c9ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:16.866540 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef134e9d-008b-4ea0-871d-115bb098c9ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:16.867991 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef134e9d-008b-4ea0-871d-115bb098c9ce None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:16.886014 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 256/521] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:55:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:16.886881 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef134e9d-008b-4ea0-871d-115bb098c9ce None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:16.900213 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdf4e6-cfb1-4e18-ae85-03a2e9081d12 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:16.934590 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f53672-efa3-4450-93a0-183e95a25a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:16.935389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f53672-efa3-4450-93a0-183e95a25a63 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:16.935684 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f53672-efa3-4450-93a0-183e95a25a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:16.935947 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f53672-efa3-4450-93a0-183e95a25a63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:16.942596 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f53672-efa3-4450-93a0-183e95a25a63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:16.944055 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f53672-efa3-4450-93a0-183e95a25a63 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:16.957955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-19f53672-efa3-4450-93a0-183e95a25a63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:16.957955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:16.957955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:16.957955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:16.957955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:16.957955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:16.957955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:16.957955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:16.957955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:16.957955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:16.957955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:16.957955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:16.957955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:55:16.957955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:55:16.957955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:55:16.958931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:55:16.958931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:16.958931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:16.958931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:16.958931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:16.958931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:16.958931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:16.958931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:16.958931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:16.958931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:16.958931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:16.958931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:16.958931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:16.958931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:16.958931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:16.958931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:16.958931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:16.959882 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:55:16.959882 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:55:16.959882 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:55:16.959882 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:55:16.959882 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:55:16.959882 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:55:16.959882 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:16.959882 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:16.959882 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 266/522] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:16.959882 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f53672-efa3-4450-93a0-183e95a25a63 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:16.976409 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:16.986626 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef134e9d-008b-4ea0-871d-115bb098c9ce None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:16.991079 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:17.021661 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3b7d0-5f45-4424-b297-dbc30d075fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:17.022342 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3b7d0-5f45-4424-b297-dbc30d075fde None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:17.022661 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3b7d0-5f45-4424-b297-dbc30d075fde None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:17.022939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3b7d0-5f45-4424-b297-dbc30d075fde None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:17.023648 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3b7d0-5f45-4424-b297-dbc30d075fde None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:17.025107 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3b7d0-5f45-4424-b297-dbc30d075fde None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:17.046095 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 257/523] 10.222.0.79 () {60 vars in 1132 bytes} [Thu Jul 14 11:55:16 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:55:17.046981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3b7d0-5f45-4424-b297-dbc30d075fde None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:17.069806 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f53672-efa3-4450-93a0-183e95a25a63 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:17.108780 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6c6be-8fc7-4d3e-8bfb-b69d30cc1ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:17.109469 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6c6be-8fc7-4d3e-8bfb-b69d30cc1ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:17.109864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6c6be-8fc7-4d3e-8bfb-b69d30cc1ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:17.110066 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6c6be-8fc7-4d3e-8bfb-b69d30cc1ba4 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:17.110817 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6c6be-8fc7-4d3e-8bfb-b69d30cc1ba4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:17.111134 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6c6be-8fc7-4d3e-8bfb-b69d30cc1ba4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:17.112575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6c6be-8fc7-4d3e-8bfb-b69d30cc1ba4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:17.130687 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 267/524] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:17.130687 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6c6be-8fc7-4d3e-8bfb-b69d30cc1ba4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:17.187939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3b7d0-5f45-4424-b297-dbc30d075fde None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:17.232656 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:17.241773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e0125-d224-4401-83c4-41b3b9fb06e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:17.242677 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e0125-d224-4401-83c4-41b3b9fb06e4 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:17.243127 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e0125-d224-4401-83c4-41b3b9fb06e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:17.243566 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e0125-d224-4401-83c4-41b3b9fb06e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:17.257740 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6c6be-8fc7-4d3e-8bfb-b69d30cc1ba4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:17.267605 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:17.296830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8d491-37a3-4b79-ab6b-131a6930f653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:17.297578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8d491-37a3-4b79-ab6b-131a6930f653 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:17.297779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8d491-37a3-4b79-ab6b-131a6930f653 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:17.298059 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8d491-37a3-4b79-ab6b-131a6930f653 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:17.298923 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8d491-37a3-4b79-ab6b-131a6930f653 None admin] RBAC: Adding query filter params (role.id=73743e14bfe849198f3a8b549163f32b, scope.project.id=66f531bc924b41faa64743923afac319, user.id=e41a4d3a822c403fad048764a0edf209) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:17.299237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8d491-37a3-4b79-ab6b-131a6930f653 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:17.300660 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8d491-37a3-4b79-ab6b-131a6930f653 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:17.306903 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 268/525] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:55:17 2022] GET /identity/v3/role_assignments?user.id=e41a4d3a822c403fad048764a0edf209&scope.project.id=66f531bc924b41faa64743923afac319&role.id=73743e14bfe849198f3a8b549163f32b => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:17.307784 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8d491-37a3-4b79-ab6b-131a6930f653 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:17.359790 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e0125-d224-4401-83c4-41b3b9fb06e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:17.362486 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e0125-d224-4401-83c4-41b3b9fb06e4 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:17.453006 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8d491-37a3-4b79-ab6b-131a6930f653 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:17.486987 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 258/526] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:55:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:17.490605 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e0125-d224-4401-83c4-41b3b9fb06e4 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:17.510152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39771d3e-81b6-4b80-b90b-77b606c1a626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:17.511962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39771d3e-81b6-4b80-b90b-77b606c1a626 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:17.512250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39771d3e-81b6-4b80-b90b-77b606c1a626 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:17.512800 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39771d3e-81b6-4b80-b90b-77b606c1a626 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:17.513623 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39771d3e-81b6-4b80-b90b-77b606c1a626 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:17.514198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39771d3e-81b6-4b80-b90b-77b606c1a626 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:17.516453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39771d3e-81b6-4b80-b90b-77b606c1a626 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:17.538437 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:17.544630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 269/527] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:55:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:17.545509 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39771d3e-81b6-4b80-b90b-77b606c1a626 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:17.560021 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:17.603509 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e0125-d224-4401-83c4-41b3b9fb06e4 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:17.640285 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f284d3f-9dbb-4d39-94ba-252ae681b2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:17.641089 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f284d3f-9dbb-4d39-94ba-252ae681b2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:17.641375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f284d3f-9dbb-4d39-94ba-252ae681b2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:17.641653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f284d3f-9dbb-4d39-94ba-252ae681b2a6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:17.649996 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f284d3f-9dbb-4d39-94ba-252ae681b2a6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:17.652318 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f284d3f-9dbb-4d39-94ba-252ae681b2a6 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:17.661459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39771d3e-81b6-4b80-b90b-77b606c1a626 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:17.667374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-3f284d3f-9dbb-4d39-94ba-252ae681b2a6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 11:55:17.667374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:17.667374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:17.667374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:17.667374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:17.667374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:17.667374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:17.667374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:17.667374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:17.667374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:17.667374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:17.667374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:17.667374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:55:17.667374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:55:17.667374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:55:17.667374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:55:17.668298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:17.668298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:17.668298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:55:17.668298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:17.668298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:55:17.668298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:17.668298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:17.668298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:17.668298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:17.668298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:17.668298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:17.668298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:17.668298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:17.668298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:17.668298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:17.668298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:17.668298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:17.668298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:17.669247 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:17.669247 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:17.669247 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:55:17.669247 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:55:17.669247 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:55:17.669247 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:55:17.669247 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:55:17.669247 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:55:17.669247 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 11:55:17.669247 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:17.669247 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 259/528] 10.222.0.79 () {56 vars in 1102 bytes} [Thu Jul 14 11:55:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:17.669778 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f284d3f-9dbb-4d39-94ba-252ae681b2a6 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:17.699562 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa4693-1240-4609-be35-ee6bc3dc243c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:17.700367 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa4693-1240-4609-be35-ee6bc3dc243c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:17.700661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa4693-1240-4609-be35-ee6bc3dc243c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:17.700943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa4693-1240-4609-be35-ee6bc3dc243c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:17.711670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa4693-1240-4609-be35-ee6bc3dc243c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:17.713153 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa4693-1240-4609-be35-ee6bc3dc243c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:17.743087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-5aaa4693-1240-4609-be35-ee6bc3dc243c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:17.743087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:17.743087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:17.743087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:17.743087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:17.743087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:17.743087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:17.743087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:17.743087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:17.743087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:17.743087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:17.743087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:17.743087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:17.743087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:17.743087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:17.744125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:17.744125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:17.744125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:17.744125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:17.744125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:17.744125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:17.744125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:17.744125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:17.744125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:17.744125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:17.744125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:17.744125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:17.744125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:17.744125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:17.744125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:17.744125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:17.744125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:17.745163 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:17.745163 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:17.745163 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:17.745163 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:17.751474 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 270/529] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:17.752601 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa4693-1240-4609-be35-ee6bc3dc243c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:17.779657 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f284d3f-9dbb-4d39-94ba-252ae681b2a6 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:17.787339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:17.819039 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c9558-d192-48ef-98ef-6753a80591c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:17.819852 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c9558-d192-48ef-98ef-6753a80591c1 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:17.820239 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c9558-d192-48ef-98ef-6753a80591c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:17.820618 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c9558-d192-48ef-98ef-6753a80591c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:17.821552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c9558-d192-48ef-98ef-6753a80591c1 None admin] RBAC: Adding query filter params (role.id=73743e14bfe849198f3a8b549163f32b, scope.project.id=66f531bc924b41faa64743923afac319, user.id=d6921990ec98492f8f4420f911208b84) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:17.822326 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c9558-d192-48ef-98ef-6753a80591c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:17.824234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c9558-d192-48ef-98ef-6753a80591c1 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:17.826172 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:17.830767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 260/530] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:55:17 2022] GET /identity/v3/role_assignments?user.id=d6921990ec98492f8f4420f911208b84&scope.project.id=66f531bc924b41faa64743923afac319&role.id=73743e14bfe849198f3a8b549163f32b => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:17.831738 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c9558-d192-48ef-98ef-6753a80591c1 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:17.874452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa4693-1240-4609-be35-ee6bc3dc243c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:17.934352 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6af3b9-d4a9-463f-86cd-4fbd518c4ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:17.935464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6af3b9-d4a9-463f-86cd-4fbd518c4ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:17.935969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6af3b9-d4a9-463f-86cd-4fbd518c4ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:17.936454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6af3b9-d4a9-463f-86cd-4fbd518c4ea7 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:17.937580 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6af3b9-d4a9-463f-86cd-4fbd518c4ea7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:17.938110 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6af3b9-d4a9-463f-86cd-4fbd518c4ea7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:17.939828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6af3b9-d4a9-463f-86cd-4fbd518c4ea7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:17.960191 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 271/531] 10.222.0.79 () {56 vars in 1139 bytes} [Thu Jul 14 11:55:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:17.966535 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c9558-d192-48ef-98ef-6753a80591c1 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:17.968067 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6af3b9-d4a9-463f-86cd-4fbd518c4ea7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:18.006604 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7c96d-e429-4778-b5a8-9f51882f743d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:18.006604 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7c96d-e429-4778-b5a8-9f51882f743d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:18.006604 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7c96d-e429-4778-b5a8-9f51882f743d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:18.006604 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7c96d-e429-4778-b5a8-9f51882f743d None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:18.006997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7c96d-e429-4778-b5a8-9f51882f743d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:18.006997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7c96d-e429-4778-b5a8-9f51882f743d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:18.006997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7c96d-e429-4778-b5a8-9f51882f743d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:18.017385 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 261/532] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:18.031675 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7c96d-e429-4778-b5a8-9f51882f743d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:18.117170 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6af3b9-d4a9-463f-86cd-4fbd518c4ea7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:18.137488 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:18.146930 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:18.157300 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc36a6-8e47-41be-90e7-0cfdb0c682ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:18.158187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc36a6-8e47-41be-90e7-0cfdb0c682ed None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:18.158672 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc36a6-8e47-41be-90e7-0cfdb0c682ed None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:18.159097 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc36a6-8e47-41be-90e7-0cfdb0c682ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:18.234517 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc36a6-8e47-41be-90e7-0cfdb0c682ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:18.236378 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc36a6-8e47-41be-90e7-0cfdb0c682ed None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:18.324853 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7c96d-e429-4778-b5a8-9f51882f743d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:18.346566 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 272/533] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:55:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:18.355966 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc36a6-8e47-41be-90e7-0cfdb0c682ed None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:18.389107 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1423a-e795-492e-9bb6-6bc95d71934c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:18.391778 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1423a-e795-492e-9bb6-6bc95d71934c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:18.392063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1423a-e795-492e-9bb6-6bc95d71934c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:18.392336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1423a-e795-492e-9bb6-6bc95d71934c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:18.394004 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:18.409121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1423a-e795-492e-9bb6-6bc95d71934c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:18.410620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1423a-e795-492e-9bb6-6bc95d71934c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:18.440817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-63c1423a-e795-492e-9bb6-6bc95d71934c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:18.440817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:18.440817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:18.440817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:18.440817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:18.440817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:18.440817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:18.440817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:18.440817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:18.440817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:18.440817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:18.440817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:18.440817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:55:18.440817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:55:18.440817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:55:18.441731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:55:18.441731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:18.441731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:18.441731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:18.441731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:18.441731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:18.441731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:18.441731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:18.441731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:18.441731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:18.441731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:18.441731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:18.441731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:18.441731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:18.441731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:18.441731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:18.441731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:18.442577 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:55:18.442577 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:55:18.442577 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:55:18.442577 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:55:18.442577 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:55:18.442577 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:55:18.442577 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:18.442577 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:18.444170 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 262/534] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:18.451058 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1423a-e795-492e-9bb6-6bc95d71934c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:18.555321 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc36a6-8e47-41be-90e7-0cfdb0c682ed None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:18.606603 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:18.609573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecc7c3-5978-4076-929c-d55403559696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:18.610374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecc7c3-5978-4076-929c-d55403559696 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:18.610708 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecc7c3-5978-4076-929c-d55403559696 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:18.610983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecc7c3-5978-4076-929c-d55403559696 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:18.617831 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1423a-e795-492e-9bb6-6bc95d71934c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:18.632886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbecc7c3-5978-4076-929c-d55403559696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:18.634358 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbecc7c3-5978-4076-929c-d55403559696 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:18.660483 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f331b-cac3-4e34-9b58-0ef9e19db989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:18.661546 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f331b-cac3-4e34-9b58-0ef9e19db989 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:18.662035 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f331b-cac3-4e34-9b58-0ef9e19db989 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:18.662532 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f331b-cac3-4e34-9b58-0ef9e19db989 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:18.663803 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f331b-cac3-4e34-9b58-0ef9e19db989 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:18.665200 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f331b-cac3-4e34-9b58-0ef9e19db989 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:18.667117 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f331b-cac3-4e34-9b58-0ef9e19db989 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:18.685152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-dbecc7c3-5978-4076-929c-d55403559696 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:18.685152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:18.685152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:18.685152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:18.685152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:18.685152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:18.685152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:18.685152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:18.685152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:18.685152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:18.685152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:18.685152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:18.685152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:18.685152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:18.685152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:18.686014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:18.686014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:18.686014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:18.686014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:18.686014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:18.686014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:18.686014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:18.686014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:18.686014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:18.686014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:18.686014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:18.686014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:18.686014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:18.686014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:18.686014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:18.686014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:18.686014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:18.686884 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:18.686884 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:18.686884 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:18.686884 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:18.689116 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 273/535] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:18.694341 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecc7c3-5978-4076-929c-d55403559696 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:18.700816 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 263/536] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:55:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:18.711523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f331b-cac3-4e34-9b58-0ef9e19db989 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:18.836296 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:18.875210 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f331b-cac3-4e34-9b58-0ef9e19db989 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:18.907891 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecc7c3-5978-4076-929c-d55403559696 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:18.911797 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c3375-d62c-443b-9b8e-f5749d86987c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:18.912463 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c3375-d62c-443b-9b8e-f5749d86987c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:18.912750 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c3375-d62c-443b-9b8e-f5749d86987c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:18.913032 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c3375-d62c-443b-9b8e-f5749d86987c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:18.913988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c3375-d62c-443b-9b8e-f5749d86987c None admin] RBAC: Adding query filter params (role.id=73743e14bfe849198f3a8b549163f32b, scope.project.id=66f531bc924b41faa64743923afac319, user.id=7deede571e7d42408c2fb86665eccfe7) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:18.914312 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c3375-d62c-443b-9b8e-f5749d86987c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:18.915804 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c3375-d62c-443b-9b8e-f5749d86987c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:18.926535 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 264/537] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:55:18 2022] GET /identity/v3/role_assignments?user.id=7deede571e7d42408c2fb86665eccfe7&scope.project.id=66f531bc924b41faa64743923afac319&role.id=73743e14bfe849198f3a8b549163f32b => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:18.977163 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa43e2e-2575-4164-950d-111ff3a9d6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:18.977854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa43e2e-2575-4164-950d-111ff3a9d6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:18.978142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa43e2e-2575-4164-950d-111ff3a9d6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:18.978423 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa43e2e-2575-4164-950d-111ff3a9d6d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:18.979208 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa43e2e-2575-4164-950d-111ff3a9d6d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:18.979555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa43e2e-2575-4164-950d-111ff3a9d6d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:18.980976 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa43e2e-2575-4164-950d-111ff3a9d6d5 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:19.004377 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 274/538] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:55:19.012178 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c3375-d62c-443b-9b8e-f5749d86987c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:19.035537 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:19.145219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c3375-d62c-443b-9b8e-f5749d86987c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:19.183104 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b21c2-bdaf-4a0f-a6e4-40bac3e34286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:19.183922 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b21c2-bdaf-4a0f-a6e4-40bac3e34286 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:19.184211 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b21c2-bdaf-4a0f-a6e4-40bac3e34286 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:19.184489 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b21c2-bdaf-4a0f-a6e4-40bac3e34286 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:19.191915 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b21c2-bdaf-4a0f-a6e4-40bac3e34286 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:19.193386 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b21c2-bdaf-4a0f-a6e4-40bac3e34286 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:19.209440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-5d2b21c2-bdaf-4a0f-a6e4-40bac3e34286 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:19.209440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:19.209440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:19.209440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:19.209440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:19.209440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:19.209440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:19.209440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:19.209440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:19.209440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:19.209440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:19.209440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:19.209440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:55:19.209440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:55:19.209440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:55:19.210329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:55:19.210329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:19.210329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:19.210329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:19.210329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:19.210329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:19.210329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:19.210329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:19.210329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:19.210329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:19.210329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:19.210329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:19.210329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:19.210329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:19.210329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:19.210329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:19.210329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:19.211220 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:55:19.211220 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:55:19.211220 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:55:19.211220 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:55:19.211220 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:55:19.211220 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:55:19.211220 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:19.211220 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:19.211220 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 265/539] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:19.217520 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa43e2e-2575-4164-950d-111ff3a9d6d5 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:19.351876 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa43e2e-2575-4164-950d-111ff3a9d6d5 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:19.391921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:19.396137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bda6d-ed3d-49b7-8cd1-b051b7eca7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:19.396759 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bda6d-ed3d-49b7-8cd1-b051b7eca7cb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:19.397042 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bda6d-ed3d-49b7-8cd1-b051b7eca7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:19.397468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bda6d-ed3d-49b7-8cd1-b051b7eca7cb None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:19.398321 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bda6d-ed3d-49b7-8cd1-b051b7eca7cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:19.398708 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bda6d-ed3d-49b7-8cd1-b051b7eca7cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:19.400196 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bda6d-ed3d-49b7-8cd1-b051b7eca7cb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:19.420668 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 275/540] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:55:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:19.427003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b21c2-bdaf-4a0f-a6e4-40bac3e34286 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:19.521496 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:19.528266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fbe76-655d-4bbb-8211-ae64d60bcf40 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:19.528886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fbe76-655d-4bbb-8211-ae64d60bcf40 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:19.529544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fbe76-655d-4bbb-8211-ae64d60bcf40 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:19.535008 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 276/541] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:55:19.536647 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f6f56-584c-495b-9702-21e1c76c5693 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:19.537134 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f6f56-584c-495b-9702-21e1c76c5693 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:19.537628 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f6f56-584c-495b-9702-21e1c76c5693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:19.549647 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b21c2-bdaf-4a0f-a6e4-40bac3e34286 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:19.574523 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-100f6f56-584c-495b-9702-21e1c76c5693 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:19.576528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-100f6f56-584c-495b-9702-21e1c76c5693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:19.585430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bfe4f-c011-4e25-9200-4c9b434698f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:19.586100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bfe4f-c011-4e25-9200-4c9b434698f2 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:19.586539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bfe4f-c011-4e25-9200-4c9b434698f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:19.587062 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bfe4f-c011-4e25-9200-4c9b434698f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:19.588123 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879bfe4f-c011-4e25-9200-4c9b434698f2 None admin] RBAC: Adding query filter params (role.id=73743e14bfe849198f3a8b549163f32b, scope.project.id=66f531bc924b41faa64743923afac319, user.id=2fedd4e015384379bf41c2e01ecc0a6a) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:19.589291 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879bfe4f-c011-4e25-9200-4c9b434698f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:19.591048 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879bfe4f-c011-4e25-9200-4c9b434698f2 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:19.597579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 266/542] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:55:19 2022] GET /identity/v3/role_assignments?user.id=2fedd4e015384379bf41c2e01ecc0a6a&scope.project.id=66f531bc924b41faa64743923afac319&role.id=73743e14bfe849198f3a8b549163f32b => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:19.679188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 277/543] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:19.723130 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bfe4f-c011-4e25-9200-4c9b434698f2 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:19.840886 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bfe4f-c011-4e25-9200-4c9b434698f2 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:19.878714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87bf3b-7aea-4196-9595-e6c10d66c6b4 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:19.879344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87bf3b-7aea-4196-9595-e6c10d66c6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:19.879818 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87bf3b-7aea-4196-9595-e6c10d66c6b4 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:19.883236 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 278/544] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:19.888786 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1934589-92cd-41ad-aea9-86a0d8ea6a1f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:19.889110 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cd3d6-da53-4810-ab65-b4d3c0867642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:19.889571 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1934589-92cd-41ad-aea9-86a0d8ea6a1f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:19.889985 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cd3d6-da53-4810-ab65-b4d3c0867642 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:19.890243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1934589-92cd-41ad-aea9-86a0d8ea6a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:19.890362 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cd3d6-da53-4810-ab65-b4d3c0867642 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:19.890568 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cd3d6-da53-4810-ab65-b4d3c0867642 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:19.899369 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:19.904720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cd3d6-da53-4810-ab65-b4d3c0867642 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:19.911754 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a1934589-92cd-41ad-aea9-86a0d8ea6a1f None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:19.913197 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a1934589-92cd-41ad-aea9-86a0d8ea6a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:19.913338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-925cd3d6-da53-4810-ab65-b4d3c0867642 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:19.913338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:19.913338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:19.913338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:19.913338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:19.913338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:19.913338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:19.913338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:19.913338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:19.913338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:19.913338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:19.913338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:19.913338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:19.913338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:19.913338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:19.913338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:19.914146 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:19.914146 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:19.914146 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:19.914146 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:19.914146 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:19.914146 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:19.914146 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:19.914146 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:19.914146 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:19.914146 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:19.914146 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:19.914146 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:19.914146 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:19.914146 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:19.914146 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:19.914146 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:19.915136 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:19.915136 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:19.915136 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:19.915136 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:19.915136 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:19.915136 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:19.915136 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:19.915136 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:19.915136 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:19.915136 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:19.915136 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:19.915136 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:19.915136 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 267/545] 10.222.0.79 () {56 vars in 1102 bytes} [Thu Jul 14 11:55:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:19.923535 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cd3d6-da53-4810-ab65-b4d3c0867642 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:20.032689 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cd3d6-da53-4810-ab65-b4d3c0867642 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:20.032991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 279/546] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:55:20.070140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de8859-6b12-40ae-ad3a-6827c5b6edde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:20.071210 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de8859-6b12-40ae-ad3a-6827c5b6edde None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:20.071723 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de8859-6b12-40ae-ad3a-6827c5b6edde None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:20.072202 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de8859-6b12-40ae-ad3a-6827c5b6edde None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:20.073282 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de8859-6b12-40ae-ad3a-6827c5b6edde None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:20.073794 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de8859-6b12-40ae-ad3a-6827c5b6edde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:20.075432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de8859-6b12-40ae-ad3a-6827c5b6edde None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:20.078378 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1934589-92cd-41ad-aea9-86a0d8ea6a1f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:20.086537 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 268/547] 10.222.0.79 () {56 vars in 1103 bytes} [Thu Jul 14 11:55:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:20.090250 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de8859-6b12-40ae-ad3a-6827c5b6edde None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:20.169596 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:20.199487 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:20.236955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1934589-92cd-41ad-aea9-86a0d8ea6a1f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:20.253880 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de8859-6b12-40ae-ad3a-6827c5b6edde None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:20.275329 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435db901-0120-442b-802a-ca33e5f5c1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:20.276687 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435db901-0120-442b-802a-ca33e5f5c1cd None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:20.277076 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435db901-0120-442b-802a-ca33e5f5c1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:20.277573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435db901-0120-442b-802a-ca33e5f5c1cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:20.289096 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435db901-0120-442b-802a-ca33e5f5c1cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:20.295094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93486d6e-4002-4341-8fcb-31023bcffb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:20.296018 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93486d6e-4002-4341-8fcb-31023bcffb65 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:20.296371 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93486d6e-4002-4341-8fcb-31023bcffb65 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:20.296717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93486d6e-4002-4341-8fcb-31023bcffb65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:20.298630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-435db901-0120-442b-802a-ca33e5f5c1cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:20.298630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:20.298630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:20.298630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:20.298630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:20.298630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:20.298630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:20.298630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:20.298630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:20.298630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:20.298630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:20.298630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:20.298630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:20.298630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:20.298630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:20.298630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:20.299537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:20.299537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:20.299537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:20.299537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:20.299537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:20.299537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:20.299537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:20.299537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:20.299537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:20.299537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:20.299537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:20.299537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:20.299537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:20.299537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:20.299537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:20.299537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:20.300304 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:20.300304 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:20.300304 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:20.300304 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:20.300304 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:20.300304 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:20.300304 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:20.300304 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:20.300304 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:20.300304 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:20.300304 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:20.300304 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:20.303629 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 280/548] 10.222.0.79 () {56 vars in 1102 bytes} [Thu Jul 14 11:55:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:55:20.305326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833d3f6-cffe-407e-928e-e374cb198a60 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:20.305790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833d3f6-cffe-407e-928e-e374cb198a60 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:20.306232 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833d3f6-cffe-407e-928e-e374cb198a60 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:20.308762 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 281/549] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:20.310240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833d3f6-cffe-407e-928e-e374cb198a60 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:20.317691 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93486d6e-4002-4341-8fcb-31023bcffb65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:20.319447 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93486d6e-4002-4341-8fcb-31023bcffb65 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:20.343063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-93486d6e-4002-4341-8fcb-31023bcffb65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:20.343063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:20.343063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:20.343063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:20.343063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:20.343063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:20.343063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:20.343063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:20.343063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:20.343063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:20.343063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:20.343063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:20.343063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:20.343063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:20.343063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:20.344476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:20.344476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:20.344476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:20.344476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:20.344476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:20.344476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:20.344476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:20.344476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:20.344476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:20.344476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:20.344476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:20.344476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:20.344476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:20.344476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:20.344476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:20.344476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:20.344476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:20.345491 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:20.345491 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:20.345491 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:20.345491 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:20.345491 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 269/550] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:55:20.346869 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50882354-2c14-4843-a505-2ec32be1620e None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:20.347223 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50882354-2c14-4843-a505-2ec32be1620e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:20.347581 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50882354-2c14-4843-a505-2ec32be1620e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:20.370528 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-50882354-2c14-4843-a505-2ec32be1620e None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:20.370528 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-50882354-2c14-4843-a505-2ec32be1620e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:20.438561 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833d3f6-cffe-407e-928e-e374cb198a60 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:20.453294 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:20.462163 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 270/551] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:20.463669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50882354-2c14-4843-a505-2ec32be1620e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:20.497079 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326ce06-7080-46fa-b9bb-257d7c0bae71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:20.498035 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326ce06-7080-46fa-b9bb-257d7c0bae71 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:20.498461 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326ce06-7080-46fa-b9bb-257d7c0bae71 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:20.498915 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326ce06-7080-46fa-b9bb-257d7c0bae71 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:20.499820 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326ce06-7080-46fa-b9bb-257d7c0bae71 None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:20.500269 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326ce06-7080-46fa-b9bb-257d7c0bae71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:20.501787 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326ce06-7080-46fa-b9bb-257d7c0bae71 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:20.511345 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 282/552] 10.222.0.79 () {56 vars in 1103 bytes} [Thu Jul 14 11:55:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:20.512486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326ce06-7080-46fa-b9bb-257d7c0bae71 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:20.531274 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:20.598760 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50882354-2c14-4843-a505-2ec32be1620e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:20.617740 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326ce06-7080-46fa-b9bb-257d7c0bae71 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:20.638874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d50734-ce13-4349-9384-cf8172c36942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:20.639866 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d50734-ce13-4349-9384-cf8172c36942 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:20.640353 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d50734-ce13-4349-9384-cf8172c36942 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:20.640847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d50734-ce13-4349-9384-cf8172c36942 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:20.641870 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d50734-ce13-4349-9384-cf8172c36942 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:20.642454 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d50734-ce13-4349-9384-cf8172c36942 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:20.644053 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d50734-ce13-4349-9384-cf8172c36942 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:20.653701 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b88bc-4a7c-4ac4-a646-534552260012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:20.654480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b88bc-4a7c-4ac4-a646-534552260012 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:20.654789 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b88bc-4a7c-4ac4-a646-534552260012 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:20.655062 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b88bc-4a7c-4ac4-a646-534552260012 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:20.659634 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 271/553] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:20.660705 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d50734-ce13-4349-9384-cf8172c36942 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:20.671519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b88bc-4a7c-4ac4-a646-534552260012 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:20.679384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-a53b88bc-4a7c-4ac4-a646-534552260012 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:20.679384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:20.679384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:20.679384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:20.679384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:20.679384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:20.679384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:20.679384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:20.679384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:20.679384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:20.679384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:20.679384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:20.679384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:20.679384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:20.679384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:20.679384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:20.680394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:20.680394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:20.680394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:20.680394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:20.680394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:20.680394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:20.680394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:20.680394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:20.680394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:20.680394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:20.680394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:20.680394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:20.680394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:20.680394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:20.680394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:20.680394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:20.681573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:20.681573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:20.681573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:20.681573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:20.681573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:20.681573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:20.681573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:20.681573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:20.681573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:20.681573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:20.681573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:20.681573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:20.685742 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 283/554] 10.222.0.79 () {56 vars in 1102 bytes} [Thu Jul 14 11:55:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:20.686435 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b88bc-4a7c-4ac4-a646-534552260012 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:20.719217 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:20.781163 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d50734-ce13-4349-9384-cf8172c36942 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:20.783567 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:20.796133 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b88bc-4a7c-4ac4-a646-534552260012 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:20.823479 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783782da-e2cb-4253-96b4-5dfd6041b575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:20.824685 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783782da-e2cb-4253-96b4-5dfd6041b575 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:20.825168 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783782da-e2cb-4253-96b4-5dfd6041b575 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:20.825662 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783782da-e2cb-4253-96b4-5dfd6041b575 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:20.832043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f565c-a6b2-4e49-9124-24f1e11e0271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:20.833040 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f565c-a6b2-4e49-9124-24f1e11e0271 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:20.833324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f565c-a6b2-4e49-9124-24f1e11e0271 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:20.833600 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f565c-a6b2-4e49-9124-24f1e11e0271 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:20.839483 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783782da-e2cb-4253-96b4-5dfd6041b575 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:20.841250 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783782da-e2cb-4253-96b4-5dfd6041b575 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:20.842688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f565c-a6b2-4e49-9124-24f1e11e0271 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:20.844153 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f565c-a6b2-4e49-9124-24f1e11e0271 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:20.858985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f40f565c-a6b2-4e49-9124-24f1e11e0271 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 11:55:20.858985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:20.858985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:20.858985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:20.858985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:20.858985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:20.858985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:20.858985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:20.858985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:20.858985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:20.858985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:20.858985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:20.858985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:55:20.858985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:55:20.858985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:55:20.858985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:55:20.860018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:20.860018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:20.860018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:55:20.860018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:20.860018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:55:20.860018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:20.860018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:20.860018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:20.860018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:20.860018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:20.860018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:20.860018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:20.860018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:20.860018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:20.860018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:20.860018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:20.860018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:20.860018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:20.860917 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:20.860917 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:20.860917 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:55:20.860917 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:55:20.860917 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:55:20.860917 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:55:20.860917 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:55:20.860917 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:55:20.860917 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 11:55:20.860917 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:20.860917 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 284/555] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:55:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:20.860917 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f565c-a6b2-4e49-9124-24f1e11e0271 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:20.863724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-783782da-e2cb-4253-96b4-5dfd6041b575 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:20.863724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:20.863724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:20.863724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:20.863724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:20.863724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:20.863724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:20.863724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:20.863724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:20.863724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:20.863724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:20.863724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:20.863724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:20.863724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:20.863724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:20.864579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:20.864579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:20.864579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:20.864579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:20.864579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:20.864579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:20.864579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:20.864579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:20.864579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:20.864579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:20.864579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:20.864579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:20.864579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:20.864579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:20.864579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:20.864579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:20.864579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:20.865901 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:20.865901 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:20.865901 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:20.865901 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:20.873204 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 272/556] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:20.874404 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783782da-e2cb-4253-96b4-5dfd6041b575 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:20.967174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:20.977443 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f565c-a6b2-4e49-9124-24f1e11e0271 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:21.008119 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783782da-e2cb-4253-96b4-5dfd6041b575 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:21.014244 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfbeb3-15d3-414a-87a4-004e750d62fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:21.015051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfbeb3-15d3-414a-87a4-004e750d62fd None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:21.015401 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfbeb3-15d3-414a-87a4-004e750d62fd None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:21.015890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfbeb3-15d3-414a-87a4-004e750d62fd None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:21.016750 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfbeb3-15d3-414a-87a4-004e750d62fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:21.017130 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfbeb3-15d3-414a-87a4-004e750d62fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:21.018833 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfbeb3-15d3-414a-87a4-004e750d62fd None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:21.028195 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 285/557] 10.222.0.79 () {56 vars in 1103 bytes} [Thu Jul 14 11:55:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:21.033958 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfbeb3-15d3-414a-87a4-004e750d62fd None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:21.048495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5691bd-41ba-47fb-8352-57e782ec5fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:21.049488 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5691bd-41ba-47fb-8352-57e782ec5fdb None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:21.049946 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5691bd-41ba-47fb-8352-57e782ec5fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:21.050392 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5691bd-41ba-47fb-8352-57e782ec5fdb None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:21.051424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5691bd-41ba-47fb-8352-57e782ec5fdb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:21.052254 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5691bd-41ba-47fb-8352-57e782ec5fdb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:21.053881 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5691bd-41ba-47fb-8352-57e782ec5fdb None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:21.074753 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 273/558] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Jul 14 11:55:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:21.075920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5691bd-41ba-47fb-8352-57e782ec5fdb None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:21.091412 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:21.167776 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfbeb3-15d3-414a-87a4-004e750d62fd None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:21.196186 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5691bd-41ba-47fb-8352-57e782ec5fdb None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:21.203184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad891b-8dc6-4051-bfde-72d965329956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:21.203852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad891b-8dc6-4051-bfde-72d965329956 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:21.204135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad891b-8dc6-4051-bfde-72d965329956 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:21.204410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad891b-8dc6-4051-bfde-72d965329956 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:21.205130 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad891b-8dc6-4051-bfde-72d965329956 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:21.205435 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad891b-8dc6-4051-bfde-72d965329956 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:21.206960 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad891b-8dc6-4051-bfde-72d965329956 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:21.223900 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 286/559] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:21.223900 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad891b-8dc6-4051-bfde-72d965329956 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:21.242511 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:21.249611 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96c140-9338-4bc2-98ee-1332b04957f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:21.251012 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96c140-9338-4bc2-98ee-1332b04957f8 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:21.251552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96c140-9338-4bc2-98ee-1332b04957f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:21.252047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96c140-9338-4bc2-98ee-1332b04957f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:21.265558 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96c140-9338-4bc2-98ee-1332b04957f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:21.267393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96c140-9338-4bc2-98ee-1332b04957f8 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:21.288621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-3d96c140-9338-4bc2-98ee-1332b04957f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:21.288621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:21.288621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:21.288621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:21.288621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:21.288621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:21.288621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:21.288621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:21.288621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:21.288621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:21.288621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:21.288621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:21.288621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:21.288621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:21.288621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:21.289553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:21.289553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:21.289553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:21.289553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:21.289553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:21.289553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:21.289553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:21.289553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:21.289553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:21.289553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:21.289553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:21.289553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:21.289553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:21.289553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:21.289553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:21.289553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:21.289553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:21.290414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:21.290414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:21.290414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:21.290414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:21.293379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 274/560] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:21.294526 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96c140-9338-4bc2-98ee-1332b04957f8 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:21.339503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad891b-8dc6-4051-bfde-72d965329956 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:21.365483 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:21.376459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd0006-ca1d-410f-83b8-7b3df985b04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:21.377273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd0006-ca1d-410f-83b8-7b3df985b04a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:21.377567 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd0006-ca1d-410f-83b8-7b3df985b04a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:21.377841 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd0006-ca1d-410f-83b8-7b3df985b04a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:21.410845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96c140-9338-4bc2-98ee-1332b04957f8 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:21.451297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a728d-8c8a-467c-8aca-9234f40cb600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:21.452399 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a728d-8c8a-467c-8aca-9234f40cb600 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:21.452834 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a728d-8c8a-467c-8aca-9234f40cb600 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:21.453120 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a728d-8c8a-467c-8aca-9234f40cb600 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:21.455303 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd0006-ca1d-410f-83b8-7b3df985b04a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:21.457665 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd0006-ca1d-410f-83b8-7b3df985b04a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:21.464587 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a728d-8c8a-467c-8aca-9234f40cb600 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:21.466456 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a728d-8c8a-467c-8aca-9234f40cb600 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:21.478094 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:21.483022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-f20a728d-8c8a-467c-8aca-9234f40cb600 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:55:21.483022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:21.483022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:21.483022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:21.483022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:21.483022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:21.483022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:21.483022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:21.483022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:21.483022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:21.483022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:21.483022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:21.483022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:55:21.483022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:55:21.483022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:55:21.483022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:55:21.483997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:21.483997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:21.483997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:55:21.483997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:21.483997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:55:21.483997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:21.483997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:21.483997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:21.483997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:21.483997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:21.483997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:21.483997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:21.483997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:21.483997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:21.483997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:21.483997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:21.483997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:21.483997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:21.484907 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:21.484907 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:21.484907 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:55:21.484907 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:55:21.484907 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:55:21.484907 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:55:21.484907 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:55:21.484907 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:55:21.484907 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:55:21.484907 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:21.488928 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 275/561] 10.222.0.79 () {56 vars in 1093 bytes} [Thu Jul 14 11:55:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:21.489796 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a728d-8c8a-467c-8aca-9234f40cb600 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:21.575160 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 287/562] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:55:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:21.576506 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0f8bd-275e-4031-a3b9-ba09bbbe6aa8 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:21.576795 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0f8bd-275e-4031-a3b9-ba09bbbe6aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:21.577071 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0f8bd-275e-4031-a3b9-ba09bbbe6aa8 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:21.582424 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 288/563] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:21.582424 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0f8bd-275e-4031-a3b9-ba09bbbe6aa8 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:21.606342 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a728d-8c8a-467c-8aca-9234f40cb600 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:21.629883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:21.643715 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fb089-106d-4984-b599-54106267946d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:21.644368 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fb089-106d-4984-b599-54106267946d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:21.644652 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fb089-106d-4984-b599-54106267946d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:21.644924 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fb089-106d-4984-b599-54106267946d None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:21.645691 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fb089-106d-4984-b599-54106267946d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:21.645932 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fb089-106d-4984-b599-54106267946d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:21.647529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fb089-106d-4984-b599-54106267946d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:21.666080 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 276/564] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:21.666080 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fb089-106d-4984-b599-54106267946d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:21.692380 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0f8bd-275e-4031-a3b9-ba09bbbe6aa8 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:21.707735 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:21.735700 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ed7aa-cdd8-4aab-a850-4034634c88cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:21.738536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ed7aa-cdd8-4aab-a850-4034634c88cb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:21.738536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ed7aa-cdd8-4aab-a850-4034634c88cb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:21.738536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ed7aa-cdd8-4aab-a850-4034634c88cb None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:21.738536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ed7aa-cdd8-4aab-a850-4034634c88cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:21.738536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ed7aa-cdd8-4aab-a850-4034634c88cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:21.739527 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ed7aa-cdd8-4aab-a850-4034634c88cb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:21.759133 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 289/565] 10.222.0.79 () {56 vars in 1133 bytes} [Thu Jul 14 11:55:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:21.760539 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ee7f3-9529-4634-bcfa-0ca638274474 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:21.761365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ee7f3-9529-4634-bcfa-0ca638274474 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:21.761645 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ee7f3-9529-4634-bcfa-0ca638274474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:21.778044 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-7e3ee7f3-9529-4634-bcfa-0ca638274474 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:21.779296 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7e3ee7f3-9529-4634-bcfa-0ca638274474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:21.787153 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fb089-106d-4984-b599-54106267946d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:21.826960 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6c702-7689-466c-9258-900369ba8380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:21.828025 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6c702-7689-466c-9258-900369ba8380 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:21.828306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6c702-7689-466c-9258-900369ba8380 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:21.828645 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6c702-7689-466c-9258-900369ba8380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:21.839622 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6c702-7689-466c-9258-900369ba8380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:21.841071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6c702-7689-466c-9258-900369ba8380 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:21.858522 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 290/566] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:21.858522 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ee7f3-9529-4634-bcfa-0ca638274474 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:21.867284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-91e6c702-7689-466c-9258-900369ba8380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:21.867284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:21.867284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:21.867284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:21.867284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:21.867284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:21.867284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:21.867284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:21.867284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:21.867284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:21.867284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:21.867284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:21.867284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:21.867284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:21.867284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:21.868236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:21.868236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:21.868236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:21.868236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:21.868236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:21.868236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:21.868236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:21.868236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:21.868236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:21.868236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:21.868236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:21.868236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:21.868236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:21.868236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:21.868236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:21.868236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:21.868236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:21.869083 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:21.869083 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:21.869083 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:21.869083 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:21.869083 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 277/567] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:21.869718 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6c702-7689-466c-9258-900369ba8380 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:21.912123 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:21.965962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ee7f3-9529-4634-bcfa-0ca638274474 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:21.967441 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:21.978321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6c702-7689-466c-9258-900369ba8380 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:22.000609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbe62b-13b6-4c74-bc85-ad49416ab649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:22.001407 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbe62b-13b6-4c74-bc85-ad49416ab649 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:22.001701 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbe62b-13b6-4c74-bc85-ad49416ab649 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:22.001978 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbe62b-13b6-4c74-bc85-ad49416ab649 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:22.009367 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dbe62b-13b6-4c74-bc85-ad49416ab649 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:22.011389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dbe62b-13b6-4c74-bc85-ad49416ab649 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:22.012409 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f22e98-cf5c-4fcc-8a5e-207e0fb815e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:22.013200 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f22e98-cf5c-4fcc-8a5e-207e0fb815e6 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:22.013484 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f22e98-cf5c-4fcc-8a5e-207e0fb815e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:22.013762 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f22e98-cf5c-4fcc-8a5e-207e0fb815e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:22.024167 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f22e98-cf5c-4fcc-8a5e-207e0fb815e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:22.025616 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f22e98-cf5c-4fcc-8a5e-207e0fb815e6 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:22.026638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-84dbe62b-13b6-4c74-bc85-ad49416ab649 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 11:55:22.026638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:22.026638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:22.026638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:22.026638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:22.026638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:22.026638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:22.026638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:22.026638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:22.026638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:22.026638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:22.026638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:22.026638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:55:22.026638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:55:22.026638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:55:22.026638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:55:22.027659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:22.027659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:22.027659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:55:22.027659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:22.027659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:55:22.027659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:22.027659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:22.027659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:22.027659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:22.027659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:22.027659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:22.027659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:22.027659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:22.027659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:22.027659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:22.027659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:22.027659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:22.027659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:22.028587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:22.028587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:22.028587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:55:22.028587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:55:22.028587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:55:22.028587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:55:22.028587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:55:22.028587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:55:22.028587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 11:55:22.028587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:22.028587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 291/568] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:55:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:22.029153 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd3484-8fd9-4866-8027-648165b26f51 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:22.029419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd3484-8fd9-4866-8027-648165b26f51 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:22.029747 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd3484-8fd9-4866-8027-648165b26f51 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:22.030954 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 292/569] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:22.034537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd3484-8fd9-4866-8027-648165b26f51 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:22.050653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-70f22e98-cf5c-4fcc-8a5e-207e0fb815e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:22.050653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:22.050653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:22.050653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:22.050653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:22.050653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:22.050653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:22.050653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:22.050653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:22.050653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:22.050653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:22.050653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:22.050653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:22.050653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:22.050653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:22.051878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:22.051878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:22.051878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:22.051878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:22.051878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:22.051878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:22.051878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:22.051878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:22.051878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:22.051878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:22.051878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:22.051878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:22.051878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:22.051878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:22.051878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:22.051878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:22.051878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:22.052738 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:22.052738 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:22.052738 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:22.052738 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:22.052738 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 278/570] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:22.053015 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f22e98-cf5c-4fcc-8a5e-207e0fb815e6 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:22.136189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd3484-8fd9-4866-8027-648165b26f51 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:22.139728 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:22.151901 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f22e98-cf5c-4fcc-8a5e-207e0fb815e6 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:22.171786 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d999674-32ee-4e66-8a6c-6b978180d48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:22.172455 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d999674-32ee-4e66-8a6c-6b978180d48b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:22.172737 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d999674-32ee-4e66-8a6c-6b978180d48b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:22.173008 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d999674-32ee-4e66-8a6c-6b978180d48b None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:22.173731 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d999674-32ee-4e66-8a6c-6b978180d48b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:22.174037 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d999674-32ee-4e66-8a6c-6b978180d48b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:22.175517 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d999674-32ee-4e66-8a6c-6b978180d48b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:22.186822 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1797f-9437-42bb-b061-7cb9ace4c55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:22.187504 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 293/571] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:22.187643 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1797f-9437-42bb-b061-7cb9ace4c55d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:22.187877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1797f-9437-42bb-b061-7cb9ace4c55d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:22.188151 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1797f-9437-42bb-b061-7cb9ace4c55d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:22.188315 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d999674-32ee-4e66-8a6c-6b978180d48b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:22.200244 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1797f-9437-42bb-b061-7cb9ace4c55d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:22.208000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-37c1797f-9437-42bb-b061-7cb9ace4c55d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:22.208000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:22.208000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:22.208000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:22.208000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:22.208000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:22.208000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:22.208000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:22.208000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:22.208000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:22.208000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:22.208000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:22.208000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:22.208000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:22.208000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:22.208000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:22.209001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:22.209001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:22.209001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:22.209001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:22.209001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:22.209001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:22.209001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:22.209001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:22.209001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:22.209001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:22.209001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:22.209001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:22.209001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:22.209001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:22.209001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:22.209001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:22.209817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:22.209817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:22.209817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:22.209817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:22.209817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:22.209817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:22.209817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:22.209817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:22.209817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:22.209817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:22.209817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:22.209817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:22.209817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 279/572] 10.222.0.79 () {56 vars in 1102 bytes} [Thu Jul 14 11:55:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:22.210804 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f739272-8ee6-432a-9489-b8396a398121 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:22.211132 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f739272-8ee6-432a-9489-b8396a398121 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:22.211349 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f739272-8ee6-432a-9489-b8396a398121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:22.217846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:22.234722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-5f739272-8ee6-432a-9489-b8396a398121 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:22.235962 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5f739272-8ee6-432a-9489-b8396a398121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:22.294639 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d999674-32ee-4e66-8a6c-6b978180d48b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:22.302800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 280/573] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:22.303858 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f739272-8ee6-432a-9489-b8396a398121 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:22.328650 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92434e0d-a93c-416e-a163-fe5363c0c628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:22.329326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92434e0d-a93c-416e-a163-fe5363c0c628 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:22.329604 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92434e0d-a93c-416e-a163-fe5363c0c628 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:22.329883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92434e0d-a93c-416e-a163-fe5363c0c628 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:22.330755 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92434e0d-a93c-416e-a163-fe5363c0c628 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:22.331078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92434e0d-a93c-416e-a163-fe5363c0c628 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:22.332481 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92434e0d-a93c-416e-a163-fe5363c0c628 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:22.350455 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 294/574] 10.222.0.79 () {56 vars in 1137 bytes} [Thu Jul 14 11:55:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:22.351311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92434e0d-a93c-416e-a163-fe5363c0c628 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:22.391606 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:22.414699 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f739272-8ee6-432a-9489-b8396a398121 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:22.433110 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:22.450634 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f14bc-df35-4a9f-833b-f90a9df7091e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:22.451301 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f14bc-df35-4a9f-833b-f90a9df7091e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:22.451588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f14bc-df35-4a9f-833b-f90a9df7091e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:22.451867 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f14bc-df35-4a9f-833b-f90a9df7091e None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:22.452554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92434e0d-a93c-416e-a163-fe5363c0c628 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:22.452671 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f14bc-df35-4a9f-833b-f90a9df7091e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:22.452893 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f14bc-df35-4a9f-833b-f90a9df7091e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:22.454292 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f14bc-df35-4a9f-833b-f90a9df7091e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:22.465355 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 281/575] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:22.466697 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f14bc-df35-4a9f-833b-f90a9df7091e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:22.491432 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a4d65-34fa-47db-927e-9aa4e8e776be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:22.492152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a4d65-34fa-47db-927e-9aa4e8e776be None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:22.492433 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a4d65-34fa-47db-927e-9aa4e8e776be None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:22.492701 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a4d65-34fa-47db-927e-9aa4e8e776be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:22.499956 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a4d65-34fa-47db-927e-9aa4e8e776be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:22.501400 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a4d65-34fa-47db-927e-9aa4e8e776be None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:22.515440 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f31a4d65-34fa-47db-927e-9aa4e8e776be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:22.515440 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:22.515440 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:22.515440 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:22.515440 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:22.515440 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:22.515440 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:22.515440 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:22.515440 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:22.515440 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:22.515440 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:22.515440 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:22.515440 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:55:22.515440 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:55:22.515440 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:55:22.516556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:55:22.516556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:22.516556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:22.516556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:22.516556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:22.516556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:22.516556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:22.516556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:22.516556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:22.516556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:22.516556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:22.516556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:22.516556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:22.516556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:22.516556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:22.516556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:22.516556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:22.517476 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:55:22.517476 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:55:22.517476 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:55:22.517476 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:55:22.517476 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:55:22.517476 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:55:22.517476 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:22.517476 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:22.517476 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 295/576] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:22.517476 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a4d65-34fa-47db-927e-9aa4e8e776be None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:22.569217 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f14bc-df35-4a9f-833b-f90a9df7091e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:22.605202 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92980a-5686-46fa-8953-1a761f55f9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:22.605862 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92980a-5686-46fa-8953-1a761f55f9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:22.606143 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92980a-5686-46fa-8953-1a761f55f9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:22.606416 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92980a-5686-46fa-8953-1a761f55f9a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:22.607178 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92980a-5686-46fa-8953-1a761f55f9a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:22.607485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92980a-5686-46fa-8953-1a761f55f9a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:22.608850 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92980a-5686-46fa-8953-1a761f55f9a9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:22.613859 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:22.622885 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 282/577] 10.222.0.79 () {56 vars in 1103 bytes} [Thu Jul 14 11:55:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:22.622885 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92980a-5686-46fa-8953-1a761f55f9a9 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:22.629285 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a4d65-34fa-47db-927e-9aa4e8e776be None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:22.664791 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183f04e-c98a-4980-9afe-58037bbb9eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:22.665595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183f04e-c98a-4980-9afe-58037bbb9eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:22.665881 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183f04e-c98a-4980-9afe-58037bbb9eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:22.666153 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183f04e-c98a-4980-9afe-58037bbb9eb2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:22.673822 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:22.678039 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183f04e-c98a-4980-9afe-58037bbb9eb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:22.686711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-7183f04e-c98a-4980-9afe-58037bbb9eb2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:22.686711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:22.686711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:22.686711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:22.686711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:22.686711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:22.686711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:22.686711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:22.686711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:22.686711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:22.686711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:22.686711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:22.686711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:22.686711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:22.686711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:22.686711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:22.687618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:22.687618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:22.687618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:22.687618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:22.687618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:22.687618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:22.687618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:22.687618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:22.687618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:22.687618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:22.687618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:22.687618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:22.687618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:22.687618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:22.687618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:22.687618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:22.688442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:22.688442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:22.688442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:22.688442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:22.688442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:22.688442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:22.688442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:22.688442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:22.688442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:22.688442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:22.688442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:22.688442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:22.688442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 296/578] 10.222.0.79 () {56 vars in 1102 bytes} [Thu Jul 14 11:55:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:22.689100 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183f04e-c98a-4980-9afe-58037bbb9eb2 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:22.724836 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92980a-5686-46fa-8953-1a761f55f9a9 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:22.758215 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb486a-04f9-42e9-8341-e510abba2e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:22.758982 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb486a-04f9-42e9-8341-e510abba2e99 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:22.759261 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb486a-04f9-42e9-8341-e510abba2e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:22.759536 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb486a-04f9-42e9-8341-e510abba2e99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:22.774694 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb486a-04f9-42e9-8341-e510abba2e99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:22.776189 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb486a-04f9-42e9-8341-e510abba2e99 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:22.787948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183f04e-c98a-4980-9afe-58037bbb9eb2 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:22.794720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-53cb486a-04f9-42e9-8341-e510abba2e99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:22.794720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:22.794720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:22.794720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:22.794720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:22.794720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:22.794720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:22.794720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:22.794720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:22.794720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:22.794720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:22.794720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:22.794720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:22.794720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:22.794720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:22.795936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:22.795936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:22.795936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:22.795936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:22.795936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:22.795936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:22.795936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:22.795936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:22.795936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:22.795936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:22.795936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:22.795936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:22.795936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:22.795936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:22.795936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:22.795936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:22.795936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:22.796816 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:22.796816 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:22.796816 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:22.796816 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:22.796816 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 283/579] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:22.796816 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb486a-04f9-42e9-8341-e510abba2e99 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:22.829175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1430301-891d-4ebb-993a-b1677415b4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:22.829981 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1430301-891d-4ebb-993a-b1677415b4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:22.830243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1430301-891d-4ebb-993a-b1677415b4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:22.830554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1430301-891d-4ebb-993a-b1677415b4a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:22.837283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1430301-891d-4ebb-993a-b1677415b4a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:22.838783 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1430301-891d-4ebb-993a-b1677415b4a6 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:22.849161 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:22.852558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-e1430301-891d-4ebb-993a-b1677415b4a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:22.852558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:22.852558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:22.852558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:22.852558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:22.852558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:22.852558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:22.852558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:22.852558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:22.852558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:22.852558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:22.852558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:22.852558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:55:22.852558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:55:22.852558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:55:22.853673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:55:22.853673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:22.853673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:22.853673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:22.853673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:22.853673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:22.853673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:22.853673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:22.853673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:22.853673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:22.853673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:22.853673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:22.853673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:22.853673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:22.853673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:22.853673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:22.853673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:22.859887 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:55:22.859887 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:55:22.859887 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:55:22.859887 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:55:22.859887 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:55:22.859887 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:55:22.859887 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:22.859887 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:22.859887 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 297/580] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:22.859887 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1430301-891d-4ebb-993a-b1677415b4a6 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:22.897718 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb486a-04f9-42e9-8341-e510abba2e99 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:22.919324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:22.931264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1f375-a7aa-4266-b1a4-d6b9f9102150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:22.931929 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1f375-a7aa-4266-b1a4-d6b9f9102150 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:22.932209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1f375-a7aa-4266-b1a4-d6b9f9102150 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:22.933086 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1f375-a7aa-4266-b1a4-d6b9f9102150 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:22.933942 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1f375-a7aa-4266-b1a4-d6b9f9102150 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:22.934171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1f375-a7aa-4266-b1a4-d6b9f9102150 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:22.935662 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1f375-a7aa-4266-b1a4-d6b9f9102150 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:22.947378 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 284/581] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:55:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:22.948187 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1f375-a7aa-4266-b1a4-d6b9f9102150 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:22.962007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1430301-891d-4ebb-993a-b1677415b4a6 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:22.996544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef3b7f-cb87-4f8d-b7e0-3d12a624bbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:22.997420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef3b7f-cb87-4f8d-b7e0-3d12a624bbb8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:22.997711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef3b7f-cb87-4f8d-b7e0-3d12a624bbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:22.997985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef3b7f-cb87-4f8d-b7e0-3d12a624bbb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:23.008937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef3b7f-cb87-4f8d-b7e0-3d12a624bbb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:23.010306 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef3b7f-cb87-4f8d-b7e0-3d12a624bbb8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:23.027616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-beef3b7f-cb87-4f8d-b7e0-3d12a624bbb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:23.027616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:23.027616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:23.027616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:23.027616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:23.027616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:23.027616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:23.027616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:23.027616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:23.027616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:23.027616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:23.027616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:23.027616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:23.027616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:23.027616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:23.028696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:23.028696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:23.028696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:23.028696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:23.028696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:23.028696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:23.028696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:23.028696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:23.028696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:23.028696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:23.028696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:23.028696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:23.028696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:23.028696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:23.028696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:23.028696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:23.028696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:23.029574 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:23.029574 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:23.029574 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:23.029574 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:23.029574 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 298/582] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:23.029574 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef3b7f-cb87-4f8d-b7e0-3d12a624bbb8 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:23.052518 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1f375-a7aa-4266-b1a4-d6b9f9102150 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:23.067335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:23.090080 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1bc32-1c2a-4829-9902-86cadacfe8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:23.090784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1bc32-1c2a-4829-9902-86cadacfe8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:23.091067 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1bc32-1c2a-4829-9902-86cadacfe8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:23.091342 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1bc32-1c2a-4829-9902-86cadacfe8d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:23.092085 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1bc32-1c2a-4829-9902-86cadacfe8d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:23.092392 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1bc32-1c2a-4829-9902-86cadacfe8d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:23.093776 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1bc32-1c2a-4829-9902-86cadacfe8d7 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:23.101681 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 285/583] 10.222.0.79 () {56 vars in 1103 bytes} [Thu Jul 14 11:55:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:23.102514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1bc32-1c2a-4829-9902-86cadacfe8d7 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:23.132559 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef3b7f-cb87-4f8d-b7e0-3d12a624bbb8 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:23.145053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:23.166266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ccbee-d3eb-4a51-af43-7ba3a283c705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:23.167582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ccbee-d3eb-4a51-af43-7ba3a283c705 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:23.167862 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ccbee-d3eb-4a51-af43-7ba3a283c705 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:23.168136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ccbee-d3eb-4a51-af43-7ba3a283c705 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:23.168859 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ccbee-d3eb-4a51-af43-7ba3a283c705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:23.169164 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ccbee-d3eb-4a51-af43-7ba3a283c705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:23.170563 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ccbee-d3eb-4a51-af43-7ba3a283c705 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:23.183585 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 299/584] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:23.184421 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ccbee-d3eb-4a51-af43-7ba3a283c705 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:23.202347 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1bc32-1c2a-4829-9902-86cadacfe8d7 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:23.239653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9c659-fd12-4141-87ca-cdf408be325d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:23.240319 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9c659-fd12-4141-87ca-cdf408be325d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:23.240600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9c659-fd12-4141-87ca-cdf408be325d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:23.240874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9c659-fd12-4141-87ca-cdf408be325d None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:23.241646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9c659-fd12-4141-87ca-cdf408be325d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:23.241951 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9c659-fd12-4141-87ca-cdf408be325d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:23.243414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9c659-fd12-4141-87ca-cdf408be325d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:23.255175 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 286/585] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:55:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:23.255979 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9c659-fd12-4141-87ca-cdf408be325d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:23.289398 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:23.291465 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ccbee-d3eb-4a51-af43-7ba3a283c705 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:23.326222 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebf7d2-d73a-4b4a-a58f-296366cf4285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:23.326906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebf7d2-d73a-4b4a-a58f-296366cf4285 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:23.327197 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebf7d2-d73a-4b4a-a58f-296366cf4285 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:23.327477 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebf7d2-d73a-4b4a-a58f-296366cf4285 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:23.328309 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebf7d2-d73a-4b4a-a58f-296366cf4285 None admin] RBAC: Adding query filter params (role.id=73743e14bfe849198f3a8b549163f32b, scope.project.id=66f531bc924b41faa64743923afac319, user.id=969ee98dfe644ef2a016860aa1585317) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:23.328628 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebf7d2-d73a-4b4a-a58f-296366cf4285 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:23.330063 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebf7d2-d73a-4b4a-a58f-296366cf4285 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:23.335674 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 300/586] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:55:23 2022] GET /identity/v3/role_assignments?user.id=969ee98dfe644ef2a016860aa1585317&scope.project.id=66f531bc924b41faa64743923afac319&role.id=73743e14bfe849198f3a8b549163f32b => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:23.336474 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebf7d2-d73a-4b4a-a58f-296366cf4285 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:23.360762 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9c659-fd12-4141-87ca-cdf408be325d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:23.382202 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:23.406330 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590c999-ac4f-47cb-a806-69fcc21da81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:23.407082 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590c999-ac4f-47cb-a806-69fcc21da81a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:23.407370 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590c999-ac4f-47cb-a806-69fcc21da81a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:23.407650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590c999-ac4f-47cb-a806-69fcc21da81a None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:23.408388 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590c999-ac4f-47cb-a806-69fcc21da81a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:23.408701 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590c999-ac4f-47cb-a806-69fcc21da81a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:23.410182 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590c999-ac4f-47cb-a806-69fcc21da81a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:23.423481 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 287/587] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:23.424191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590c999-ac4f-47cb-a806-69fcc21da81a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:23.467652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebf7d2-d73a-4b4a-a58f-296366cf4285 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:23.518795 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8405e-196b-4ef2-b3f2-f61e7d5fa78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:23.520386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8405e-196b-4ef2-b3f2-f61e7d5fa78a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:23.520672 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8405e-196b-4ef2-b3f2-f61e7d5fa78a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:23.520950 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8405e-196b-4ef2-b3f2-f61e7d5fa78a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:23.532942 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8405e-196b-4ef2-b3f2-f61e7d5fa78a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:23.534443 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8405e-196b-4ef2-b3f2-f61e7d5fa78a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:23.543164 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:23.550809 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590c999-ac4f-47cb-a806-69fcc21da81a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:23.553137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-e4c8405e-196b-4ef2-b3f2-f61e7d5fa78a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:23.553137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:23.553137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:23.553137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:23.553137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:23.553137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:23.553137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:23.553137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:23.553137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:23.553137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:23.553137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:23.553137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:23.553137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:23.553137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:23.553137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:23.554043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:23.554043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:23.554043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:23.554043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:23.554043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:23.554043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:23.554043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:23.554043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:23.554043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:23.554043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:23.554043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:23.554043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:23.554043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:23.554043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:23.554043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:23.554043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:23.554043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:23.555084 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:23.555084 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:23.555084 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:23.555084 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:23.555084 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 301/588] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:23.555487 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8405e-196b-4ef2-b3f2-f61e7d5fa78a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:23.601558 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ac738-5e17-4d12-ad87-14da23a914a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:23.603187 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ac738-5e17-4d12-ad87-14da23a914a3 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:23.603731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ac738-5e17-4d12-ad87-14da23a914a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:23.604208 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ac738-5e17-4d12-ad87-14da23a914a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:23.613668 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ac738-5e17-4d12-ad87-14da23a914a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:23.615583 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ac738-5e17-4d12-ad87-14da23a914a3 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:23.631093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-715ac738-5e17-4d12-ad87-14da23a914a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:23.631093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:23.631093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:23.631093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:23.631093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:23.631093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:23.631093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:23.631093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:23.631093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:23.631093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:23.631093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:23.631093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:23.631093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:55:23.631093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:55:23.631093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:55:23.632273 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:55:23.632273 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:23.632273 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:23.632273 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:23.632273 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:23.632273 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:23.632273 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:23.632273 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:23.632273 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:23.632273 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:23.632273 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:23.632273 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:23.632273 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:23.632273 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:23.632273 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:23.632273 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:23.632273 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:23.633323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:55:23.633323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:55:23.633323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:55:23.633323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:55:23.633323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:55:23.633323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:55:23.633323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:23.633323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:23.640649 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 288/589] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:23.641921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ac738-5e17-4d12-ad87-14da23a914a3 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:23.648041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:23.661379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8405e-196b-4ef2-b3f2-f61e7d5fa78a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:23.697661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f7268-327f-4dcc-91a3-90583791429c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:23.699211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f7268-327f-4dcc-91a3-90583791429c None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:23.699497 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f7268-327f-4dcc-91a3-90583791429c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:23.699774 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f7268-327f-4dcc-91a3-90583791429c None admin] PATH_INFO: `/v3/projects/66f531bc924b41faa64743923afac319/users/e41a4d3a822c403fad048764a0edf209/roles/73743e14bfe849198f3a8b549163f32b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:23.714820 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f7268-327f-4dcc-91a3-90583791429c None admin] RBAC: Authorizing `identity:create_grant(project_id=66f531bc924b41faa64743923afac319, user_id=e41a4d3a822c403fad048764a0edf209, role_id=73743e14bfe849198f3a8b549163f32b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:23.716278 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f7268-327f-4dcc-91a3-90583791429c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:23.736107 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 302/590] 10.222.0.79 () {58 vars in 1439 bytes} [Thu Jul 14 11:55:23 2022] PUT /identity/v3/projects/66f531bc924b41faa64743923afac319/users/e41a4d3a822c403fad048764a0edf209/roles/73743e14bfe849198f3a8b549163f32b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:55:23.748030 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f7268-327f-4dcc-91a3-90583791429c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:23.761710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ac738-5e17-4d12-ad87-14da23a914a3 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:23.804437 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114b138-39c0-4ae7-b258-bf099e4e146b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:23.805201 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114b138-39c0-4ae7-b258-bf099e4e146b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:23.805449 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114b138-39c0-4ae7-b258-bf099e4e146b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:23.805731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114b138-39c0-4ae7-b258-bf099e4e146b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:23.814969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114b138-39c0-4ae7-b258-bf099e4e146b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:23.816965 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114b138-39c0-4ae7-b258-bf099e4e146b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:23.838358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-0114b138-39c0-4ae7-b258-bf099e4e146b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 11:55:23.838358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:23.838358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:23.838358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:23.838358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:23.838358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:23.838358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:23.838358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:23.838358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:23.838358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:23.838358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:23.838358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:23.838358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:55:23.838358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:55:23.838358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:55:23.838358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:55:23.839588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:23.839588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:23.839588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:55:23.839588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:23.839588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:55:23.839588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:23.839588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:23.839588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:23.839588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:23.839588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:23.839588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:23.839588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:23.839588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:23.839588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:23.839588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:23.839588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:23.839588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:23.839588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:23.840532 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:23.840532 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:23.840532 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:55:23.840532 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:55:23.840532 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:55:23.840532 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:55:23.840532 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:55:23.840532 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:55:23.840532 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 11:55:23.840532 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:23.842647 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 289/591] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:55:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:23.843837 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114b138-39c0-4ae7-b258-bf099e4e146b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:23.867157 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:23.898101 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f7268-327f-4dcc-91a3-90583791429c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:23.941870 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80b692-4eb3-47bf-af85-0d9903c2f73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:23.943835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80b692-4eb3-47bf-af85-0d9903c2f73b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:23.943835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80b692-4eb3-47bf-af85-0d9903c2f73b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:23.943835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80b692-4eb3-47bf-af85-0d9903c2f73b None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:23.944103 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80b692-4eb3-47bf-af85-0d9903c2f73b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:23.944424 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80b692-4eb3-47bf-af85-0d9903c2f73b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:23.945874 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80b692-4eb3-47bf-af85-0d9903c2f73b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:23.954055 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:23.961446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 303/592] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:23.962298 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80b692-4eb3-47bf-af85-0d9903c2f73b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:23.966696 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114b138-39c0-4ae7-b258-bf099e4e146b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:24.010997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd65e9d-6368-4354-b6d3-87aa0dfdeae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:24.011722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd65e9d-6368-4354-b6d3-87aa0dfdeae4 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:24.012003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd65e9d-6368-4354-b6d3-87aa0dfdeae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:24.012277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd65e9d-6368-4354-b6d3-87aa0dfdeae4 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:24.013067 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd65e9d-6368-4354-b6d3-87aa0dfdeae4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:24.013379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd65e9d-6368-4354-b6d3-87aa0dfdeae4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:24.016424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd65e9d-6368-4354-b6d3-87aa0dfdeae4 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:24.031748 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 290/593] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:55:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:24.032887 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd65e9d-6368-4354-b6d3-87aa0dfdeae4 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:24.094033 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80b692-4eb3-47bf-af85-0d9903c2f73b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:24.123297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:24.143885 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d60ed-ab1e-4d2b-bad4-83c32a9659ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:24.145292 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d60ed-ab1e-4d2b-bad4-83c32a9659ae None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:24.145984 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d60ed-ab1e-4d2b-bad4-83c32a9659ae None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:24.146425 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d60ed-ab1e-4d2b-bad4-83c32a9659ae None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:24.147720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d60ed-ab1e-4d2b-bad4-83c32a9659ae None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:24.148549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d60ed-ab1e-4d2b-bad4-83c32a9659ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:24.150438 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d60ed-ab1e-4d2b-bad4-83c32a9659ae None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:24.151250 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd65e9d-6368-4354-b6d3-87aa0dfdeae4 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:24.178526 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 304/594] 10.222.0.79 () {56 vars in 1137 bytes} [Thu Jul 14 11:55:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:24.178526 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d60ed-ab1e-4d2b-bad4-83c32a9659ae None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:24.202426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcd1d0-35a3-4bd6-ae34-40af299eb1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:24.203700 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcd1d0-35a3-4bd6-ae34-40af299eb1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:24.204247 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcd1d0-35a3-4bd6-ae34-40af299eb1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:24.204684 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcd1d0-35a3-4bd6-ae34-40af299eb1d5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:24.216131 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcd1d0-35a3-4bd6-ae34-40af299eb1d5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:24.218709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcd1d0-35a3-4bd6-ae34-40af299eb1d5 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:24.237420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-5dbcd1d0-35a3-4bd6-ae34-40af299eb1d5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 11:55:24.237420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:24.237420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:24.237420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:24.237420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:24.237420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:24.237420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:24.237420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:24.237420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:24.237420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:24.237420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:24.237420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:24.237420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:55:24.237420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:55:24.237420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:55:24.237420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:55:24.238655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:24.238655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:24.238655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:55:24.238655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:24.238655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:55:24.238655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:24.238655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:24.238655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:24.238655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:24.238655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:24.238655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:24.238655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:24.238655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:24.238655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:24.238655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:24.238655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:24.238655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:24.238655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:24.239828 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:24.239828 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:24.239828 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:55:24.239828 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:55:24.239828 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:55:24.239828 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:55:24.239828 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:55:24.239828 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:55:24.239828 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 11:55:24.239828 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:24.243015 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 291/595] 10.222.0.79 () {56 vars in 1102 bytes} [Thu Jul 14 11:55:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:24.244257 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcd1d0-35a3-4bd6-ae34-40af299eb1d5 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:24.245686 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:24.303604 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d60ed-ab1e-4d2b-bad4-83c32a9659ae None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:24.348715 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e328531-d0ba-4775-8b26-568e2dc7a86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:24.350229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e328531-d0ba-4775-8b26-568e2dc7a86e None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:24.350696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e328531-d0ba-4775-8b26-568e2dc7a86e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:24.351412 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e328531-d0ba-4775-8b26-568e2dc7a86e None admin] PATH_INFO: `/v3/projects/66f531bc924b41faa64743923afac319/users/d6921990ec98492f8f4420f911208b84/roles/73743e14bfe849198f3a8b549163f32b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:24.373023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e328531-d0ba-4775-8b26-568e2dc7a86e None admin] RBAC: Authorizing `identity:create_grant(project_id=66f531bc924b41faa64743923afac319, user_id=d6921990ec98492f8f4420f911208b84, role_id=73743e14bfe849198f3a8b549163f32b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:24.375365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e328531-d0ba-4775-8b26-568e2dc7a86e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:24.377931 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcd1d0-35a3-4bd6-ae34-40af299eb1d5 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:24.394061 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 305/596] 10.222.0.79 () {58 vars in 1439 bytes} [Thu Jul 14 11:55:24 2022] PUT /identity/v3/projects/66f531bc924b41faa64743923afac319/users/d6921990ec98492f8f4420f911208b84/roles/73743e14bfe849198f3a8b549163f32b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:55:24.395354 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e328531-d0ba-4775-8b26-568e2dc7a86e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:24.443205 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8519c4-af23-4200-bdee-298dc2061782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:24.444199 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8519c4-af23-4200-bdee-298dc2061782 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:24.444673 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8519c4-af23-4200-bdee-298dc2061782 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:24.445057 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8519c4-af23-4200-bdee-298dc2061782 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:24.453265 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:24.488121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8519c4-af23-4200-bdee-298dc2061782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:24.490854 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8519c4-af23-4200-bdee-298dc2061782 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:24.574174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-bb8519c4-af23-4200-bdee-298dc2061782 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:24.574174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:24.574174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:24.574174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:24.574174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:24.574174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:24.574174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:24.574174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:24.574174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:24.574174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:24.574174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:24.574174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:24.574174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:24.574174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:24.574174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:24.575968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:24.575968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:24.575968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:24.575968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:24.575968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:24.575968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:24.575968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:24.575968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:24.575968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:24.575968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:24.575968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:24.575968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:24.575968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:24.575968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:24.575968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:24.575968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:24.575968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:24.577627 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:24.577627 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:24.577627 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:24.577627 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:24.577627 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 292/597] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:24.585263 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e328531-d0ba-4775-8b26-568e2dc7a86e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:24.604752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8519c4-af23-4200-bdee-298dc2061782 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:24.605111 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:24.656941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48fca2-c389-47b8-881b-d91bf9a4e7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:24.658781 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48fca2-c389-47b8-881b-d91bf9a4e7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:24.659435 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48fca2-c389-47b8-881b-d91bf9a4e7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:24.660119 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48fca2-c389-47b8-881b-d91bf9a4e7e1 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:24.661807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48fca2-c389-47b8-881b-d91bf9a4e7e1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:24.662633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48fca2-c389-47b8-881b-d91bf9a4e7e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:24.665828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48fca2-c389-47b8-881b-d91bf9a4e7e1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:24.703182 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 306/598] 10.222.0.79 () {56 vars in 1139 bytes} [Thu Jul 14 11:55:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:24.716193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48fca2-c389-47b8-881b-d91bf9a4e7e1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:24.820387 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8519c4-af23-4200-bdee-298dc2061782 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:24.856394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48fca2-c389-47b8-881b-d91bf9a4e7e1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:24.870513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087519d-5f57-4a91-a3b5-ce74c0c00680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:24.872914 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087519d-5f57-4a91-a3b5-ce74c0c00680 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:24.873206 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087519d-5f57-4a91-a3b5-ce74c0c00680 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:24.873494 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087519d-5f57-4a91-a3b5-ce74c0c00680 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:24.874226 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087519d-5f57-4a91-a3b5-ce74c0c00680 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:24.874559 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087519d-5f57-4a91-a3b5-ce74c0c00680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:24.875971 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087519d-5f57-4a91-a3b5-ce74c0c00680 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:24.901982 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 293/599] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:24.907681 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087519d-5f57-4a91-a3b5-ce74c0c00680 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:24.920577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66890d4d-bfe6-4f7b-9200-7cb2e4747cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:24.921385 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66890d4d-bfe6-4f7b-9200-7cb2e4747cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:24.921756 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66890d4d-bfe6-4f7b-9200-7cb2e4747cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:24.921951 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66890d4d-bfe6-4f7b-9200-7cb2e4747cc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:24.939349 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66890d4d-bfe6-4f7b-9200-7cb2e4747cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:24.940823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66890d4d-bfe6-4f7b-9200-7cb2e4747cc3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:24.968830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-66890d4d-bfe6-4f7b-9200-7cb2e4747cc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:24.968830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:24.968830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:24.968830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:24.968830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:24.968830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:24.968830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:24.968830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:24.968830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:24.968830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:24.968830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:24.968830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:24.968830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:24.968830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:24.968830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:24.969937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:24.969937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:24.969937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:24.969937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:24.969937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:24.969937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:24.969937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:24.969937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:24.969937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:24.969937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:24.969937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:24.969937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:24.969937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:24.969937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:24.969937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:24.969937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:24.969937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:24.972417 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:24.972417 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:24.972417 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:24.972417 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:24.972417 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 307/600] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:24.974350 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66890d4d-bfe6-4f7b-9200-7cb2e4747cc3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:24.993759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:25.015030 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:25.096184 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087519d-5f57-4a91-a3b5-ce74c0c00680 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:25.162728 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a09fa8-f709-4325-ac20-0aea333c88bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:25.164926 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a09fa8-f709-4325-ac20-0aea333c88bc None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:25.166138 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a09fa8-f709-4325-ac20-0aea333c88bc None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:25.167801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a09fa8-f709-4325-ac20-0aea333c88bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:25.170774 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66890d4d-bfe6-4f7b-9200-7cb2e4747cc3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:25.180740 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a09fa8-f709-4325-ac20-0aea333c88bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:25.184513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a09fa8-f709-4325-ac20-0aea333c88bc None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:25.215599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-f4a09fa8-f709-4325-ac20-0aea333c88bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:25.215599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:25.215599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:25.215599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:25.215599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:25.215599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:25.215599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:25.215599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:25.215599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:25.215599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:25.215599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:25.215599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:25.215599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:55:25.215599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:55:25.215599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:55:25.216559 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:55:25.216559 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:25.216559 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:25.216559 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:25.216559 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:25.216559 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:25.216559 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:25.216559 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:25.216559 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:25.216559 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:25.216559 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:25.216559 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:25.216559 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:25.216559 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:25.216559 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:25.216559 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:25.216559 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:25.217424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:55:25.217424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:55:25.217424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:55:25.217424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:55:25.217424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:55:25.217424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:55:25.217424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:25.217424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:25.219924 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 294/601] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:55:25.227927 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a09fa8-f709-4325-ac20-0aea333c88bc None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:25.239652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8e668-9d2d-46c4-9af7-85aa50742148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:25.241111 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8e668-9d2d-46c4-9af7-85aa50742148 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:25.241625 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8e668-9d2d-46c4-9af7-85aa50742148 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:25.242138 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8e668-9d2d-46c4-9af7-85aa50742148 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:25.243132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8e668-9d2d-46c4-9af7-85aa50742148 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:25.243659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8e668-9d2d-46c4-9af7-85aa50742148 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:25.245512 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8e668-9d2d-46c4-9af7-85aa50742148 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:25.261008 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 308/602] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:55:25.265973 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8e668-9d2d-46c4-9af7-85aa50742148 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:25.399481 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:25.411252 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a09fa8-f709-4325-ac20-0aea333c88bc None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:25.419528 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:25.445648 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8e668-9d2d-46c4-9af7-85aa50742148 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:25.452429 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea8d6e-2b8f-4b6f-ab99-2b91a6acb7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:25.453410 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea8d6e-2b8f-4b6f-ab99-2b91a6acb7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:25.453898 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea8d6e-2b8f-4b6f-ab99-2b91a6acb7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:25.454383 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea8d6e-2b8f-4b6f-ab99-2b91a6acb7f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:25.455456 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea8d6e-2b8f-4b6f-ab99-2b91a6acb7f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:25.455992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea8d6e-2b8f-4b6f-ab99-2b91a6acb7f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:25.457634 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea8d6e-2b8f-4b6f-ab99-2b91a6acb7f7 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:25.471601 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 295/603] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:55:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:25.484442 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea8d6e-2b8f-4b6f-ab99-2b91a6acb7f7 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:25.505583 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6349f-824f-424e-a1db-48b90a280743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:25.506394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6349f-824f-424e-a1db-48b90a280743 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:25.506705 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6349f-824f-424e-a1db-48b90a280743 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:25.506983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6349f-824f-424e-a1db-48b90a280743 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:25.520480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae6349f-824f-424e-a1db-48b90a280743 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:25.523462 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae6349f-824f-424e-a1db-48b90a280743 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:25.551533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-3ae6349f-824f-424e-a1db-48b90a280743 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:25.551533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:25.551533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:25.551533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:25.551533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:25.551533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:25.551533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:25.551533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:25.551533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:25.551533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:25.551533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:25.551533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:25.551533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:55:25.551533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:55:25.551533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:55:25.552722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:55:25.552722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:25.552722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:25.552722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:25.552722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:25.552722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:25.552722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:25.552722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:25.552722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:25.552722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:25.552722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:25.552722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:25.552722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:25.552722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:25.552722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:25.552722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:25.552722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:25.553575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:55:25.553575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:55:25.553575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:55:25.553575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:55:25.553575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:55:25.553575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:55:25.553575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:25.553575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:25.553982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 309/604] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:25.559841 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6349f-824f-424e-a1db-48b90a280743 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:25.652819 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea8d6e-2b8f-4b6f-ab99-2b91a6acb7f7 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:25.717507 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd75b7-ef69-45ab-89d0-99c11ecc4d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:25.718417 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd75b7-ef69-45ab-89d0-99c11ecc4d2d None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:25.718923 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd75b7-ef69-45ab-89d0-99c11ecc4d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:25.719213 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd75b7-ef69-45ab-89d0-99c11ecc4d2d None admin] PATH_INFO: `/v3/projects/66f531bc924b41faa64743923afac319/users/7deede571e7d42408c2fb86665eccfe7/roles/73743e14bfe849198f3a8b549163f32b` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:25.746222 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd75b7-ef69-45ab-89d0-99c11ecc4d2d None admin] RBAC: Authorizing `identity:create_grant(project_id=66f531bc924b41faa64743923afac319, user_id=7deede571e7d42408c2fb86665eccfe7, role_id=73743e14bfe849198f3a8b549163f32b)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:25.746793 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6349f-824f-424e-a1db-48b90a280743 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:25.748069 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd75b7-ef69-45ab-89d0-99c11ecc4d2d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:25.778527 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 296/605] 10.222.0.79 () {58 vars in 1439 bytes} [Thu Jul 14 11:55:25 2022] PUT /identity/v3/projects/66f531bc924b41faa64743923afac319/users/7deede571e7d42408c2fb86665eccfe7/roles/73743e14bfe849198f3a8b549163f32b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:55:25.778527 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a5145-5ace-4fb3-9270-01febf90145b None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:25.778527 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a5145-5ace-4fb3-9270-01febf90145b None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:25.778527 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a5145-5ace-4fb3-9270-01febf90145b None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:25.780047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 297/606] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:25.781682 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeea99d-4585-4383-95a8-a7ee12967544 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:25.782085 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeea99d-4585-4383-95a8-a7ee12967544 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:25.782465 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeea99d-4585-4383-95a8-a7ee12967544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:25.810873 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-cbeea99d-4585-4383-95a8-a7ee12967544 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:25.812746 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-cbeea99d-4585-4383-95a8-a7ee12967544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:25.815491 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f670f-13d5-4351-8a94-8631535f3404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:25.816335 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f670f-13d5-4351-8a94-8631535f3404 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:25.816823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f670f-13d5-4351-8a94-8631535f3404 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:25.817992 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f670f-13d5-4351-8a94-8631535f3404 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:25.818993 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f670f-13d5-4351-8a94-8631535f3404 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:25.820216 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f670f-13d5-4351-8a94-8631535f3404 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:25.824670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f670f-13d5-4351-8a94-8631535f3404 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:25.832334 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:25.842110 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:25.856782 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 310/607] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:55:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:25.861598 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f670f-13d5-4351-8a94-8631535f3404 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:26.000366 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 298/608] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:26.002318 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4948ec0-172d-4d26-9720-0e0169ef26e9 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:26.002318 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4948ec0-172d-4d26-9720-0e0169ef26e9 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:26.002523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4948ec0-172d-4d26-9720-0e0169ef26e9 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:26.006928 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 299/609] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:26.014552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b9c7c-58c6-4e8e-a040-a3deee7e2e73 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:26.014552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b9c7c-58c6-4e8e-a040-a3deee7e2e73 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:26.014552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b9c7c-58c6-4e8e-a040-a3deee7e2e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:26.031598 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-7d8b9c7c-58c6-4e8e-a040-a3deee7e2e73 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:26.032871 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-7d8b9c7c-58c6-4e8e-a040-a3deee7e2e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:26.065815 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f670f-13d5-4351-8a94-8631535f3404 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:26.103829 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c316a-6d49-477a-b466-7c4af7b851f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:26.104769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c316a-6d49-477a-b466-7c4af7b851f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:26.105059 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c316a-6d49-477a-b466-7c4af7b851f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:26.105331 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c316a-6d49-477a-b466-7c4af7b851f3 None admin] PATH_INFO: `/v3/projects/66f531bc924b41faa64743923afac319/users/2fedd4e015384379bf41c2e01ecc0a6a/roles/73743e14bfe849198f3a8b549163f32b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:26.121356 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c316a-6d49-477a-b466-7c4af7b851f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=66f531bc924b41faa64743923afac319, user_id=2fedd4e015384379bf41c2e01ecc0a6a, role_id=73743e14bfe849198f3a8b549163f32b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:26.126518 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 300/610] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:55:26.126518 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b9c7c-58c6-4e8e-a040-a3deee7e2e73 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:26.131106 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c316a-6d49-477a-b466-7c4af7b851f3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:26.158280 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 311/611] 10.222.0.79 () {58 vars in 1439 bytes} [Thu Jul 14 11:55:25 2022] PUT /identity/v3/projects/66f531bc924b41faa64743923afac319/users/2fedd4e015384379bf41c2e01ecc0a6a/roles/73743e14bfe849198f3a8b549163f32b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:55:26.163503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c316a-6d49-477a-b466-7c4af7b851f3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:26.215028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:26.247553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b9c7c-58c6-4e8e-a040-a3deee7e2e73 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:26.262159 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:26.297991 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75014524-9e26-4e95-b053-cce94b7707bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:26.300460 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75014524-9e26-4e95-b053-cce94b7707bb None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:26.302701 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75014524-9e26-4e95-b053-cce94b7707bb None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:26.304969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75014524-9e26-4e95-b053-cce94b7707bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:26.340926 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75014524-9e26-4e95-b053-cce94b7707bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:26.352956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-75014524-9e26-4e95-b053-cce94b7707bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:26.352956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:26.352956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:26.352956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:26.352956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:26.352956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:26.352956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:26.352956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:26.352956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:26.352956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:26.352956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:26.352956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:26.352956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:26.352956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:26.352956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:26.352956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:26.353953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:26.353953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:26.353953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:26.353953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:26.353953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:26.353953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:26.353953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:26.353953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:26.353953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:26.353953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:26.353953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:26.353953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:26.353953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:26.353953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:26.353953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:26.353953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:26.356896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:26.356896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:26.356896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:26.356896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:26.356896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:26.356896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:26.356896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:26.356896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:26.356896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:26.356896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:26.356896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:26.356896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:26.356896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 301/612] 10.222.0.79 () {56 vars in 1102 bytes} [Thu Jul 14 11:55:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:26.363615 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75014524-9e26-4e95-b053-cce94b7707bb None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:26.457526 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c316a-6d49-477a-b466-7c4af7b851f3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:26.568561 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272ee76-4645-4dba-8623-f56057eb9e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:26.576454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272ee76-4645-4dba-8623-f56057eb9e5e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:26.577117 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272ee76-4645-4dba-8623-f56057eb9e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:26.577609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272ee76-4645-4dba-8623-f56057eb9e5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:26.603859 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272ee76-4645-4dba-8623-f56057eb9e5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:26.622605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-0272ee76-4645-4dba-8623-f56057eb9e5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:26.622605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:26.622605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:26.622605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:26.622605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:26.622605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:26.622605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:26.622605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:26.622605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:26.622605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:26.622605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:26.622605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:26.622605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:26.622605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:26.622605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:26.622605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:26.623802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:26.623802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:26.623802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:26.623802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:26.623802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:26.623802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:26.623802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:26.623802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:26.623802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:26.623802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:26.623802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:26.623802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:26.623802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:26.623802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:26.623802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:26.623802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:26.624880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:26.624880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:26.624880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:26.624880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:26.624880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:26.624880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:26.624880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:26.624880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:26.624880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:26.624880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:26.624880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:26.624880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:26.629513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75014524-9e26-4e95-b053-cce94b7707bb None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:26.634532 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 312/613] 10.222.0.79 () {56 vars in 1102 bytes} [Thu Jul 14 11:55:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 475 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:26.640407 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272ee76-4645-4dba-8623-f56057eb9e5e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:26.775780 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f3c83-d32b-4423-825a-a3cfac71731d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:26.777065 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f3c83-d32b-4423-825a-a3cfac71731d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:26.777351 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f3c83-d32b-4423-825a-a3cfac71731d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:26.777621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f3c83-d32b-4423-825a-a3cfac71731d None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:26.778375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f3c83-d32b-4423-825a-a3cfac71731d None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:26.778637 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272ee76-4645-4dba-8623-f56057eb9e5e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:26.779082 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f3c83-d32b-4423-825a-a3cfac71731d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:26.780076 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f3c83-d32b-4423-825a-a3cfac71731d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:26.787413 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:26.792222 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:26.799631 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 302/614] 10.222.0.79 () {56 vars in 1103 bytes} [Thu Jul 14 11:55:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:26.805028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f3c83-d32b-4423-825a-a3cfac71731d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:26.866265 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec6b1b-662c-4bde-af2f-fdc7319dcf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:26.867068 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec6b1b-662c-4bde-af2f-fdc7319dcf29 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:26.867359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec6b1b-662c-4bde-af2f-fdc7319dcf29 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:26.867636 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec6b1b-662c-4bde-af2f-fdc7319dcf29 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:26.868455 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec6b1b-662c-4bde-af2f-fdc7319dcf29 None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:26.868774 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec6b1b-662c-4bde-af2f-fdc7319dcf29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:26.871023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec6b1b-662c-4bde-af2f-fdc7319dcf29 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:26.894904 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 313/615] 10.222.0.79 () {56 vars in 1103 bytes} [Thu Jul 14 11:55:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:26.900675 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec6b1b-662c-4bde-af2f-fdc7319dcf29 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:26.946719 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f3c83-d32b-4423-825a-a3cfac71731d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:27.013404 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ae748-fd16-4ea3-a424-716356e22471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:27.014273 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ae748-fd16-4ea3-a424-716356e22471 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:27.014601 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ae748-fd16-4ea3-a424-716356e22471 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:27.014926 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ae748-fd16-4ea3-a424-716356e22471 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:27.031369 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ae748-fd16-4ea3-a424-716356e22471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:27.032835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ae748-fd16-4ea3-a424-716356e22471 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:27.054315 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec6b1b-662c-4bde-af2f-fdc7319dcf29 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:27.057094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-449ae748-fd16-4ea3-a424-716356e22471 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:27.057094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:27.057094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:27.057094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:27.057094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:27.057094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:27.057094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:27.057094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:27.057094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:27.057094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:27.057094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:27.057094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:27.057094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:27.057094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:27.057094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:27.058554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:27.058554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:27.058554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:27.058554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:27.058554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:27.058554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:27.058554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:27.058554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:27.058554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:27.058554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:27.058554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:27.058554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:27.058554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:27.058554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:27.058554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:27.058554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:27.058554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:27.059449 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:27.059449 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:27.059449 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:27.059449 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:27.059449 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 303/616] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:27.060873 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f67acc-e7ea-4e9f-bf67-3f05996c36d4 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:27.061162 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f67acc-e7ea-4e9f-bf67-3f05996c36d4 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:27.061439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f67acc-e7ea-4e9f-bf67-3f05996c36d4 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:27.063036 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 304/617] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:27.065263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f67acc-e7ea-4e9f-bf67-3f05996c36d4 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:27.122512 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cd0a9-e59d-4e65-91d5-91fceff84b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:27.123982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cd0a9-e59d-4e65-91d5-91fceff84b85 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:27.124339 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cd0a9-e59d-4e65-91d5-91fceff84b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:27.124695 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cd0a9-e59d-4e65-91d5-91fceff84b85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:27.132514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:27.141948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cd0a9-e59d-4e65-91d5-91fceff84b85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:27.144066 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cd0a9-e59d-4e65-91d5-91fceff84b85 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:27.167410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-c15cd0a9-e59d-4e65-91d5-91fceff84b85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:27.167410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:27.167410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:27.167410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:27.167410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:27.167410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:27.167410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:27.167410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:27.167410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:27.167410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:27.167410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:27.167410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:27.167410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:27.167410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:27.167410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:27.168576 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:27.168576 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:27.168576 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:27.168576 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:27.168576 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:27.168576 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:27.168576 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:27.168576 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:27.168576 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:27.168576 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:27.168576 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:27.168576 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:27.168576 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:27.168576 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:27.168576 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:27.168576 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:27.168576 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:27.169648 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:27.169648 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:27.169648 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:27.169648 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:27.171445 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 314/618] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:27.172862 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae882b-0113-47fb-a72e-45b5567ed143 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:27.173225 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae882b-0113-47fb-a72e-45b5567ed143 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:27.173573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae882b-0113-47fb-a72e-45b5567ed143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:27.193202 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f67acc-e7ea-4e9f-bf67-3f05996c36d4 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:27.194556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f4ae882b-0113-47fb-a72e-45b5567ed143 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:27.196061 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f4ae882b-0113-47fb-a72e-45b5567ed143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:27.212715 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:27.237972 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0d4b5-0494-43fc-b6be-29796e473d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:27.239744 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0d4b5-0494-43fc-b6be-29796e473d3e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:27.240215 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0d4b5-0494-43fc-b6be-29796e473d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:27.240646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0d4b5-0494-43fc-b6be-29796e473d3e None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:27.241524 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0d4b5-0494-43fc-b6be-29796e473d3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:27.241981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0d4b5-0494-43fc-b6be-29796e473d3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:27.243552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0d4b5-0494-43fc-b6be-29796e473d3e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:27.264154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 305/619] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:27.264154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0d4b5-0494-43fc-b6be-29796e473d3e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:27.282526 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 315/620] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:27.282526 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae882b-0113-47fb-a72e-45b5567ed143 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:27.401393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0d4b5-0494-43fc-b6be-29796e473d3e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:27.405087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae882b-0113-47fb-a72e-45b5567ed143 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:27.414206 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:27.443899 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8586e3-e13f-4824-97cc-4a12d5b12e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:27.444899 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8586e3-e13f-4824-97cc-4a12d5b12e05 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:27.445382 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8586e3-e13f-4824-97cc-4a12d5b12e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:27.445831 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8586e3-e13f-4824-97cc-4a12d5b12e05 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:27.446781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8586e3-e13f-4824-97cc-4a12d5b12e05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:27.447312 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8586e3-e13f-4824-97cc-4a12d5b12e05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:27.448724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39d04b-2241-4a8b-aa30-d638b7779279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:27.449526 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39d04b-2241-4a8b-aa30-d638b7779279 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:27.449797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39d04b-2241-4a8b-aa30-d638b7779279 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:27.450075 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39d04b-2241-4a8b-aa30-d638b7779279 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:27.450430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8586e3-e13f-4824-97cc-4a12d5b12e05 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:27.459075 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39d04b-2241-4a8b-aa30-d638b7779279 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:27.460537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39d04b-2241-4a8b-aa30-d638b7779279 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:27.465471 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 306/621] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:27.466685 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8586e3-e13f-4824-97cc-4a12d5b12e05 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:27.479243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-6f39d04b-2241-4a8b-aa30-d638b7779279 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 11:55:27.479243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:27.479243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:27.479243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:27.479243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:27.479243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:27.479243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:27.479243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:27.479243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:27.479243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:27.479243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:27.479243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:27.479243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:55:27.479243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:55:27.479243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:55:27.479243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:55:27.480231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:27.480231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:27.480231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:55:27.480231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:27.480231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:55:27.480231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:27.480231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:27.480231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:27.480231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:27.480231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:27.480231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:27.480231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:27.480231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:27.480231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:27.480231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:27.480231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:27.480231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:27.480231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:27.481731 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:27.481731 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:27.481731 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:55:27.481731 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:55:27.481731 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:55:27.481731 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:55:27.481731 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:55:27.481731 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:55:27.481731 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 11:55:27.481731 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:27.485446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 316/622] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:55:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:27.486371 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39d04b-2241-4a8b-aa30-d638b7779279 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:27.501432 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:27.600326 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8586e3-e13f-4824-97cc-4a12d5b12e05 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:27.603858 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39d04b-2241-4a8b-aa30-d638b7779279 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:27.641280 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad0dcc-ddb8-4825-b148-86f4a10b07a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:27.642090 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad0dcc-ddb8-4825-b148-86f4a10b07a9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:27.642376 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad0dcc-ddb8-4825-b148-86f4a10b07a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:27.642689 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad0dcc-ddb8-4825-b148-86f4a10b07a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:27.643509 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9970d06-c0b8-4e9e-8d62-7584d3856abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:27.644336 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9970d06-c0b8-4e9e-8d62-7584d3856abd None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:27.644620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9970d06-c0b8-4e9e-8d62-7584d3856abd None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:27.644898 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9970d06-c0b8-4e9e-8d62-7584d3856abd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:27.653965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9970d06-c0b8-4e9e-8d62-7584d3856abd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:27.655373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9970d06-c0b8-4e9e-8d62-7584d3856abd None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:27.655699 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad0dcc-ddb8-4825-b148-86f4a10b07a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:27.663990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-66ad0dcc-ddb8-4825-b148-86f4a10b07a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:27.663990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:27.663990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:27.663990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:27.663990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:27.663990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:27.663990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:27.663990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:27.663990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:27.663990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:27.663990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:27.663990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:27.663990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:27.663990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:27.663990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:27.663990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:27.664949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:27.664949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:27.664949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:27.664949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:27.664949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:27.664949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:27.664949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:27.664949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:27.664949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:27.664949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:27.664949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:27.664949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:27.664949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:27.664949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:27.664949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:27.664949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:27.666183 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:27.666183 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:27.666183 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:27.666183 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:27.666183 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:27.666183 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:27.666183 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:27.666183 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:27.666183 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:27.666183 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:27.666183 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:27.666183 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:27.666183 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 307/623] 10.222.0.79 () {56 vars in 1102 bytes} [Thu Jul 14 11:55:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:27.667488 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad0dcc-ddb8-4825-b148-86f4a10b07a9 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:27.675246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f9970d06-c0b8-4e9e-8d62-7584d3856abd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:55:27.675246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:27.675246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:27.675246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:27.675246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:27.675246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:27.675246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:27.675246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:27.675246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:27.675246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:27.675246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:27.675246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:27.675246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:55:27.675246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:55:27.675246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:55:27.675246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:55:27.677220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:27.677220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:27.677220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:55:27.677220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:27.677220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:55:27.677220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:27.677220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:27.677220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:27.677220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:27.677220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:27.677220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:27.677220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:27.677220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:27.677220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:27.677220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:27.677220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:27.677220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:27.677220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:27.678592 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:27.678592 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:27.678592 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:55:27.678592 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:55:27.678592 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:55:27.678592 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:55:27.678592 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:55:27.678592 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:55:27.678592 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:55:27.678592 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:27.683466 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 317/624] 10.222.0.79 () {56 vars in 1093 bytes} [Thu Jul 14 11:55:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:27.684504 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9970d06-c0b8-4e9e-8d62-7584d3856abd None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:27.718006 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:27.780192 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:27.803151 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad0dcc-ddb8-4825-b148-86f4a10b07a9 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:27.814451 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9970d06-c0b8-4e9e-8d62-7584d3856abd None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:27.840925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c217cb-161e-44d9-8a64-7e47eb81d414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:27.841511 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c217cb-161e-44d9-8a64-7e47eb81d414 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:27.841801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c217cb-161e-44d9-8a64-7e47eb81d414 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:27.842086 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c217cb-161e-44d9-8a64-7e47eb81d414 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:27.843064 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c217cb-161e-44d9-8a64-7e47eb81d414 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:27.843374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c217cb-161e-44d9-8a64-7e47eb81d414 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:27.844967 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c217cb-161e-44d9-8a64-7e47eb81d414 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:27.852058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014861f4-e46d-47cb-b904-89841963385d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:27.852991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014861f4-e46d-47cb-b904-89841963385d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:27.853447 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014861f4-e46d-47cb-b904-89841963385d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:27.853880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014861f4-e46d-47cb-b904-89841963385d None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:27.855440 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014861f4-e46d-47cb-b904-89841963385d None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:27.855920 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014861f4-e46d-47cb-b904-89841963385d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:27.857452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014861f4-e46d-47cb-b904-89841963385d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:27.870523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 308/625] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Jul 14 11:55:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:27.870523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c217cb-161e-44d9-8a64-7e47eb81d414 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:27.870790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 318/626] 10.222.0.79 () {56 vars in 1103 bytes} [Thu Jul 14 11:55:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:27.870790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014861f4-e46d-47cb-b904-89841963385d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:27.964613 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:27.977914 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c217cb-161e-44d9-8a64-7e47eb81d414 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:27.989208 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014861f4-e46d-47cb-b904-89841963385d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:28.017126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b43e4-44c3-49fa-9ef9-0de188ac98c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:28.018452 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b43e4-44c3-49fa-9ef9-0de188ac98c2 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:28.019205 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b43e4-44c3-49fa-9ef9-0de188ac98c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:28.020113 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b43e4-44c3-49fa-9ef9-0de188ac98c2 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:28.021655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b43e4-44c3-49fa-9ef9-0de188ac98c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:28.022431 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b43e4-44c3-49fa-9ef9-0de188ac98c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:28.023279 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:28.025635 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b43e4-44c3-49fa-9ef9-0de188ac98c2 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:28.029962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ae8cb-999d-4215-890f-04cdcfb95a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:28.031627 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ae8cb-999d-4215-890f-04cdcfb95a2b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:28.031924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ae8cb-999d-4215-890f-04cdcfb95a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:28.032210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ae8cb-999d-4215-890f-04cdcfb95a2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:28.047087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ae8cb-999d-4215-890f-04cdcfb95a2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:28.048634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ae8cb-999d-4215-890f-04cdcfb95a2b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:28.049878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 309/627] 10.222.0.79 () {56 vars in 1133 bytes} [Thu Jul 14 11:55:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:28.050885 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b43e4-44c3-49fa-9ef9-0de188ac98c2 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:28.068148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-678ae8cb-999d-4215-890f-04cdcfb95a2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:28.068148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:28.068148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:28.068148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:28.068148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:28.068148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:28.068148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:28.068148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:28.068148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:28.068148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:28.068148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:28.068148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:28.068148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:28.068148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:28.068148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:28.070809 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:28.070809 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:28.070809 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:28.070809 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:28.070809 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:28.070809 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:28.070809 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:28.070809 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:28.070809 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:28.070809 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:28.070809 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:28.070809 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:28.070809 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:28.070809 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:28.070809 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:28.070809 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:28.070809 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:28.073036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:28.073036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:28.073036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:28.073036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:28.073036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 319/628] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:55:28.073036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1ca24-15be-425b-9249-13cffdb3c55f None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:28.073036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1ca24-15be-425b-9249-13cffdb3c55f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:28.073036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1ca24-15be-425b-9249-13cffdb3c55f None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:28.073036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 320/629] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:28.074523 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1ca24-15be-425b-9249-13cffdb3c55f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:28.176483 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b43e4-44c3-49fa-9ef9-0de188ac98c2 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:28.194236 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1ca24-15be-425b-9249-13cffdb3c55f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:28.220972 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d212b4-9aee-4004-9282-4fcf6c6f0709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:28.221781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d212b4-9aee-4004-9282-4fcf6c6f0709 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:28.222121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d212b4-9aee-4004-9282-4fcf6c6f0709 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:28.222354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d212b4-9aee-4004-9282-4fcf6c6f0709 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:28.234318 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d212b4-9aee-4004-9282-4fcf6c6f0709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:28.235819 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d212b4-9aee-4004-9282-4fcf6c6f0709 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:28.239269 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402d8de-88da-422c-a5e4-1c86ed81f3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:28.239929 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402d8de-88da-422c-a5e4-1c86ed81f3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:28.240219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402d8de-88da-422c-a5e4-1c86ed81f3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:28.240500 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402d8de-88da-422c-a5e4-1c86ed81f3b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:28.243715 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:28.255877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-78d212b4-9aee-4004-9282-4fcf6c6f0709 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:28.255877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:28.255877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:28.255877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:28.255877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:28.255877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:28.255877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:28.255877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:28.255877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:28.255877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:28.255877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:28.255877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:28.255877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:28.255877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:28.255877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:28.256835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:28.256835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:28.256835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:28.256835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:28.256835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:28.256835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:28.256835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:28.256835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:28.256835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:28.256835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:28.256835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:28.256835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:28.256835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:28.256835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:28.256835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:28.256835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:28.256835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:28.257701 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:28.257701 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:28.257701 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:28.257701 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:28.262425 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 310/630] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:28.263350 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d212b4-9aee-4004-9282-4fcf6c6f0709 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:28.300620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:28.328376 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402d8de-88da-422c-a5e4-1c86ed81f3b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:28.329945 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402d8de-88da-422c-a5e4-1c86ed81f3b7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:28.377179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d212b4-9aee-4004-9282-4fcf6c6f0709 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:28.414790 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b961db1-c5ad-4096-b65c-9908877298fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:28.415573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b961db1-c5ad-4096-b65c-9908877298fc None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:28.415914 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b961db1-c5ad-4096-b65c-9908877298fc None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:28.416262 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b961db1-c5ad-4096-b65c-9908877298fc None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:28.417092 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b961db1-c5ad-4096-b65c-9908877298fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:28.417485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b961db1-c5ad-4096-b65c-9908877298fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:28.418966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b961db1-c5ad-4096-b65c-9908877298fc None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:28.431688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 311/631] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:28.433401 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdefc0b-62a6-46df-bbc1-56b9c09a2cae None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:28.433688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdefc0b-62a6-46df-bbc1-56b9c09a2cae None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:28.433961 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdefc0b-62a6-46df-bbc1-56b9c09a2cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:28.447376 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 321/632] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:55:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:28.448889 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402d8de-88da-422c-a5e4-1c86ed81f3b7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:28.455737 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-7bdefc0b-62a6-46df-bbc1-56b9c09a2cae None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:28.457035 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-7bdefc0b-62a6-46df-bbc1-56b9c09a2cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:28.518652 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:28.532615 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 312/633] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:28.533463 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdefc0b-62a6-46df-bbc1-56b9c09a2cae None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:28.539083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:28.557340 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402d8de-88da-422c-a5e4-1c86ed81f3b7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:28.591155 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb1543-688d-4e76-8971-4f11958afa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:28.592104 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb1543-688d-4e76-8971-4f11958afa40 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:28.592388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb1543-688d-4e76-8971-4f11958afa40 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:28.592661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb1543-688d-4e76-8971-4f11958afa40 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:28.593378 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb1543-688d-4e76-8971-4f11958afa40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:28.593683 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb1543-688d-4e76-8971-4f11958afa40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:28.595075 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb1543-688d-4e76-8971-4f11958afa40 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:28.610123 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 322/634] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:28.611174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb1543-688d-4e76-8971-4f11958afa40 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:28.638004 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdefc0b-62a6-46df-bbc1-56b9c09a2cae None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:28.673800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731d663-4cb6-43b2-a809-e5a95d086c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:28.674649 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731d663-4cb6-43b2-a809-e5a95d086c26 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:28.674925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731d663-4cb6-43b2-a809-e5a95d086c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:28.675198 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731d663-4cb6-43b2-a809-e5a95d086c26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:28.682156 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731d663-4cb6-43b2-a809-e5a95d086c26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:28.683654 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731d663-4cb6-43b2-a809-e5a95d086c26 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:28.705029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-e731d663-4cb6-43b2-a809-e5a95d086c26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:28.705029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:28.705029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:28.705029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:28.705029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:28.705029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:28.705029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:28.705029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:28.705029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:28.705029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:28.705029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:28.705029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:28.705029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:55:28.705029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:55:28.705029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:55:28.706078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:55:28.706078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:28.706078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:28.706078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:28.706078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:28.706078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:28.706078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:28.706078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:28.706078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:28.706078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:28.706078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:28.706078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:28.706078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:28.706078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:28.706078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:28.706078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:28.706078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:28.707268 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:55:28.707268 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:55:28.707268 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:55:28.707268 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:55:28.707268 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:55:28.707268 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:55:28.707268 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:28.707268 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:28.707268 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 313/635] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:28.707910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b36d38-58b7-4577-8f44-d4bc6f8017ca None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:28.708142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b36d38-58b7-4577-8f44-d4bc6f8017ca None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:28.708423 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b36d38-58b7-4577-8f44-d4bc6f8017ca None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:28.709698 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 314/636] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:28.710392 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b36d38-58b7-4577-8f44-d4bc6f8017ca None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:28.720136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb1543-688d-4e76-8971-4f11958afa40 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:28.758706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb16445-2e6e-400e-b56b-f05abf0aa767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:28.759511 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb16445-2e6e-400e-b56b-f05abf0aa767 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:28.759792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb16445-2e6e-400e-b56b-f05abf0aa767 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:28.760065 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb16445-2e6e-400e-b56b-f05abf0aa767 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:28.763497 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:28.771400 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb16445-2e6e-400e-b56b-f05abf0aa767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:28.772787 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb16445-2e6e-400e-b56b-f05abf0aa767 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:28.775365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:28.791616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-fcb16445-2e6e-400e-b56b-f05abf0aa767 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:28.791616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:28.791616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:28.791616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:28.791616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:28.791616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:28.791616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:28.791616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:28.791616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:28.791616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:28.791616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:28.791616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:28.791616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:28.791616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:28.791616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:28.793634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:28.793634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:28.793634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:28.793634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:28.793634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:28.793634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:28.793634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:28.793634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:28.793634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:28.793634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:28.793634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:28.793634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:28.793634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:28.793634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:28.793634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:28.793634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:28.793634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:28.794740 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:28.794740 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:28.794740 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:28.794740 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:28.794740 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 323/637] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:28.794740 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb16445-2e6e-400e-b56b-f05abf0aa767 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:28.819112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b36d38-58b7-4577-8f44-d4bc6f8017ca None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:28.853984 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca8b34-aa05-45c6-8648-3113eb7ff1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:28.855164 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca8b34-aa05-45c6-8648-3113eb7ff1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:28.855452 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca8b34-aa05-45c6-8648-3113eb7ff1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:28.855729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca8b34-aa05-45c6-8648-3113eb7ff1d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:28.866888 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca8b34-aa05-45c6-8648-3113eb7ff1d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:28.874618 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-6aca8b34-aa05-45c6-8648-3113eb7ff1d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:28.874618 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:28.874618 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:28.874618 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:28.874618 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:28.874618 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:28.874618 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:28.874618 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:28.874618 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:28.874618 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:28.874618 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:28.874618 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:28.874618 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:28.874618 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:28.874618 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:28.874618 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:28.876844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:28.876844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:28.876844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:28.876844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:28.876844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:28.876844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:28.876844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:28.876844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:28.876844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:28.876844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:28.876844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:28.876844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:28.876844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:28.876844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:28.876844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:28.876844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:28.883700 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:28.883700 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:28.883700 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:28.883700 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:28.883700 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:28.883700 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:28.883700 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:28.883700 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:28.883700 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:28.883700 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:28.883700 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:28.883700 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:28.883700 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 315/638] 10.222.0.79 () {56 vars in 1102 bytes} [Thu Jul 14 11:55:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:28.883700 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca8b34-aa05-45c6-8648-3113eb7ff1d3 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:28.908495 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb16445-2e6e-400e-b56b-f05abf0aa767 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:28.944219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557e010-2584-42ff-8bf9-99baf6bf7a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:28.945012 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557e010-2584-42ff-8bf9-99baf6bf7a49 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:28.945294 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557e010-2584-42ff-8bf9-99baf6bf7a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:28.945573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557e010-2584-42ff-8bf9-99baf6bf7a49 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:28.953580 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557e010-2584-42ff-8bf9-99baf6bf7a49 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:28.955042 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557e010-2584-42ff-8bf9-99baf6bf7a49 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:28.969411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-2557e010-2584-42ff-8bf9-99baf6bf7a49 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 11:55:28.969411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:28.969411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:28.969411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:28.969411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:28.969411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:28.969411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:28.969411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:28.969411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:28.969411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:28.969411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:28.969411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:28.969411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:55:28.969411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:55:28.969411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:55:28.969411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:55:28.970616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:28.970616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:28.970616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:55:28.970616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:28.970616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:55:28.970616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:28.970616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:28.970616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:28.970616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:28.970616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:28.970616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:28.970616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:28.970616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:28.970616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:28.970616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:28.970616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:28.970616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:28.970616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:28.971728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:28.971728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:28.971728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:55:28.971728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:55:28.971728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:55:28.971728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:55:28.971728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:55:28.971728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:55:28.971728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 11:55:28.971728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:28.974778 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 324/639] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:55:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:28.976186 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ee285-bde4-4e54-95ea-51f701795501 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:28.976484 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ee285-bde4-4e54-95ea-51f701795501 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:28.976772 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ee285-bde4-4e54-95ea-51f701795501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:28.985057 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca8b34-aa05-45c6-8648-3113eb7ff1d3 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:28.993158 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f43ee285-bde4-4e54-95ea-51f701795501 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:28.993954 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:28.994331 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f43ee285-bde4-4e54-95ea-51f701795501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:29.021362 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720aecb-ba19-45af-b103-4029a9593c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:29.022076 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720aecb-ba19-45af-b103-4029a9593c37 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:29.022305 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720aecb-ba19-45af-b103-4029a9593c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:29.022615 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720aecb-ba19-45af-b103-4029a9593c37 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:29.023397 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720aecb-ba19-45af-b103-4029a9593c37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:29.023749 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720aecb-ba19-45af-b103-4029a9593c37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:29.025141 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720aecb-ba19-45af-b103-4029a9593c37 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:29.037541 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 316/640] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:55:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:29.038366 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720aecb-ba19-45af-b103-4029a9593c37 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:29.045498 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:29.069768 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 325/641] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:29.070747 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ee285-bde4-4e54-95ea-51f701795501 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:29.144428 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720aecb-ba19-45af-b103-4029a9593c37 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:29.179286 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2942c1-3188-46c1-9c62-389d4658679a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:29.179950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2942c1-3188-46c1-9c62-389d4658679a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:29.180235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2942c1-3188-46c1-9c62-389d4658679a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:29.180722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2942c1-3188-46c1-9c62-389d4658679a None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:29.181235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2942c1-3188-46c1-9c62-389d4658679a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:29.181552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2942c1-3188-46c1-9c62-389d4658679a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:29.183534 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2942c1-3188-46c1-9c62-389d4658679a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:29.189811 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ee285-bde4-4e54-95ea-51f701795501 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:29.195393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 317/642] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:29.196237 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2942c1-3188-46c1-9c62-389d4658679a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:29.224928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f74cf-c4e2-4553-a646-4a4858eb51a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:29.225595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f74cf-c4e2-4553-a646-4a4858eb51a2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:29.225878 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f74cf-c4e2-4553-a646-4a4858eb51a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:29.226155 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f74cf-c4e2-4553-a646-4a4858eb51a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:29.226928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f74cf-c4e2-4553-a646-4a4858eb51a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:29.227468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f74cf-c4e2-4553-a646-4a4858eb51a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:29.227642 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:29.229050 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f74cf-c4e2-4553-a646-4a4858eb51a2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:29.237847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 326/643] 10.222.0.79 () {56 vars in 1103 bytes} [Thu Jul 14 11:55:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:29.238677 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f74cf-c4e2-4553-a646-4a4858eb51a2 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:29.288581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:29.299019 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2942c1-3188-46c1-9c62-389d4658679a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:29.332496 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852c2c5-d886-4917-a91b-f20dabd6e2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:29.333165 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852c2c5-d886-4917-a91b-f20dabd6e2ca None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:29.333445 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852c2c5-d886-4917-a91b-f20dabd6e2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:29.333726 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852c2c5-d886-4917-a91b-f20dabd6e2ca None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:29.334574 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852c2c5-d886-4917-a91b-f20dabd6e2ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:29.334887 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852c2c5-d886-4917-a91b-f20dabd6e2ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:29.336305 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852c2c5-d886-4917-a91b-f20dabd6e2ca None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:29.339231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f74cf-c4e2-4553-a646-4a4858eb51a2 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:29.353391 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 318/644] 10.222.0.79 () {56 vars in 1137 bytes} [Thu Jul 14 11:55:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:29.354301 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852c2c5-d886-4917-a91b-f20dabd6e2ca None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:29.378675 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9e79d-c425-4370-a67f-e81397452aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:29.379563 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9e79d-c425-4370-a67f-e81397452aaf None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:29.379844 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9e79d-c425-4370-a67f-e81397452aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:29.380116 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9e79d-c425-4370-a67f-e81397452aaf None admin] PATH_INFO: `/v3/projects/66f531bc924b41faa64743923afac319/users/969ee98dfe644ef2a016860aa1585317/roles/73743e14bfe849198f3a8b549163f32b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:29.395659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9e79d-c425-4370-a67f-e81397452aaf None admin] RBAC: Authorizing `identity:create_grant(project_id=66f531bc924b41faa64743923afac319, user_id=969ee98dfe644ef2a016860aa1585317, role_id=73743e14bfe849198f3a8b549163f32b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:29.397114 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9e79d-c425-4370-a67f-e81397452aaf None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:29.410015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 327/645] 10.222.0.79 () {58 vars in 1439 bytes} [Thu Jul 14 11:55:29 2022] PUT /identity/v3/projects/66f531bc924b41faa64743923afac319/users/969ee98dfe644ef2a016860aa1585317/roles/73743e14bfe849198f3a8b549163f32b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:55:29.410882 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9e79d-c425-4370-a67f-e81397452aaf None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:29.448509 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:29.465861 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852c2c5-d886-4917-a91b-f20dabd6e2ca None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:29.503480 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58640051-7188-47f1-848c-ba7ffd2c8bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:29.504437 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58640051-7188-47f1-848c-ba7ffd2c8bda None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:29.504726 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58640051-7188-47f1-848c-ba7ffd2c8bda None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:29.505004 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58640051-7188-47f1-848c-ba7ffd2c8bda None admin] PATH_INFO: `/v3/roles/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:29.518242 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58640051-7188-47f1-848c-ba7ffd2c8bda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:29.526154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-58640051-7188-47f1-848c-ba7ffd2c8bda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:29.526154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:29.526154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:29.526154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:29.526154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:29.526154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:29.526154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:29.526154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:29.526154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:29.526154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:29.526154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:29.526154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:29.526154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:29.526154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:29.526154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:29.526154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:29.527216 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:29.527216 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:29.527216 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:29.527216 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:29.527216 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:29.527216 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:29.527216 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:29.527216 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:29.527216 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:29.527216 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:29.527216 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:29.527216 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:29.527216 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:29.527216 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:29.527216 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:29.527216 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:29.528181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:29.528181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:29.528181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:29.528181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:29.528181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:29.528181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:29.528181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:29.528181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:29.528181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:29.528181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:29.528181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:29.528181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:29.528181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 319/646] 10.222.0.79 () {56 vars in 1102 bytes} [Thu Jul 14 11:55:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:29.528905 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58640051-7188-47f1-848c-ba7ffd2c8bda None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:29.549450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:29.554369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9e79d-c425-4370-a67f-e81397452aaf None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:29.596971 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a451f-ae03-4726-a564-55a6744c43b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:29.597828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a451f-ae03-4726-a564-55a6744c43b4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:29.598124 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a451f-ae03-4726-a564-55a6744c43b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:29.598400 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a451f-ae03-4726-a564-55a6744c43b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:29.606218 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a451f-ae03-4726-a564-55a6744c43b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:29.607724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a451f-ae03-4726-a564-55a6744c43b4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:29.622189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-e14a451f-ae03-4726-a564-55a6744c43b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:29.622189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:29.622189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:29.622189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:29.622189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:29.622189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:29.622189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:29.622189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:29.622189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:29.622189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:29.622189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:29.622189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:29.622189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:55:29.622189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:55:29.622189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:55:29.623181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:55:29.623181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:29.623181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:29.623181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:29.623181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:29.623181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:29.623181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:29.623181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:29.623181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:29.623181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:29.623181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:29.623181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:29.623181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:29.623181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:29.623181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:29.623181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:29.623181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:29.624052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:55:29.624052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:55:29.624052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:55:29.624052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:55:29.624052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:55:29.624052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:55:29.624052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:29.624052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:29.624052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 328/647] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:29.624537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a451f-ae03-4726-a564-55a6744c43b4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:29.649921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58640051-7188-47f1-848c-ba7ffd2c8bda None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:29.690458 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158de7d-9c37-4d78-b08b-123ad4b1c8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:29.691437 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158de7d-9c37-4d78-b08b-123ad4b1c8aa None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:29.691724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158de7d-9c37-4d78-b08b-123ad4b1c8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:29.692002 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158de7d-9c37-4d78-b08b-123ad4b1c8aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:29.703214 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158de7d-9c37-4d78-b08b-123ad4b1c8aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:29.704699 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158de7d-9c37-4d78-b08b-123ad4b1c8aa None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:29.711820 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:29.723653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-f158de7d-9c37-4d78-b08b-123ad4b1c8aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:29.723653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:29.723653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:29.723653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:29.723653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:29.723653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:29.723653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:29.723653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:29.723653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:29.723653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:29.723653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:29.723653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:29.723653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:29.723653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:29.723653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:29.724599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:29.724599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:29.724599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:29.724599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:29.724599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:29.724599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:29.724599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:29.724599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:29.724599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:29.724599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:29.724599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:29.724599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:29.724599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:29.724599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:29.724599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:29.724599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:29.724599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:29.725454 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:29.725454 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:29.725454 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:29.725454 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:29.725454 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 320/648] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:29.726155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158de7d-9c37-4d78-b08b-123ad4b1c8aa None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:29.764971 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a451f-ae03-4726-a564-55a6744c43b4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:29.801236 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab75c1-f6cb-442e-8d98-8cb90b3391a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:29.802134 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab75c1-f6cb-442e-8d98-8cb90b3391a4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:29.802356 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab75c1-f6cb-442e-8d98-8cb90b3391a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:29.802653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab75c1-f6cb-442e-8d98-8cb90b3391a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:29.831380 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:29.835495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158de7d-9c37-4d78-b08b-123ad4b1c8aa None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:29.871801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79e31f-44ce-44d6-a826-c87fb0b04388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:29.872582 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79e31f-44ce-44d6-a826-c87fb0b04388 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:29.872878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79e31f-44ce-44d6-a826-c87fb0b04388 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:29.873157 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79e31f-44ce-44d6-a826-c87fb0b04388 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:29.873893 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79e31f-44ce-44d6-a826-c87fb0b04388 None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:29.874199 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79e31f-44ce-44d6-a826-c87fb0b04388 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:29.875604 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79e31f-44ce-44d6-a826-c87fb0b04388 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:29.875710 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab75c1-f6cb-442e-8d98-8cb90b3391a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:29.877151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab75c1-f6cb-442e-8d98-8cb90b3391a4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:29.887220 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 321/649] 10.222.0.79 () {56 vars in 1103 bytes} [Thu Jul 14 11:55:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:29.887220 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79e31f-44ce-44d6-a826-c87fb0b04388 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:29.950198 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:29.985773 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 329/650] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:55:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:29.986982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab75c1-f6cb-442e-8d98-8cb90b3391a4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:29.998909 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79e31f-44ce-44d6-a826-c87fb0b04388 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:30.040921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055eeda-56c3-4ad7-bb4b-5d79cf640fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:30.041763 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055eeda-56c3-4ad7-bb4b-5d79cf640fef None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:30.042053 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055eeda-56c3-4ad7-bb4b-5d79cf640fef None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:30.042401 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055eeda-56c3-4ad7-bb4b-5d79cf640fef None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:30.043155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055eeda-56c3-4ad7-bb4b-5d79cf640fef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:30.043473 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055eeda-56c3-4ad7-bb4b-5d79cf640fef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:30.045052 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055eeda-56c3-4ad7-bb4b-5d79cf640fef None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:30.050133 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:30.060867 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 322/651] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:55:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:30.061655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055eeda-56c3-4ad7-bb4b-5d79cf640fef None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:30.098927 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab75c1-f6cb-442e-8d98-8cb90b3391a4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:30.133524 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993b556-9d71-457b-a835-f8e18cb92a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:30.134191 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993b556-9d71-457b-a835-f8e18cb92a7c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:30.134478 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993b556-9d71-457b-a835-f8e18cb92a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:30.134779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993b556-9d71-457b-a835-f8e18cb92a7c None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:30.135862 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993b556-9d71-457b-a835-f8e18cb92a7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:30.135862 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993b556-9d71-457b-a835-f8e18cb92a7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:30.137177 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993b556-9d71-457b-a835-f8e18cb92a7c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:30.149627 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 330/652] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:30.151368 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993b556-9d71-457b-a835-f8e18cb92a7c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:30.170202 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055eeda-56c3-4ad7-bb4b-5d79cf640fef None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:30.192326 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:30.208333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e102f5-015f-4ea4-8ebe-5fb0a050205a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:30.209292 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e102f5-015f-4ea4-8ebe-5fb0a050205a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:30.209589 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e102f5-015f-4ea4-8ebe-5fb0a050205a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:30.209872 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e102f5-015f-4ea4-8ebe-5fb0a050205a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:30.221127 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e102f5-015f-4ea4-8ebe-5fb0a050205a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:30.222730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e102f5-015f-4ea4-8ebe-5fb0a050205a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:30.242879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-64e102f5-015f-4ea4-8ebe-5fb0a050205a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:30.242879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:30.242879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:30.242879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:30.242879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:30.242879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:30.242879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:30.242879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:30.242879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:30.242879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:30.242879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:30.242879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:30.242879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:30.242879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:30.242879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:30.243874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:30.243874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:30.243874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:30.243874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:30.243874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:30.243874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:30.243874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:30.243874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:30.243874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:30.243874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:30.243874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:30.243874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:30.243874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:30.243874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:30.243874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:30.243874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:30.243874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:30.244834 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:30.244834 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:30.244834 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:30.244834 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:30.244834 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 323/653] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:30.245115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e102f5-015f-4ea4-8ebe-5fb0a050205a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:30.265104 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993b556-9d71-457b-a835-f8e18cb92a7c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:30.283166 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:30.304171 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f867c-6ed6-43e0-a735-708f43566ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:30.305056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f867c-6ed6-43e0-a735-708f43566ebb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:30.305339 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f867c-6ed6-43e0-a735-708f43566ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:30.305620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f867c-6ed6-43e0-a735-708f43566ebb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:30.316908 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f867c-6ed6-43e0-a735-708f43566ebb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:30.318296 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f867c-6ed6-43e0-a735-708f43566ebb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:30.336589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-5d8f867c-6ed6-43e0-a735-708f43566ebb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:30.336589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:30.336589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:30.336589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:30.336589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:30.336589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:30.336589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:30.336589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:30.336589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:30.336589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:30.336589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:30.336589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:30.336589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:30.336589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:30.336589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:30.337496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:30.337496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:30.337496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:30.337496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:30.337496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:30.337496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:30.337496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:30.337496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:30.337496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:30.337496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:30.337496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:30.337496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:30.337496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:30.337496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:30.337496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:30.337496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:30.337496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:30.339055 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:30.339055 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:30.339055 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:30.339055 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:30.339055 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 331/654] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:30.339390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f867c-6ed6-43e0-a735-708f43566ebb None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:30.360800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e102f5-015f-4ea4-8ebe-5fb0a050205a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:30.397707 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0af32-79bc-48b4-b013-d9932e10a305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:30.398479 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0af32-79bc-48b4-b013-d9932e10a305 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:30.398742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0af32-79bc-48b4-b013-d9932e10a305 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:30.399059 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0af32-79bc-48b4-b013-d9932e10a305 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:30.399921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0af32-79bc-48b4-b013-d9932e10a305 None admin] RBAC: Adding query filter params (role.id=73743e14bfe849198f3a8b549163f32b, scope.project.id=66f531bc924b41faa64743923afac319, user.id=e41a4d3a822c403fad048764a0edf209) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:30.400238 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0af32-79bc-48b4-b013-d9932e10a305 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:30.402226 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0af32-79bc-48b4-b013-d9932e10a305 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:30.418529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 324/655] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:55:30 2022] GET /identity/v3/role_assignments?user.id=e41a4d3a822c403fad048764a0edf209&scope.project.id=66f531bc924b41faa64743923afac319&role.id=73743e14bfe849198f3a8b549163f32b => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:30.418529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0af32-79bc-48b4-b013-d9932e10a305 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:30.468246 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:30.473174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f867c-6ed6-43e0-a735-708f43566ebb None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:30.516884 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f7dac-e916-42e3-bf02-62d7533448ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:30.518112 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f7dac-e916-42e3-bf02-62d7533448ef None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:30.518647 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f7dac-e916-42e3-bf02-62d7533448ef None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:30.519394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f7dac-e916-42e3-bf02-62d7533448ef None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:30.530139 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f7dac-e916-42e3-bf02-62d7533448ef None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:30.532082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f7dac-e916-42e3-bf02-62d7533448ef None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:30.548653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-dc3f7dac-e916-42e3-bf02-62d7533448ef None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 11:55:30.548653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:30.548653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:30.548653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:30.548653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:30.548653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:30.548653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:30.548653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:30.548653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:30.548653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:30.548653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:30.548653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:30.548653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:55:30.548653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:55:30.548653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:55:30.548653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:55:30.549688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:30.549688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:30.549688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:55:30.549688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:30.549688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:55:30.549688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:30.549688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:30.549688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:30.549688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:30.549688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:30.549688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:30.549688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:30.549688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:30.549688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:30.549688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:30.549688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:30.549688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:30.549688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:30.550685 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:30.550685 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:30.550685 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:55:30.550685 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:55:30.550685 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:55:30.550685 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:55:30.550685 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:55:30.550685 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:55:30.550685 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 11:55:30.550685 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:30.553791 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 332/656] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:55:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:30.555315 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f7dac-e916-42e3-bf02-62d7533448ef None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:30.565586 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0af32-79bc-48b4-b013-d9932e10a305 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:30.595155 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:30.620750 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c7ede-d228-45a5-b284-b08ed2bf9960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:30.621591 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c7ede-d228-45a5-b284-b08ed2bf9960 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:30.621965 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c7ede-d228-45a5-b284-b08ed2bf9960 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:30.622602 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c7ede-d228-45a5-b284-b08ed2bf9960 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:30.623339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c7ede-d228-45a5-b284-b08ed2bf9960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:30.623649 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c7ede-d228-45a5-b284-b08ed2bf9960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:30.625051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c7ede-d228-45a5-b284-b08ed2bf9960 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:30.640108 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 325/657] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:30.641142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c7ede-d228-45a5-b284-b08ed2bf9960 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:30.696365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f7dac-e916-42e3-bf02-62d7533448ef None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:30.737271 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba78a3-86ff-419f-930e-56182b100926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:30.737945 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba78a3-86ff-419f-930e-56182b100926 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:30.738229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba78a3-86ff-419f-930e-56182b100926 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:30.738527 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba78a3-86ff-419f-930e-56182b100926 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:30.739395 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba78a3-86ff-419f-930e-56182b100926 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:30.739817 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba78a3-86ff-419f-930e-56182b100926 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:30.741184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba78a3-86ff-419f-930e-56182b100926 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:30.752811 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:30.754616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 333/658] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:30.755643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba78a3-86ff-419f-930e-56182b100926 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:30.761474 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c7ede-d228-45a5-b284-b08ed2bf9960 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:30.805125 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2360af-50fb-425d-a4e1-1a1904acbefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:30.806213 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2360af-50fb-425d-a4e1-1a1904acbefe None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:30.806716 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2360af-50fb-425d-a4e1-1a1904acbefe None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:30.807275 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2360af-50fb-425d-a4e1-1a1904acbefe None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:30.808252 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2360af-50fb-425d-a4e1-1a1904acbefe None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:30.808725 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2360af-50fb-425d-a4e1-1a1904acbefe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:30.810467 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2360af-50fb-425d-a4e1-1a1904acbefe None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:30.831121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 326/659] 10.222.0.79 () {56 vars in 1137 bytes} [Thu Jul 14 11:55:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:30.832182 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2360af-50fb-425d-a4e1-1a1904acbefe None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:30.863016 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:30.874199 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba78a3-86ff-419f-930e-56182b100926 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:30.912350 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a4f5f-4f86-485b-b0fc-beea4a8210f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:30.913718 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a4f5f-4f86-485b-b0fc-beea4a8210f3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:30.913718 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a4f5f-4f86-485b-b0fc-beea4a8210f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:30.913925 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a4f5f-4f86-485b-b0fc-beea4a8210f3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:30.922069 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a4f5f-4f86-485b-b0fc-beea4a8210f3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:30.923672 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a4f5f-4f86-485b-b0fc-beea4a8210f3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:30.941431 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-ab7a4f5f-4f86-485b-b0fc-beea4a8210f3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 11:55:30.941431 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:30.941431 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:30.941431 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:30.941431 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:30.941431 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:30.941431 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:30.941431 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:30.941431 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:30.941431 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:30.941431 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:30.941431 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:30.941431 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:55:30.941431 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:55:30.941431 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:55:30.941431 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:55:30.942620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:30.942620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:30.942620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:55:30.942620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:30.942620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:55:30.942620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:30.942620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:30.942620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:30.942620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:30.942620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:30.942620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:30.942620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:30.942620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:30.942620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:30.942620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:30.942620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:30.942620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:30.942620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:30.943595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:30.943595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:30.943595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:55:30.943595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:55:30.943595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:55:30.943595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:55:30.943595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:55:30.943595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:55:30.943595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 11:55:30.943595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:30.943595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 334/660] 10.222.0.79 () {56 vars in 1102 bytes} [Thu Jul 14 11:55:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:30.944178 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a4f5f-4f86-485b-b0fc-beea4a8210f3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:30.952273 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2360af-50fb-425d-a4e1-1a1904acbefe None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:30.990720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b0121-5de2-438b-b8d9-4f17637a1f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:30.991914 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b0121-5de2-438b-b8d9-4f17637a1f20 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:30.992340 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b0121-5de2-438b-b8d9-4f17637a1f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:30.992753 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b0121-5de2-438b-b8d9-4f17637a1f20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:31.001520 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b0121-5de2-438b-b8d9-4f17637a1f20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:31.003786 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b0121-5de2-438b-b8d9-4f17637a1f20 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:31.020121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-217b0121-5de2-438b-b8d9-4f17637a1f20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:31.020121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:31.020121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:31.020121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:31.020121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:31.020121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:31.020121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:31.020121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:31.020121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:31.020121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:31.020121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:31.020121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:31.020121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:55:31.020121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:55:31.020121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:55:31.021191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:55:31.021191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:31.021191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:31.021191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:31.021191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:31.021191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:31.021191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:31.021191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:31.021191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:31.021191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:31.021191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:31.021191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:31.021191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:31.021191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:31.021191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:31.021191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:31.021191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:31.022196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:55:31.022196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:55:31.022196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:55:31.022196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:55:31.022196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:55:31.022196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:55:31.022196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:31.022196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:31.024064 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 327/661] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:31.025066 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b0121-5de2-438b-b8d9-4f17637a1f20 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:31.044017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:31.058128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a4f5f-4f86-485b-b0fc-beea4a8210f3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:31.096163 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393927f-c858-4d5d-a7d8-9ac19c74f7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:31.097215 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393927f-c858-4d5d-a7d8-9ac19c74f7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:31.097648 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393927f-c858-4d5d-a7d8-9ac19c74f7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:31.098120 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393927f-c858-4d5d-a7d8-9ac19c74f7b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:31.120590 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:31.141690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b0121-5de2-438b-b8d9-4f17637a1f20 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:31.177243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393927f-c858-4d5d-a7d8-9ac19c74f7b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:31.179362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393927f-c858-4d5d-a7d8-9ac19c74f7b2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:31.180019 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816553a-8c44-4a70-9491-665fd0db2044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:31.180699 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816553a-8c44-4a70-9491-665fd0db2044 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:31.180982 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816553a-8c44-4a70-9491-665fd0db2044 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:31.181257 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816553a-8c44-4a70-9491-665fd0db2044 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:31.182143 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816553a-8c44-4a70-9491-665fd0db2044 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:31.183057 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816553a-8c44-4a70-9491-665fd0db2044 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:31.185079 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816553a-8c44-4a70-9491-665fd0db2044 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:31.205489 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 328/662] 10.222.0.79 () {56 vars in 1139 bytes} [Thu Jul 14 11:55:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:31.206359 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816553a-8c44-4a70-9491-665fd0db2044 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:31.289114 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:31.303965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 335/663] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:55:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:31.305400 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393927f-c858-4d5d-a7d8-9ac19c74f7b2 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:31.324957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816553a-8c44-4a70-9491-665fd0db2044 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:31.368119 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:31.369294 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a857145-545c-4ca9-a647-c3bdda1e6167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:31.370048 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a857145-545c-4ca9-a647-c3bdda1e6167 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:31.370384 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a857145-545c-4ca9-a647-c3bdda1e6167 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:31.370895 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a857145-545c-4ca9-a647-c3bdda1e6167 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:31.371682 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a857145-545c-4ca9-a647-c3bdda1e6167 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:31.372070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a857145-545c-4ca9-a647-c3bdda1e6167 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:31.374564 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a857145-545c-4ca9-a647-c3bdda1e6167 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:31.389856 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 329/664] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:55:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:31.390769 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a857145-545c-4ca9-a647-c3bdda1e6167 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:31.428277 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393927f-c858-4d5d-a7d8-9ac19c74f7b2 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:31.471080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f52330-dadd-469b-b24a-e6727f813b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:31.472183 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f52330-dadd-469b-b24a-e6727f813b7b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:31.472790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f52330-dadd-469b-b24a-e6727f813b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:31.473268 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f52330-dadd-469b-b24a-e6727f813b7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:31.512045 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a857145-545c-4ca9-a647-c3bdda1e6167 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:31.545177 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:31.550817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90ceca-5611-4dc0-89a5-73ca8c9aaf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:31.551280 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f52330-dadd-469b-b24a-e6727f813b7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:31.552025 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90ceca-5611-4dc0-89a5-73ca8c9aaf06 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:31.552435 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90ceca-5611-4dc0-89a5-73ca8c9aaf06 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:31.552768 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90ceca-5611-4dc0-89a5-73ca8c9aaf06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:31.554102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f52330-dadd-469b-b24a-e6727f813b7b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:31.565612 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90ceca-5611-4dc0-89a5-73ca8c9aaf06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:31.567294 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90ceca-5611-4dc0-89a5-73ca8c9aaf06 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:31.587603 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-1d90ceca-5611-4dc0-89a5-73ca8c9aaf06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:31.587603 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:31.587603 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:31.587603 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:31.587603 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:31.587603 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:31.587603 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:31.587603 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:31.587603 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:31.587603 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:31.587603 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:31.587603 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:31.587603 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:31.587603 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:31.587603 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:31.589087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:31.589087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:31.589087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:31.589087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:31.589087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:31.589087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:31.589087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:31.589087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:31.589087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:31.589087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:31.589087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:31.589087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:31.589087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:31.589087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:31.589087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:31.589087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:31.589087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:31.589967 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:31.589967 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:31.589967 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:31.589967 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:31.593854 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 330/665] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:31.594854 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90ceca-5611-4dc0-89a5-73ca8c9aaf06 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:31.612157 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:31.670800 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 336/666] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:55:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:31.672186 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f52330-dadd-469b-b24a-e6727f813b7b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:31.712356 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90ceca-5611-4dc0-89a5-73ca8c9aaf06 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:31.750316 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc906f00-3c3e-4448-a9f2-db41445ce56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:31.751078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc906f00-3c3e-4448-a9f2-db41445ce56e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:31.751457 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc906f00-3c3e-4448-a9f2-db41445ce56e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:31.751796 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc906f00-3c3e-4448-a9f2-db41445ce56e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:31.752688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc906f00-3c3e-4448-a9f2-db41445ce56e None admin] RBAC: Adding query filter params (role.id=73743e14bfe849198f3a8b549163f32b, scope.project.id=66f531bc924b41faa64743923afac319, user.id=d6921990ec98492f8f4420f911208b84) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:31.753130 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc906f00-3c3e-4448-a9f2-db41445ce56e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:31.754595 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc906f00-3c3e-4448-a9f2-db41445ce56e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:31.770704 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 331/667] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:55:31 2022] GET /identity/v3/role_assignments?user.id=d6921990ec98492f8f4420f911208b84&scope.project.id=66f531bc924b41faa64743923afac319&role.id=73743e14bfe849198f3a8b549163f32b => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:31.770704 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd44a37-30d8-4b19-9ba6-78675e062308 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:31.770704 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd44a37-30d8-4b19-9ba6-78675e062308 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:31.770704 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd44a37-30d8-4b19-9ba6-78675e062308 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:31.770704 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 332/668] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:31.770704 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd44a37-30d8-4b19-9ba6-78675e062308 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:31.805657 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f52330-dadd-469b-b24a-e6727f813b7b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:31.852726 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:31.857747 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac802f2f-6a9a-471b-bbcc-eee827d313ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:31.858721 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac802f2f-6a9a-471b-bbcc-eee827d313ef None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:31.859185 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac802f2f-6a9a-471b-bbcc-eee827d313ef None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:31.859628 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac802f2f-6a9a-471b-bbcc-eee827d313ef None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:31.860920 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac802f2f-6a9a-471b-bbcc-eee827d313ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:31.861325 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac802f2f-6a9a-471b-bbcc-eee827d313ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:31.863187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac802f2f-6a9a-471b-bbcc-eee827d313ef None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:31.876114 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 337/669] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:31.877539 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c285d2-76e3-4250-aefe-702f73a73c83 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:31.877833 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c285d2-76e3-4250-aefe-702f73a73c83 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:31.878111 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c285d2-76e3-4250-aefe-702f73a73c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:31.900511 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-23c285d2-76e3-4250-aefe-702f73a73c83 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:31.902170 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-23c285d2-76e3-4250-aefe-702f73a73c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:31.907366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:31.924379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd44a37-30d8-4b19-9ba6-78675e062308 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:31.966909 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bec0c-9f94-4763-b38c-8cdeb084de0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:31.967825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bec0c-9f94-4763-b38c-8cdeb084de0d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:31.968677 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bec0c-9f94-4763-b38c-8cdeb084de0d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:31.968677 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bec0c-9f94-4763-b38c-8cdeb084de0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:31.981328 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460bec0c-9f94-4763-b38c-8cdeb084de0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:31.983004 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460bec0c-9f94-4763-b38c-8cdeb084de0d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:31.989292 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 338/670] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:31.990079 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c285d2-76e3-4250-aefe-702f73a73c83 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:32.017093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-460bec0c-9f94-4763-b38c-8cdeb084de0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:32.017093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:32.017093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:32.017093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:32.017093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:32.017093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:32.017093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:32.017093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:32.017093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:32.017093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:32.017093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:32.017093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:32.017093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:32.017093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:32.017093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:32.018375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:32.018375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:32.018375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:32.018375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:32.018375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:32.018375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:32.018375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:32.018375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:32.018375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:32.018375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:32.018375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:32.018375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:32.018375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:32.018375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:32.018375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:32.018375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:32.018375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:32.019277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:32.019277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:32.019277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:32.019277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:32.020410 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 333/671] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:32.020958 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bec0c-9f94-4763-b38c-8cdeb084de0d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:32.123345 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c285d2-76e3-4250-aefe-702f73a73c83 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:32.155925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bec0c-9f94-4763-b38c-8cdeb084de0d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:32.157814 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:32.173915 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53473793-d9d5-4389-80c4-549ca7acfbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:32.175597 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53473793-d9d5-4389-80c4-549ca7acfbb8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:32.175922 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53473793-d9d5-4389-80c4-549ca7acfbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:32.176303 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53473793-d9d5-4389-80c4-549ca7acfbb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:32.187003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53473793-d9d5-4389-80c4-549ca7acfbb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:32.188475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53473793-d9d5-4389-80c4-549ca7acfbb8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:32.195582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:32.209096 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed895f3c-08f4-4d2b-934e-6fad2eaab02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:32.209347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-53473793-d9d5-4389-80c4-549ca7acfbb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:32.209347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:32.209347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:32.209347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:32.209347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:32.209347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:32.209347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:32.209347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:32.209347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:32.209347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:32.209347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:32.209347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:32.209347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:55:32.209347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:55:32.209347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:55:32.210219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:55:32.210219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:32.210219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:32.210219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:32.210219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:32.210219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:32.210219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:32.210219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:32.210219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:32.210219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:32.210219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:32.210219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:32.210219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:32.210219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:32.210219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:32.210219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:32.210219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:32.211201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:55:32.211201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:55:32.211201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:55:32.211201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:55:32.211201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:55:32.211201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:55:32.211201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:32.211201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:32.213852 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed895f3c-08f4-4d2b-934e-6fad2eaab02d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:32.214439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed895f3c-08f4-4d2b-934e-6fad2eaab02d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:32.214999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed895f3c-08f4-4d2b-934e-6fad2eaab02d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:32.215643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 339/672] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:32.216637 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53473793-d9d5-4389-80c4-549ca7acfbb8 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:32.232017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed895f3c-08f4-4d2b-934e-6fad2eaab02d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:32.243021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-ed895f3c-08f4-4d2b-934e-6fad2eaab02d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:32.243021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:32.243021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:32.243021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:32.243021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:32.243021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:32.243021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:32.243021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:32.243021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:32.243021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:32.243021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:32.243021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:32.243021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:32.243021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:32.243021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:32.243021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:32.244017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:32.244017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:32.244017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:32.244017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:32.244017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:32.244017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:32.244017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:32.244017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:32.244017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:32.244017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:32.244017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:32.244017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:32.244017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:32.244017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:32.244017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:32.244017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:32.245430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:32.245430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:32.245430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:32.245430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:32.245430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:32.245430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:32.245430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:32.245430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:32.245430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:32.245430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:32.245430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:32.245430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:32.248969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 334/673] 10.222.0.79 () {56 vars in 1102 bytes} [Thu Jul 14 11:55:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:32.250318 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed895f3c-08f4-4d2b-934e-6fad2eaab02d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:32.373241 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53473793-d9d5-4389-80c4-549ca7acfbb8 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:32.382574 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed895f3c-08f4-4d2b-934e-6fad2eaab02d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:32.424803 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2b0d1-8c58-45aa-ae21-93ae5d843aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:32.426215 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2b0d1-8c58-45aa-ae21-93ae5d843aab None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:32.426952 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2b0d1-8c58-45aa-ae21-93ae5d843aab None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:32.427672 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2b0d1-8c58-45aa-ae21-93ae5d843aab None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:32.428720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2b0d1-8c58-45aa-ae21-93ae5d843aab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:32.429288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2b0d1-8c58-45aa-ae21-93ae5d843aab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:32.431104 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2b0d1-8c58-45aa-ae21-93ae5d843aab None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:32.434424 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e363f-e4db-4877-bafa-1a3ba9173eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:32.435747 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e363f-e4db-4877-bafa-1a3ba9173eac None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:32.436353 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e363f-e4db-4877-bafa-1a3ba9173eac None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:32.436969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e363f-e4db-4877-bafa-1a3ba9173eac None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:32.438424 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e363f-e4db-4877-bafa-1a3ba9173eac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:32.439115 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e363f-e4db-4877-bafa-1a3ba9173eac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:32.441719 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e363f-e4db-4877-bafa-1a3ba9173eac None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:32.447144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 335/674] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:55:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:32.448860 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2b0d1-8c58-45aa-ae21-93ae5d843aab None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:32.472488 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 340/675] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:32.472718 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:32.474267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e363f-e4db-4877-bafa-1a3ba9173eac None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:32.572027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2b0d1-8c58-45aa-ae21-93ae5d843aab None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:32.580678 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:32.615553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52542cb-af52-4cc5-a901-949de72ccd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:32.616520 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52542cb-af52-4cc5-a901-949de72ccd07 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:32.616972 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52542cb-af52-4cc5-a901-949de72ccd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:32.617399 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52542cb-af52-4cc5-a901-949de72ccd07 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:32.618665 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52542cb-af52-4cc5-a901-949de72ccd07 None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:32.619129 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52542cb-af52-4cc5-a901-949de72ccd07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:32.621022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52542cb-af52-4cc5-a901-949de72ccd07 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:32.631843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 336/676] 10.222.0.79 () {56 vars in 1103 bytes} [Thu Jul 14 11:55:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:32.633021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52542cb-af52-4cc5-a901-949de72ccd07 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:32.658051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e363f-e4db-4877-bafa-1a3ba9173eac None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:32.718114 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27104b-6138-44fe-89f0-6e70883fd25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:32.719247 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27104b-6138-44fe-89f0-6e70883fd25f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:32.719709 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27104b-6138-44fe-89f0-6e70883fd25f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:32.720430 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27104b-6138-44fe-89f0-6e70883fd25f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:32.721923 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27104b-6138-44fe-89f0-6e70883fd25f None admin] RBAC: Adding query filter params (role.id=73743e14bfe849198f3a8b549163f32b, scope.project.id=66f531bc924b41faa64743923afac319, user.id=7deede571e7d42408c2fb86665eccfe7) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:32.722341 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27104b-6138-44fe-89f0-6e70883fd25f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:32.725147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27104b-6138-44fe-89f0-6e70883fd25f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:32.725661 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:32.746889 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 341/677] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:55:32 2022] GET /identity/v3/role_assignments?user.id=7deede571e7d42408c2fb86665eccfe7&scope.project.id=66f531bc924b41faa64743923afac319&role.id=73743e14bfe849198f3a8b549163f32b => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:32.748531 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27104b-6138-44fe-89f0-6e70883fd25f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:32.752364 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52542cb-af52-4cc5-a901-949de72ccd07 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:32.792555 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dc52a-94a8-4fcb-aa1c-f1820b6fe5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:32.793371 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dc52a-94a8-4fcb-aa1c-f1820b6fe5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:32.793653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dc52a-94a8-4fcb-aa1c-f1820b6fe5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:32.793929 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dc52a-94a8-4fcb-aa1c-f1820b6fe5d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:32.802102 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dc52a-94a8-4fcb-aa1c-f1820b6fe5d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:32.803759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dc52a-94a8-4fcb-aa1c-f1820b6fe5d6 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:32.820060 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-f55dc52a-94a8-4fcb-aa1c-f1820b6fe5d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:32.820060 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:32.820060 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:32.820060 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:32.820060 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:32.820060 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:32.820060 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:32.820060 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:32.820060 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:32.820060 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:32.820060 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:32.820060 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:32.820060 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:55:32.820060 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:55:32.820060 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:55:32.821054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:55:32.821054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:32.821054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:32.821054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:32.821054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:32.821054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:32.821054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:32.821054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:32.821054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:32.821054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:32.821054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:32.821054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:32.821054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:32.821054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:32.821054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:32.821054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:32.821054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:32.822001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:55:32.822001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:55:32.822001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:55:32.822001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:55:32.822001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:55:32.822001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:55:32.822001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:32.822001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:32.822001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 337/678] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:32.823281 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219bb02-146d-4ece-a0a9-7db6c2456317 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:32.823575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219bb02-146d-4ece-a0a9-7db6c2456317 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:32.823854 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219bb02-146d-4ece-a0a9-7db6c2456317 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:32.829253 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 338/679] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:32.829253 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219bb02-146d-4ece-a0a9-7db6c2456317 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:32.908447 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27104b-6138-44fe-89f0-6e70883fd25f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:32.935497 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:32.947822 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758ac75-0ddd-4fcc-ad70-0f8150c27bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:32.948762 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758ac75-0ddd-4fcc-ad70-0f8150c27bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:32.949186 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758ac75-0ddd-4fcc-ad70-0f8150c27bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:32.949593 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758ac75-0ddd-4fcc-ad70-0f8150c27bc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:32.962038 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758ac75-0ddd-4fcc-ad70-0f8150c27bc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:32.964209 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758ac75-0ddd-4fcc-ad70-0f8150c27bc1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:32.970225 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219bb02-146d-4ece-a0a9-7db6c2456317 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:32.987568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-a758ac75-0ddd-4fcc-ad70-0f8150c27bc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:32.987568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:32.987568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:32.987568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:32.987568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:32.987568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:32.987568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:32.987568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:32.987568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:32.987568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:32.987568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:32.987568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:32.987568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:32.987568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:32.987568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:32.988554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:32.988554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:32.988554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:32.988554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:32.988554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:32.988554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:32.988554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:32.988554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:32.988554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:32.988554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:32.988554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:32.988554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:32.988554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:32.988554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:32.988554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:32.988554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:32.988554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:32.989467 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:32.989467 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:32.989467 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:32.989467 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:32.990127 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 342/680] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:32.992016 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d6423-da45-4dda-9f60-6c53dc76278e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:32.992303 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d6423-da45-4dda-9f60-6c53dc76278e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:32.992583 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d6423-da45-4dda-9f60-6c53dc76278e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:33.012344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-298d6423-da45-4dda-9f60-6c53dc76278e None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:33.013534 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-298d6423-da45-4dda-9f60-6c53dc76278e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:33.018743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380c78d-fcf6-4710-b80c-b3d0e0ac5ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:33.019584 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380c78d-fcf6-4710-b80c-b3d0e0ac5ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:33.019692 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380c78d-fcf6-4710-b80c-b3d0e0ac5ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:33.020718 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380c78d-fcf6-4710-b80c-b3d0e0ac5ad5 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:33.020893 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380c78d-fcf6-4710-b80c-b3d0e0ac5ad5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:33.021170 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380c78d-fcf6-4710-b80c-b3d0e0ac5ad5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:33.022777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380c78d-fcf6-4710-b80c-b3d0e0ac5ad5 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:33.036215 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 339/681] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:55:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:33.036877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380c78d-fcf6-4710-b80c-b3d0e0ac5ad5 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:33.041514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:33.102672 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 343/682] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:33.110515 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d6423-da45-4dda-9f60-6c53dc76278e None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:33.190538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380c78d-fcf6-4710-b80c-b3d0e0ac5ad5 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:33.230879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb29344-f596-4d03-a32c-6f08e28a3b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:33.231941 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb29344-f596-4d03-a32c-6f08e28a3b24 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:33.232436 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb29344-f596-4d03-a32c-6f08e28a3b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:33.232920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb29344-f596-4d03-a32c-6f08e28a3b24 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:33.233885 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb29344-f596-4d03-a32c-6f08e28a3b24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:33.234402 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb29344-f596-4d03-a32c-6f08e28a3b24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:33.236034 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb29344-f596-4d03-a32c-6f08e28a3b24 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:33.249703 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 340/683] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:33.251002 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb29344-f596-4d03-a32c-6f08e28a3b24 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:33.251981 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d6423-da45-4dda-9f60-6c53dc76278e None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:33.262773 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:33.295176 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cffed-3f35-49f5-88db-b52b02046111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:33.295844 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cffed-3f35-49f5-88db-b52b02046111 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:33.296128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cffed-3f35-49f5-88db-b52b02046111 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:33.296403 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cffed-3f35-49f5-88db-b52b02046111 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:33.297246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26cffed-3f35-49f5-88db-b52b02046111 None admin] RBAC: Adding query filter params (role.id=73743e14bfe849198f3a8b549163f32b, scope.project.id=66f531bc924b41faa64743923afac319, user.id=2fedd4e015384379bf41c2e01ecc0a6a) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:33.297559 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26cffed-3f35-49f5-88db-b52b02046111 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:33.299190 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26cffed-3f35-49f5-88db-b52b02046111 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:33.306900 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 344/684] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:55:33 2022] GET /identity/v3/role_assignments?user.id=2fedd4e015384379bf41c2e01ecc0a6a&scope.project.id=66f531bc924b41faa64743923afac319&role.id=73743e14bfe849198f3a8b549163f32b => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:33.308291 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cffed-3f35-49f5-88db-b52b02046111 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:33.325798 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:33.371629 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb29344-f596-4d03-a32c-6f08e28a3b24 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:33.410084 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b5181-72d1-4f4e-90f8-397e408ced54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:33.411488 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b5181-72d1-4f4e-90f8-397e408ced54 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:33.412007 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b5181-72d1-4f4e-90f8-397e408ced54 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:33.412497 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b5181-72d1-4f4e-90f8-397e408ced54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:33.424925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b5181-72d1-4f4e-90f8-397e408ced54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:33.426884 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cffed-3f35-49f5-88db-b52b02046111 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:33.434229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-3a8b5181-72d1-4f4e-90f8-397e408ced54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:55:33.434229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:33.434229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:33.434229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:33.434229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:33.434229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:33.434229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:33.434229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:33.434229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:33.434229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:33.434229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:33.434229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:33.434229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:33.434229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:33.434229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:33.434229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:33.435277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:33.435277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:33.435277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:33.435277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:33.435277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:33.435277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:33.435277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:33.435277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:33.435277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:33.435277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:33.435277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:33.435277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:33.435277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:33.435277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:33.435277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:33.435277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:33.436117 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:33.436117 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:33.436117 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:33.436117 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:33.436117 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:33.436117 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:33.436117 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:33.436117 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:33.436117 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:33.436117 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:33.436117 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:55:33.436117 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:33.439091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 341/685] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:55:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:33.445409 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b5181-72d1-4f4e-90f8-397e408ced54 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:33.475871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96958b-b863-4fb4-82d1-b4b68d1c7215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:33.476871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96958b-b863-4fb4-82d1-b4b68d1c7215 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:33.476987 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96958b-b863-4fb4-82d1-b4b68d1c7215 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:33.477240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96958b-b863-4fb4-82d1-b4b68d1c7215 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:33.499996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96958b-b863-4fb4-82d1-b4b68d1c7215 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:33.501776 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96958b-b863-4fb4-82d1-b4b68d1c7215 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:33.534428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-5e96958b-b863-4fb4-82d1-b4b68d1c7215 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 11:55:33.534428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:33.534428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:33.534428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:33.534428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:33.534428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:33.534428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:33.534428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:33.534428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:33.534428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:33.534428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:33.534428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:33.534428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:55:33.534428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:55:33.534428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:55:33.534428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:55:33.535456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:33.535456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:33.535456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:55:33.535456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:33.535456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:55:33.535456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:33.535456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:33.535456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:33.535456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:33.535456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:33.535456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:33.535456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:33.535456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:33.535456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:33.535456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:33.535456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:33.535456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:33.535456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:33.536393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:33.536393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:33.536393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:55:33.536393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:55:33.536393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:55:33.536393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:55:33.536393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:55:33.536393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:55:33.536393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 11:55:33.536393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:33.536393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 345/686] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:55:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:33.543703 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96958b-b863-4fb4-82d1-b4b68d1c7215 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:33.581961 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:33.592024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b5181-72d1-4f4e-90f8-397e408ced54 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:33.624989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:33.644336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538861d-0375-44fa-8d2e-4992586331d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:33.645380 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538861d-0375-44fa-8d2e-4992586331d5 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:33.646348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538861d-0375-44fa-8d2e-4992586331d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:33.646867 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538861d-0375-44fa-8d2e-4992586331d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:33.648253 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538861d-0375-44fa-8d2e-4992586331d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:33.649041 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538861d-0375-44fa-8d2e-4992586331d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:33.651517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538861d-0375-44fa-8d2e-4992586331d5 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:33.665015 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 342/687] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:55:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:55:33.671222 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538861d-0375-44fa-8d2e-4992586331d5 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:33.673234 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96958b-b863-4fb4-82d1-b4b68d1c7215 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:33.719491 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e51e8-9ea0-4572-88fb-6bf0417edb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:33.720325 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e51e8-9ea0-4572-88fb-6bf0417edb01 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:33.720719 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e51e8-9ea0-4572-88fb-6bf0417edb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:33.721086 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e51e8-9ea0-4572-88fb-6bf0417edb01 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:33.722113 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e51e8-9ea0-4572-88fb-6bf0417edb01 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:33.722577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e51e8-9ea0-4572-88fb-6bf0417edb01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:33.724085 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e51e8-9ea0-4572-88fb-6bf0417edb01 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:33.747397 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 346/688] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Jul 14 11:55:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:33.752851 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e51e8-9ea0-4572-88fb-6bf0417edb01 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:33.842504 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538861d-0375-44fa-8d2e-4992586331d5 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:33.882683 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:33.898471 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e51e8-9ea0-4572-88fb-6bf0417edb01 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:33.938163 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66b434-678b-407e-a874-baf6f4ceee4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:33.938959 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66b434-678b-407e-a874-baf6f4ceee4b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:33.939145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66b434-678b-407e-a874-baf6f4ceee4b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:33.939426 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66b434-678b-407e-a874-baf6f4ceee4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:33.968577 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1164a43-a7b7-4f85-8770-e5f7b3b138f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:33.969383 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1164a43-a7b7-4f85-8770-e5f7b3b138f6 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:33.969669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1164a43-a7b7-4f85-8770-e5f7b3b138f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:33.969947 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1164a43-a7b7-4f85-8770-e5f7b3b138f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:34.011711 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1164a43-a7b7-4f85-8770-e5f7b3b138f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:34.013125 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1164a43-a7b7-4f85-8770-e5f7b3b138f6 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:34.014279 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66b434-678b-407e-a874-baf6f4ceee4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:34.015759 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66b434-678b-407e-a874-baf6f4ceee4b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:34.054847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-c1164a43-a7b7-4f85-8770-e5f7b3b138f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:34.054847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:34.054847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:34.054847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:34.054847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:34.054847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:34.054847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:34.054847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:34.054847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:34.054847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:34.054847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:34.054847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:34.054847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:34.054847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:34.054847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:34.056115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:34.056115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:34.056115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:34.056115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:34.056115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:34.056115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:34.056115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:34.056115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:34.056115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:34.056115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:34.056115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:34.056115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:34.056115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:34.056115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:34.056115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:34.056115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:34.056115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:34.057016 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:34.057016 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:34.057016 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:34.057016 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:34.060661 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 343/689] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:34.061927 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1164a43-a7b7-4f85-8770-e5f7b3b138f6 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:34.122706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:34.153450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 347/690] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:55:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 11:55:34.153750 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:34.159311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66b434-678b-407e-a874-baf6f4ceee4b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:34.237738 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1164a43-a7b7-4f85-8770-e5f7b3b138f6 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:34.277297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44381b0-2bd3-4446-b305-f3a4843a28f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:34.277901 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44381b0-2bd3-4446-b305-f3a4843a28f3 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:34.278189 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44381b0-2bd3-4446-b305-f3a4843a28f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:34.278472 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44381b0-2bd3-4446-b305-f3a4843a28f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:34.279246 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44381b0-2bd3-4446-b305-f3a4843a28f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:34.279563 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44381b0-2bd3-4446-b305-f3a4843a28f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:34.280958 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44381b0-2bd3-4446-b305-f3a4843a28f3 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:34.295398 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 344/691] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:55:34.296796 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40fa7e-eb4c-4a70-9c69-641bead56032 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:34.297096 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40fa7e-eb4c-4a70-9c69-641bead56032 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:34.297372 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40fa7e-eb4c-4a70-9c69-641bead56032 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:34.303006 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 345/692] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:34.303006 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40fa7e-eb4c-4a70-9c69-641bead56032 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:34.359459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66b434-678b-407e-a874-baf6f4ceee4b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:34.404590 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6365e3e-94a2-42d2-b51e-cef127bd9f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:34.405399 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6365e3e-94a2-42d2-b51e-cef127bd9f40 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:34.406036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6365e3e-94a2-42d2-b51e-cef127bd9f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:34.406324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6365e3e-94a2-42d2-b51e-cef127bd9f40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:34.419732 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6365e3e-94a2-42d2-b51e-cef127bd9f40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:34.421926 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6365e3e-94a2-42d2-b51e-cef127bd9f40 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:34.424290 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:34.433686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40fa7e-eb4c-4a70-9c69-641bead56032 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:34.445173 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-b6365e3e-94a2-42d2-b51e-cef127bd9f40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:34.445173 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:34.445173 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:34.445173 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:34.445173 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:34.445173 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:34.445173 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:34.445173 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:34.445173 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:34.445173 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:34.445173 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:34.445173 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:34.445173 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:34.445173 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:34.445173 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:34.446254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:34.446254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:34.446254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:34.446254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:34.446254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:34.446254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:34.446254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:34.446254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:34.446254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:34.446254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:34.446254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:34.446254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:34.446254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:34.446254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:34.446254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:34.446254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:34.446254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:34.447286 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:34.447286 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:34.447286 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:34.447286 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:34.450563 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 348/693] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:34.451984 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8a28c-86ba-4884-9d89-aee1d4117406 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:34.453128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8a28c-86ba-4884-9d89-aee1d4117406 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:34.453409 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8a28c-86ba-4884-9d89-aee1d4117406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:34.480947 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-64c8a28c-86ba-4884-9d89-aee1d4117406 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:34.482124 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-64c8a28c-86ba-4884-9d89-aee1d4117406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:34.482829 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deba310-af44-455c-8b96-bc563fa600e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:34.483888 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deba310-af44-455c-8b96-bc563fa600e2 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:34.484493 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deba310-af44-455c-8b96-bc563fa600e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:34.485124 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deba310-af44-455c-8b96-bc563fa600e2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:34.493565 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deba310-af44-455c-8b96-bc563fa600e2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:34.496065 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deba310-af44-455c-8b96-bc563fa600e2 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:34.513028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-6deba310-af44-455c-8b96-bc563fa600e2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:55:34.513028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:34.513028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:34.513028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:34.513028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:34.513028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:34.513028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:34.513028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:34.513028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:34.513028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:34.513028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:34.513028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:34.513028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:55:34.513028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:55:34.513028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:55:34.513028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:55:34.514023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:34.514023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:34.514023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:55:34.514023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:34.514023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:55:34.514023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:34.514023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:34.514023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:34.514023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:34.514023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:34.514023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:34.514023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:34.514023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:34.514023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:34.514023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:34.514023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:34.514023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:34.514023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:34.514973 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:34.514973 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:34.514973 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:55:34.514973 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:55:34.514973 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:55:34.514973 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:55:34.514973 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:55:34.514973 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:55:34.514973 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:55:34.514973 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:34.517838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 346/694] 10.222.0.79 () {56 vars in 1093 bytes} [Thu Jul 14 11:55:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:55:34.518982 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deba310-af44-455c-8b96-bc563fa600e2 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:34.521591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:34.564153 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 349/695] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:34.566041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8a28c-86ba-4884-9d89-aee1d4117406 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:34.642655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deba310-af44-455c-8b96-bc563fa600e2 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:34.679172 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26dbc1-2d69-4e91-9b31-9d6a937a49fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:34.679951 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26dbc1-2d69-4e91-9b31-9d6a937a49fb None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:34.680430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26dbc1-2d69-4e91-9b31-9d6a937a49fb None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:34.680892 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26dbc1-2d69-4e91-9b31-9d6a937a49fb None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:34.682218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26dbc1-2d69-4e91-9b31-9d6a937a49fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:34.682731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26dbc1-2d69-4e91-9b31-9d6a937a49fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:34.684138 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26dbc1-2d69-4e91-9b31-9d6a937a49fb None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:34.695304 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8a28c-86ba-4884-9d89-aee1d4117406 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:34.698539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 347/696] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:34.698539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26dbc1-2d69-4e91-9b31-9d6a937a49fb None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:34.717144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:34.755257 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb705fcf-99a5-43da-ab17-c279a96504b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:34.756362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb705fcf-99a5-43da-ab17-c279a96504b4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:34.757453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb705fcf-99a5-43da-ab17-c279a96504b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:34.758020 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb705fcf-99a5-43da-ab17-c279a96504b4 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:34.759625 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb705fcf-99a5-43da-ab17-c279a96504b4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:34.760285 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb705fcf-99a5-43da-ab17-c279a96504b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:34.762707 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb705fcf-99a5-43da-ab17-c279a96504b4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:34.787797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 350/697] 10.222.0.79 () {56 vars in 1133 bytes} [Thu Jul 14 11:55:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:34.788675 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb705fcf-99a5-43da-ab17-c279a96504b4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:34.820195 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:34.831361 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26dbc1-2d69-4e91-9b31-9d6a937a49fb None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:34.868345 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6d433-7efa-4db3-983d-e4c836a73864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:34.869616 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6d433-7efa-4db3-983d-e4c836a73864 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:34.870640 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6d433-7efa-4db3-983d-e4c836a73864 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:34.871154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6d433-7efa-4db3-983d-e4c836a73864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:34.882219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6d433-7efa-4db3-983d-e4c836a73864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:34.884038 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6d433-7efa-4db3-983d-e4c836a73864 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:34.899462 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb705fcf-99a5-43da-ab17-c279a96504b4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:34.902746 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-70f6d433-7efa-4db3-983d-e4c836a73864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:34.902746 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:34.902746 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:34.902746 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:34.902746 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:34.902746 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:34.902746 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:34.902746 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:34.902746 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:34.902746 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:34.902746 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:34.902746 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:34.902746 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:34.902746 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:34.902746 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:34.903621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:34.903621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:34.903621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:34.903621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:34.903621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:34.903621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:34.903621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:34.903621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:34.903621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:34.903621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:34.903621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:34.903621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:34.903621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:34.903621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:34.903621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:34.903621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:34.903621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:34.904507 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:34.904507 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:34.904507 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:34.904507 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:34.912141 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 348/698] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:34.913303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6d433-7efa-4db3-983d-e4c836a73864 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:34.937486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df844b-a0f9-4fa9-80c5-1fa15f56f4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:34.938284 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df844b-a0f9-4fa9-80c5-1fa15f56f4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:34.938842 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df844b-a0f9-4fa9-80c5-1fa15f56f4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:34.938842 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df844b-a0f9-4fa9-80c5-1fa15f56f4c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:34.946472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df844b-a0f9-4fa9-80c5-1fa15f56f4c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:34.947995 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df844b-a0f9-4fa9-80c5-1fa15f56f4c3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:34.962549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-b3df844b-a0f9-4fa9-80c5-1fa15f56f4c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:34.962549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:34.962549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:34.962549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:34.962549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:34.962549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:34.962549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:34.962549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:34.962549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:34.962549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:34.962549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:34.962549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:34.962549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:55:34.962549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:55:34.962549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:55:34.963643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:55:34.963643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:34.963643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:34.963643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:34.963643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:34.963643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:34.963643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:34.963643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:34.963643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:34.963643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:34.963643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:34.963643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:34.963643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:34.963643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:34.963643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:34.963643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:34.963643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:34.964610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:55:34.964610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:55:34.964610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:55:34.964610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:55:34.964610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:55:34.964610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:55:34.964610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:34.964610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:34.968563 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 351/699] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:34.969464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df844b-a0f9-4fa9-80c5-1fa15f56f4c3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:34.992084 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:35.029597 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6d433-7efa-4db3-983d-e4c836a73864 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:35.063852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:35.066909 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f15e9-8b1e-451e-b08e-dc8f7052bc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:35.068244 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f15e9-8b1e-451e-b08e-dc8f7052bc12 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:35.068745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f15e9-8b1e-451e-b08e-dc8f7052bc12 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:35.069236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f15e9-8b1e-451e-b08e-dc8f7052bc12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:35.078409 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df844b-a0f9-4fa9-80c5-1fa15f56f4c3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:35.114249 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd68eb-c2f6-462d-9c38-52db1a07709e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:35.114956 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd68eb-c2f6-462d-9c38-52db1a07709e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:35.115242 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd68eb-c2f6-462d-9c38-52db1a07709e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:35.115519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd68eb-c2f6-462d-9c38-52db1a07709e None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:35.116248 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd68eb-c2f6-462d-9c38-52db1a07709e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:35.116560 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd68eb-c2f6-462d-9c38-52db1a07709e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:35.117923 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd68eb-c2f6-462d-9c38-52db1a07709e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:35.134550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 352/700] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:35.134550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd68eb-c2f6-462d-9c38-52db1a07709e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:35.148962 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f15e9-8b1e-451e-b08e-dc8f7052bc12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:35.151377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f15e9-8b1e-451e-b08e-dc8f7052bc12 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:35.223496 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:35.245465 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd68eb-c2f6-462d-9c38-52db1a07709e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:35.261312 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 349/701] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:55:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:35.262796 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22f344-67af-4700-93f4-03d74dc454b9 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:35.263146 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22f344-67af-4700-93f4-03d74dc454b9 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:35.263516 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22f344-67af-4700-93f4-03d74dc454b9 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:35.268917 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 350/702] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:35.268917 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22f344-67af-4700-93f4-03d74dc454b9 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:35.288244 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1081d7-83ce-46fb-a20c-e6624baf2265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:35.288940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1081d7-83ce-46fb-a20c-e6624baf2265 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:35.289230 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1081d7-83ce-46fb-a20c-e6624baf2265 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:35.289542 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1081d7-83ce-46fb-a20c-e6624baf2265 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:35.290298 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1081d7-83ce-46fb-a20c-e6624baf2265 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:35.290646 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1081d7-83ce-46fb-a20c-e6624baf2265 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:35.292177 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1081d7-83ce-46fb-a20c-e6624baf2265 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:35.309811 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 353/703] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:55:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:35.309811 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1081d7-83ce-46fb-a20c-e6624baf2265 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:35.323702 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:35.396328 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22f344-67af-4700-93f4-03d74dc454b9 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:35.430224 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1081d7-83ce-46fb-a20c-e6624baf2265 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:35.434219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e01df-32fc-4062-86eb-e3729ff28614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:35.434951 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e01df-32fc-4062-86eb-e3729ff28614 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:35.435239 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e01df-32fc-4062-86eb-e3729ff28614 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:35.435520 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e01df-32fc-4062-86eb-e3729ff28614 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:35.436255 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e01df-32fc-4062-86eb-e3729ff28614 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:35.437745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e01df-32fc-4062-86eb-e3729ff28614 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:35.464773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 351/704] 10.222.0.79 () {60 vars in 1132 bytes} [Thu Jul 14 11:55:35 2022] POST /identity/v3/users => generated 254 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:55:35.466466 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecde34-15fc-4d75-a493-b04f2a8bbfaa None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:35.466897 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecde34-15fc-4d75-a493-b04f2a8bbfaa None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:35.467288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecde34-15fc-4d75-a493-b04f2a8bbfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:35.486288 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1830a-5824-47b6-bef8-879e03f9e24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:35.487464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1830a-5824-47b6-bef8-879e03f9e24c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:35.487925 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1830a-5824-47b6-bef8-879e03f9e24c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:35.488353 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1830a-5824-47b6-bef8-879e03f9e24c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:35.491885 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-f4ecde34-15fc-4d75-a493-b04f2a8bbfaa None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:35.493312 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-f4ecde34-15fc-4d75-a493-b04f2a8bbfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:35.503787 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1830a-5824-47b6-bef8-879e03f9e24c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:35.505763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1830a-5824-47b6-bef8-879e03f9e24c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:35.516209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:35.531149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f6b1830a-5824-47b6-bef8-879e03f9e24c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:35.531149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:35.531149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:35.531149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:35.531149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:35.531149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:35.531149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:35.531149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:35.531149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:35.531149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:35.531149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:35.531149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:35.531149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:35.531149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:35.531149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:35.532141 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:35.532141 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:35.532141 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:35.532141 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:35.532141 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:35.532141 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:35.532141 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:35.532141 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:35.532141 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:35.532141 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:35.532141 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:35.532141 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:35.532141 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:35.532141 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:35.532141 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:35.532141 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:35.532141 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:35.533033 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:35.533033 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:35.533033 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:35.533033 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:35.533033 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 354/705] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:35.534123 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1830a-5824-47b6-bef8-879e03f9e24c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:35.585207 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 352/706] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:35.586468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecde34-15fc-4d75-a493-b04f2a8bbfaa None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:35.640802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:35.702782 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1830a-5824-47b6-bef8-879e03f9e24c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:35.714311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecde34-15fc-4d75-a493-b04f2a8bbfaa None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:35.756711 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b366941-70d2-4675-ae2c-05a63a569068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:35.757421 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b366941-70d2-4675-ae2c-05a63a569068 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:35.757668 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b366941-70d2-4675-ae2c-05a63a569068 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:35.757945 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b366941-70d2-4675-ae2c-05a63a569068 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:35.758541 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcda0c-a5bb-46e2-a426-34fa487e9524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:35.758730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b366941-70d2-4675-ae2c-05a63a569068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:35.759024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b366941-70d2-4675-ae2c-05a63a569068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:35.759251 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcda0c-a5bb-46e2-a426-34fa487e9524 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:35.759482 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcda0c-a5bb-46e2-a426-34fa487e9524 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:35.759753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcda0c-a5bb-46e2-a426-34fa487e9524 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:35.760528 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b366941-70d2-4675-ae2c-05a63a569068 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:35.760747 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdcda0c-a5bb-46e2-a426-34fa487e9524 None admin] RBAC: Adding query filter params (role.id=73743e14bfe849198f3a8b549163f32b, scope.project.id=66f531bc924b41faa64743923afac319, user.id=969ee98dfe644ef2a016860aa1585317) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:35.761098 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdcda0c-a5bb-46e2-a426-34fa487e9524 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:35.762632 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdcda0c-a5bb-46e2-a426-34fa487e9524 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:35.769467 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 355/707] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:55:35 2022] GET /identity/v3/role_assignments?user.id=969ee98dfe644ef2a016860aa1585317&scope.project.id=66f531bc924b41faa64743923afac319&role.id=73743e14bfe849198f3a8b549163f32b => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:35.770163 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcda0c-a5bb-46e2-a426-34fa487e9524 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:35.779062 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 353/708] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:35.779062 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a966ced-4983-4fa4-a210-10bd128ababd None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:35.779062 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a966ced-4983-4fa4-a210-10bd128ababd None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:35.779062 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a966ced-4983-4fa4-a210-10bd128ababd None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:35.780385 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 354/709] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:35.784350 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a966ced-4983-4fa4-a210-10bd128ababd None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:35.809795 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:35.904108 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcda0c-a5bb-46e2-a426-34fa487e9524 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:35.938751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:35.952980 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a966ced-4983-4fa4-a210-10bd128ababd None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:35.957900 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307e64d-4520-4272-a791-8e0991609401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:35.958917 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307e64d-4520-4272-a791-8e0991609401 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:35.959276 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307e64d-4520-4272-a791-8e0991609401 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:35.959622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307e64d-4520-4272-a791-8e0991609401 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:35.960388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307e64d-4520-4272-a791-8e0991609401 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:35.961825 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307e64d-4520-4272-a791-8e0991609401 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:35.978921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-2307e64d-4520-4272-a791-8e0991609401 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:55:35.978921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:35.978921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:55:35.978921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:55:35.978921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:55:35.978921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:55:35.978921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:55:35.978921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:55:35.978921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:55:35.978921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:35.978921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:55:35.978921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:35.978921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:35.978921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:35.978921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:35.978921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:35.980369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:35.980369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:35.980369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:35.980369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:35.980369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:35.980369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:35.980369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:35.980369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:55:35.980369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:55:35.980369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:55:35.980369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:55:35.980369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:35.980369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:35.980369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:35.980369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:35.980369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:35.981175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:35.981175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:35.981175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:35.981175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:35.981175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:35.981175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:35.981175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:35.981175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:35.981175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:35.981175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:35.981175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:35.981175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:55:35.981175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:55:35.981175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:55:35.981175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:35.983814 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 356/710] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Jul 14 11:55:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:35.985326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432a171-8601-4b3f-8923-4d0479313253 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:35.985821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432a171-8601-4b3f-8923-4d0479313253 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:35.986317 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432a171-8601-4b3f-8923-4d0479313253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:35.997363 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6a77d-5f9e-42ad-aca5-253b2217443c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:35.997758 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6a77d-5f9e-42ad-aca5-253b2217443c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:35.998097 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6a77d-5f9e-42ad-aca5-253b2217443c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:35.998404 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6a77d-5f9e-42ad-aca5-253b2217443c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:36.004475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-5432a171-8601-4b3f-8923-4d0479313253 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:36.006075 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5432a171-8601-4b3f-8923-4d0479313253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:36.006553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6a77d-5f9e-42ad-aca5-253b2217443c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:36.009040 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6a77d-5f9e-42ad-aca5-253b2217443c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:36.024573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-33a6a77d-5f9e-42ad-aca5-253b2217443c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:36.024573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:36.024573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:36.024573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:36.024573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:36.024573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:36.024573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:36.024573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:36.024573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:36.024573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:36.024573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:36.024573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:36.024573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:55:36.024573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:55:36.024573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:55:36.025538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:55:36.025538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:36.025538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:36.025538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:36.025538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:36.025538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:36.025538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:36.025538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:36.025538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:36.025538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:36.025538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:36.025538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:36.025538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:36.025538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:36.025538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:36.025538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:36.025538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:36.027068 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:55:36.027068 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:55:36.027068 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:55:36.027068 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:55:36.027068 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:55:36.027068 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:55:36.027068 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:36.027068 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:36.027068 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 355/711] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:36.027800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6a77d-5f9e-42ad-aca5-253b2217443c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:36.099112 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 357/712] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:36.100424 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432a171-8601-4b3f-8923-4d0479313253 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:36.158111 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:36.186605 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6a77d-5f9e-42ad-aca5-253b2217443c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:36.226053 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d8947-03e6-4e81-ab7b-50b30869f1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:36.226670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d8947-03e6-4e81-ab7b-50b30869f1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:36.226964 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d8947-03e6-4e81-ab7b-50b30869f1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:36.227249 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d8947-03e6-4e81-ab7b-50b30869f1b4 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:36.227985 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d8947-03e6-4e81-ab7b-50b30869f1b4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:36.228302 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d8947-03e6-4e81-ab7b-50b30869f1b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:36.229870 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d8947-03e6-4e81-ab7b-50b30869f1b4 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:36.242524 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 356/713] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Jul 14 11:55:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:36.242524 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d8947-03e6-4e81-ab7b-50b30869f1b4 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:36.263150 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432a171-8601-4b3f-8923-4d0479313253 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:36.292319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:36.316449 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cca307-577d-45b6-ac7e-df7d463156a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:36.317259 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cca307-577d-45b6-ac7e-df7d463156a2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:36.317550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cca307-577d-45b6-ac7e-df7d463156a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:36.317833 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cca307-577d-45b6-ac7e-df7d463156a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:36.319116 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cca307-577d-45b6-ac7e-df7d463156a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:36.319576 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cca307-577d-45b6-ac7e-df7d463156a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:36.321327 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cca307-577d-45b6-ac7e-df7d463156a2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:36.338618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 358/714] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:55:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:36.339860 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cca307-577d-45b6-ac7e-df7d463156a2 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:36.373738 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d8947-03e6-4e81-ab7b-50b30869f1b4 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:36.432758 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ac76e-3f89-44d8-b572-6f80b2686934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:36.433574 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ac76e-3f89-44d8-b572-6f80b2686934 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:36.433865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ac76e-3f89-44d8-b572-6f80b2686934 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:36.434408 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ac76e-3f89-44d8-b572-6f80b2686934 None admin] PATH_INFO: `/v3/services/network` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:36.435154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ac76e-3f89-44d8-b572-6f80b2686934 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:36.437538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ac76e-3f89-44d8-b572-6f80b2686934 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:36.456752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-fc6ac76e-3f89-44d8-b572-6f80b2686934 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:55:36.456752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:36.456752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:55:36.456752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:55:36.456752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:55:36.456752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:55:36.456752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:55:36.456752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:55:36.456752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:55:36.456752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:36.456752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:55:36.456752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:36.456752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:36.456752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:36.456752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:36.456752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:36.456752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:36.457784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:36.457784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:36.457784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:36.457784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:36.457784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:36.457784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:36.457784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:55:36.457784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:55:36.457784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:55:36.457784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:55:36.457784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:36.457784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:36.457784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:36.457784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:36.457784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:36.457784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:36.458624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:36.458624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:36.458624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:36.458624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:36.458624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:36.458624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:36.458624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:36.458624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:36.458624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:36.458624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:36.458624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:55:36.458624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:55:36.458624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:55:36.458624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:36.462636 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 357/715] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:36 2022] GET /identity/v3/services/network => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:36.465558 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ac76e-3f89-44d8-b572-6f80b2686934 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:36.470596 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:36.477685 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cca307-577d-45b6-ac7e-df7d463156a2 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:36.514115 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b89306-8c86-4035-ac29-9130b4553e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:36.514838 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b89306-8c86-4035-ac29-9130b4553e0d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:36.515125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b89306-8c86-4035-ac29-9130b4553e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:36.515404 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b89306-8c86-4035-ac29-9130b4553e0d None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:36.516111 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b89306-8c86-4035-ac29-9130b4553e0d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:36.516420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b89306-8c86-4035-ac29-9130b4553e0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:36.517790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b89306-8c86-4035-ac29-9130b4553e0d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:36.530885 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 359/716] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Jul 14 11:55:36 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:36.531906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b89306-8c86-4035-ac29-9130b4553e0d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:36.605572 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ac76e-3f89-44d8-b572-6f80b2686934 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:36.612279 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:36.660030 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4eec1b-8324-49c4-ae12-9058ab0ab1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:36.661133 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4eec1b-8324-49c4-ae12-9058ab0ab1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:36.661637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4eec1b-8324-49c4-ae12-9058ab0ab1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:36.662142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4eec1b-8324-49c4-ae12-9058ab0ab1f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:36.663268 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4eec1b-8324-49c4-ae12-9058ab0ab1f3 None admin] RBAC: Adding query filter params (role.id=eff4f9bbb7064bc1a0f9fc55a05fea51, scope.project.id=66f531bc924b41faa64743923afac319, user.id=e41a4d3a822c403fad048764a0edf209) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:36.663840 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4eec1b-8324-49c4-ae12-9058ab0ab1f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:36.665604 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4eec1b-8324-49c4-ae12-9058ab0ab1f3 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:36.679461 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 358/717] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:55:36 2022] GET /identity/v3/role_assignments?user.id=e41a4d3a822c403fad048764a0edf209&scope.project.id=66f531bc924b41faa64743923afac319&role.id=eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:36.718768 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b89306-8c86-4035-ac29-9130b4553e0d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:36.788822 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a7609-1d63-406c-802d-54018af49f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:36.789514 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a7609-1d63-406c-802d-54018af49f13 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:36.789799 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a7609-1d63-406c-802d-54018af49f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:36.790077 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a7609-1d63-406c-802d-54018af49f13 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:36.790887 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a7609-1d63-406c-802d-54018af49f13 None admin] RBAC: Adding query filter params (name=network) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:36.791201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a7609-1d63-406c-802d-54018af49f13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:36.793203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a7609-1d63-406c-802d-54018af49f13 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:36.798913 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 360/718] 10.222.0.79 () {56 vars in 1112 bytes} [Thu Jul 14 11:55:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:36.806179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4eec1b-8324-49c4-ae12-9058ab0ab1f3 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:36.886308 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:36.924011 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4eec1b-8324-49c4-ae12-9058ab0ab1f3 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:36.974911 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710a043-fa5d-402b-b935-4dc453180b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:36.976561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710a043-fa5d-402b-b935-4dc453180b14 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:36.977386 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710a043-fa5d-402b-b935-4dc453180b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:36.978185 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710a043-fa5d-402b-b935-4dc453180b14 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:36.979892 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710a043-fa5d-402b-b935-4dc453180b14 None admin] RBAC: Adding query filter params (type=network) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:36.980773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710a043-fa5d-402b-b935-4dc453180b14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:36.983844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710a043-fa5d-402b-b935-4dc453180b14 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:36.999772 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 359/719] 10.222.0.79 () {56 vars in 1112 bytes} [Thu Jul 14 11:55:36 2022] GET /identity/v3/services?type=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:38.174009 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd54049-07ba-4e37-9da9-d62db7798b16 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:38.175538 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd54049-07ba-4e37-9da9-d62db7798b16 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:38.176375 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd54049-07ba-4e37-9da9-d62db7798b16 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:38.179883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 361/720] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:38.188148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7c127-e645-4eb1-b882-93be13dfb515 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:38.188785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7c127-e645-4eb1-b882-93be13dfb515 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:38.188785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7c127-e645-4eb1-b882-93be13dfb515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:38.206264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-12b7c127-e645-4eb1-b882-93be13dfb515 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:38.211761 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-12b7c127-e645-4eb1-b882-93be13dfb515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:38.305099 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 360/721] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:38.333358 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd54049-07ba-4e37-9da9-d62db7798b16 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:38.451081 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581f5d7-4959-411c-ba6b-f45d7510c397 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:38.451272 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581f5d7-4959-411c-ba6b-f45d7510c397 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:38.451557 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581f5d7-4959-411c-ba6b-f45d7510c397 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:38.453208 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 361/722] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:38.458099 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bd07c-2b29-4fc5-ae83-9bfe99ff1543 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:38.458401 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bd07c-2b29-4fc5-ae83-9bfe99ff1543 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:38.458714 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bd07c-2b29-4fc5-ae83-9bfe99ff1543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:38.485682 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-191bd07c-2b29-4fc5-ae83-9bfe99ff1543 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:38.487696 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-191bd07c-2b29-4fc5-ae83-9bfe99ff1543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:38.512295 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd54049-07ba-4e37-9da9-d62db7798b16 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:38.528211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:38.586863 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:38.588206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85427b11-f364-43cb-b8ed-d3895988b472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:38.589545 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85427b11-f364-43cb-b8ed-d3895988b472 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:38.589826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85427b11-f364-43cb-b8ed-d3895988b472 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:38.590102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85427b11-f364-43cb-b8ed-d3895988b472 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:38.606641 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 362/723] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:38.620904 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85427b11-f364-43cb-b8ed-d3895988b472 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:38.628663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-85427b11-f364-43cb-b8ed-d3895988b472 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:38.628663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:38.628663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:38.628663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:38.628663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:38.628663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:38.628663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:38.628663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:38.628663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:38.628663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:38.628663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:38.628663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:38.628663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:38.628663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:38.628663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:38.628663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:38.629581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:38.629581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:38.629581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:38.629581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:38.629581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:38.629581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:38.629581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:38.629581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:38.629581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:38.629581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:38.629581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:38.629581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:38.629581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:38.629581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:38.629581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:38.629581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:38.631061 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:38.631061 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:38.631061 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:38.631061 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:38.631061 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:38.631061 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:38.631061 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:38.631061 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:38.631061 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:38.631061 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:38.631061 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:38.631061 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:38.631061 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 362/724] 10.222.0.79 () {56 vars in 1102 bytes} [Thu Jul 14 11:55:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:38.635758 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bd07c-2b29-4fc5-ae83-9bfe99ff1543 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:38.649971 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85427b11-f364-43cb-b8ed-d3895988b472 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:38.834701 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85427b11-f364-43cb-b8ed-d3895988b472 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:38.850958 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bd07c-2b29-4fc5-ae83-9bfe99ff1543 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:38.893145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b251f6d-7fe3-40f6-9b63-423767e00b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:38.894088 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b251f6d-7fe3-40f6-9b63-423767e00b9a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:38.894378 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b251f6d-7fe3-40f6-9b63-423767e00b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:38.894698 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b251f6d-7fe3-40f6-9b63-423767e00b9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:38.907732 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b251f6d-7fe3-40f6-9b63-423767e00b9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:38.916905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-0b251f6d-7fe3-40f6-9b63-423767e00b9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:55:38.916905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:38.916905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:38.916905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:38.916905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:38.916905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:38.916905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:38.916905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:38.916905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:38.916905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:38.916905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:38.916905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:38.916905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:38.916905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:38.916905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:38.916905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:38.917957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:38.917957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:38.917957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:38.917957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:38.917957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:38.917957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:38.917957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:38.917957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:38.917957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:38.917957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:38.917957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:38.917957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:38.917957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:38.917957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:38.917957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:38.917957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:38.919254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:38.919254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:38.919254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:38.919254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:38.919254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:38.919254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:38.919254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:38.919254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:38.919254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:38.919254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:38.919254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:55:38.919254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:38.919254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 363/725] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:55:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:38.927631 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b251f6d-7fe3-40f6-9b63-423767e00b9a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:38.938045 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f213ad7-b27f-475f-83bf-be5de8159ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:38.939123 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f213ad7-b27f-475f-83bf-be5de8159ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:38.939644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f213ad7-b27f-475f-83bf-be5de8159ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:38.940125 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f213ad7-b27f-475f-83bf-be5de8159ac1 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:38.941088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f213ad7-b27f-475f-83bf-be5de8159ac1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:38.941603 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f213ad7-b27f-475f-83bf-be5de8159ac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:38.943226 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f213ad7-b27f-475f-83bf-be5de8159ac1 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:38.958024 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:38.964553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 363/726] 10.222.0.79 () {56 vars in 1103 bytes} [Thu Jul 14 11:55:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:38.966005 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f213ad7-b27f-475f-83bf-be5de8159ac1 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:39.039933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b251f6d-7fe3-40f6-9b63-423767e00b9a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:39.041290 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:39.094456 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f213ad7-b27f-475f-83bf-be5de8159ac1 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:39.111270 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cf061-0bd6-404d-8ecc-89a536fedddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:39.111988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cf061-0bd6-404d-8ecc-89a536fedddc None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:39.112275 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cf061-0bd6-404d-8ecc-89a536fedddc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:39.112549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cf061-0bd6-404d-8ecc-89a536fedddc None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:39.113336 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cf061-0bd6-404d-8ecc-89a536fedddc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:39.113669 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cf061-0bd6-404d-8ecc-89a536fedddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:39.115083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cf061-0bd6-404d-8ecc-89a536fedddc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:39.128914 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 364/727] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:55:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:39.136123 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cf061-0bd6-404d-8ecc-89a536fedddc None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:39.138354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36490c-36a1-4f64-835c-4c35ae0eafdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:39.139469 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36490c-36a1-4f64-835c-4c35ae0eafdb None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:39.139935 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36490c-36a1-4f64-835c-4c35ae0eafdb None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:39.140357 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36490c-36a1-4f64-835c-4c35ae0eafdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:39.154116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36490c-36a1-4f64-835c-4c35ae0eafdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:39.156082 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36490c-36a1-4f64-835c-4c35ae0eafdb None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:39.179556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-bb36490c-36a1-4f64-835c-4c35ae0eafdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:39.179556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:39.179556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:39.179556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:39.179556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:39.179556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:39.179556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:39.179556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:39.179556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:39.179556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:39.179556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:39.179556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:39.179556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:39.179556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:39.179556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:39.180759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:39.180759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:39.180759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:39.180759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:39.180759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:39.180759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:39.180759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:39.180759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:39.180759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:39.180759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:39.180759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:39.180759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:39.180759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:39.180759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:39.180759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:39.180759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:39.180759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:39.182461 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:39.182461 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:39.182461 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:39.182461 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:39.182461 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 364/728] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:39.187814 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f8af-2833-40f4-a2f2-68d2f184adf9 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:39.188187 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f8af-2833-40f4-a2f2-68d2f184adf9 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:39.188720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f8af-2833-40f4-a2f2-68d2f184adf9 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:39.193909 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 365/729] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:39.193909 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086f8af-2833-40f4-a2f2-68d2f184adf9 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:39.254140 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:39.269786 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cf061-0bd6-404d-8ecc-89a536fedddc None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:39.309148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d72f0c-a93a-4eee-b6ad-52bd8e448f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:39.309918 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d72f0c-a93a-4eee-b6ad-52bd8e448f4c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:39.310205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d72f0c-a93a-4eee-b6ad-52bd8e448f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:39.310507 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d72f0c-a93a-4eee-b6ad-52bd8e448f4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:39.323080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d72f0c-a93a-4eee-b6ad-52bd8e448f4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:39.324568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d72f0c-a93a-4eee-b6ad-52bd8e448f4c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:39.331414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086f8af-2833-40f4-a2f2-68d2f184adf9 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:39.334714 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:39.342886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-e1d72f0c-a93a-4eee-b6ad-52bd8e448f4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:39.342886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:39.342886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:39.342886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:39.342886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:39.342886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:39.342886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:39.342886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:39.342886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:39.342886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:39.342886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:39.342886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:39.342886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:39.342886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:39.342886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:39.343803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:39.343803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:39.343803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:39.343803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:39.343803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:39.343803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:39.343803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:39.343803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:39.343803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:39.343803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:39.343803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:39.343803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:39.343803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:39.343803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:39.343803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:39.343803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:39.343803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:39.344650 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:39.344650 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:39.344650 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:39.344650 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:39.348577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 365/730] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:39.349840 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2665b4c-69a5-49e0-a6a4-f6f1e2deb4b2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:39.350135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2665b4c-69a5-49e0-a6a4-f6f1e2deb4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:39.350420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2665b4c-69a5-49e0-a6a4-f6f1e2deb4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:39.368581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f2665b4c-69a5-49e0-a6a4-f6f1e2deb4b2 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:39.370314 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f2665b4c-69a5-49e0-a6a4-f6f1e2deb4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:39.374422 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc47f2-68b6-4538-bd16-e9237cea61ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:39.375130 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc47f2-68b6-4538-bd16-e9237cea61ce None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:39.375460 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc47f2-68b6-4538-bd16-e9237cea61ce None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:39.375688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc47f2-68b6-4538-bd16-e9237cea61ce None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:39.376406 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc47f2-68b6-4538-bd16-e9237cea61ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:39.376718 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc47f2-68b6-4538-bd16-e9237cea61ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:39.378108 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc47f2-68b6-4538-bd16-e9237cea61ce None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:39.390249 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 366/731] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:39.391717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e11b6-926c-4ccf-9b2a-cc180323dbc5 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:39.392075 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e11b6-926c-4ccf-9b2a-cc180323dbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:39.392423 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e11b6-926c-4ccf-9b2a-cc180323dbc5 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:39.398280 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 367/732] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:39.398280 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e11b6-926c-4ccf-9b2a-cc180323dbc5 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:39.454069 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 366/733] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:39.454976 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2665b4c-69a5-49e0-a6a4-f6f1e2deb4b2 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:39.519628 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e11b6-926c-4ccf-9b2a-cc180323dbc5 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:39.529419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:39.559401 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9d531-692a-4bc3-8c2c-0f48d6ba2c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:39.560098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9d531-692a-4bc3-8c2c-0f48d6ba2c75 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:39.560389 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9d531-692a-4bc3-8c2c-0f48d6ba2c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:39.560785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9d531-692a-4bc3-8c2c-0f48d6ba2c75 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:39.561509 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9d531-692a-4bc3-8c2c-0f48d6ba2c75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:39.561826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9d531-692a-4bc3-8c2c-0f48d6ba2c75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:39.563235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9d531-692a-4bc3-8c2c-0f48d6ba2c75 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:39.563846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2665b4c-69a5-49e0-a6a4-f6f1e2deb4b2 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:39.579322 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 368/734] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:39.579322 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11288b3-1533-4488-8a74-16b3dde40cb6 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:39.579322 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11288b3-1533-4488-8a74-16b3dde40cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:39.579322 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11288b3-1533-4488-8a74-16b3dde40cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:39.594307 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-b11288b3-1533-4488-8a74-16b3dde40cb6 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:39.595667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b11288b3-1533-4488-8a74-16b3dde40cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:39.606861 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eba529-a0d0-4871-a44e-a7c90848e2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:39.608144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eba529-a0d0-4871-a44e-a7c90848e2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:39.608358 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eba529-a0d0-4871-a44e-a7c90848e2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:39.608916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eba529-a0d0-4871-a44e-a7c90848e2d8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:39.615937 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:39.616553 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eba529-a0d0-4871-a44e-a7c90848e2d8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:39.618003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eba529-a0d0-4871-a44e-a7c90848e2d8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:39.634615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-c4eba529-a0d0-4871-a44e-a7c90848e2d8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 11:55:39.634615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:39.634615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:39.634615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:39.634615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:39.634615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:39.634615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:39.634615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:39.634615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:39.634615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:39.634615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:39.634615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:39.634615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:55:39.634615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:55:39.634615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:55:39.634615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:55:39.635635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:39.635635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:39.635635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:55:39.635635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:39.635635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:55:39.635635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:39.635635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:39.635635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:39.635635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:39.635635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:39.635635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:39.635635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:39.635635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:39.635635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:39.635635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:39.635635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:39.635635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:39.635635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:39.636633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:39.636633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:39.636633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:55:39.636633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:55:39.636633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:55:39.636633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:55:39.636633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:55:39.636633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:55:39.636633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 11:55:39.636633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:39.640722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 367/735] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Jul 14 11:55:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:39.641443 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eba529-a0d0-4871-a44e-a7c90848e2d8 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:39.674610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 369/736] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:39.674610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11288b3-1533-4488-8a74-16b3dde40cb6 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:39.777255 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eba529-a0d0-4871-a44e-a7c90848e2d8 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:39.797405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11288b3-1533-4488-8a74-16b3dde40cb6 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:39.807891 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:39.813837 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee80705-38c0-4d55-8aba-c25cfbc6f2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:39.814448 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee80705-38c0-4d55-8aba-c25cfbc6f2ba None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:39.814775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee80705-38c0-4d55-8aba-c25cfbc6f2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:39.815058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee80705-38c0-4d55-8aba-c25cfbc6f2ba None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:39.815779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee80705-38c0-4d55-8aba-c25cfbc6f2ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:39.817136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee80705-38c0-4d55-8aba-c25cfbc6f2ba None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:39.831447 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 368/737] 10.222.0.79 () {60 vars in 1141 bytes} [Thu Jul 14 11:55:39 2022] POST /identity/v3/services => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:55:39.832267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee80705-38c0-4d55-8aba-c25cfbc6f2ba None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:39.848286 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72757c-0ede-4999-b7ef-b4dd38ec290f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:39.849212 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72757c-0ede-4999-b7ef-b4dd38ec290f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:39.849574 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72757c-0ede-4999-b7ef-b4dd38ec290f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:39.849922 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72757c-0ede-4999-b7ef-b4dd38ec290f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:39.860447 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72757c-0ede-4999-b7ef-b4dd38ec290f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:39.862048 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72757c-0ede-4999-b7ef-b4dd38ec290f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:39.878585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-ce72757c-0ede-4999-b7ef-b4dd38ec290f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 11:55:39.878585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:39.878585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:39.878585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:39.878585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:39.878585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:39.878585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:39.878585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:39.878585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:39.878585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:39.878585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:39.878585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:39.878585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:55:39.878585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:55:39.878585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:55:39.878585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:55:39.879656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:39.879656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:39.879656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:55:39.879656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:39.879656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:55:39.879656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:39.879656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:39.879656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:39.879656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:39.879656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:39.879656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:39.879656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:39.879656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:39.879656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:39.879656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:39.879656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:39.879656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:39.879656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:39.880593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:39.880593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:39.880593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:55:39.880593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:55:39.880593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:55:39.880593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:55:39.880593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:55:39.880593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:55:39.880593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 11:55:39.880593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:39.880593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 370/738] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:55:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:39.881183 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72757c-0ede-4999-b7ef-b4dd38ec290f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:39.896237 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:39.961592 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee80705-38c0-4d55-8aba-c25cfbc6f2ba None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:40.000589 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72757c-0ede-4999-b7ef-b4dd38ec290f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:40.000926 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2bffa-c87b-4d6f-89c6-1dc1cf39fdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:40.001598 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2bffa-c87b-4d6f-89c6-1dc1cf39fdf2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:40.001891 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2bffa-c87b-4d6f-89c6-1dc1cf39fdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:40.002169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2bffa-c87b-4d6f-89c6-1dc1cf39fdf2 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:40.003083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2bffa-c87b-4d6f-89c6-1dc1cf39fdf2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:40.003400 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2bffa-c87b-4d6f-89c6-1dc1cf39fdf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:40.004907 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2bffa-c87b-4d6f-89c6-1dc1cf39fdf2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:40.026796 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 369/739] 10.222.0.79 () {56 vars in 1149 bytes} [Thu Jul 14 11:55:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:40.028235 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298829d-7fd3-4bd2-ab41-b461b31378ab None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:40.028534 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298829d-7fd3-4bd2-ab41-b461b31378ab None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:40.029107 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298829d-7fd3-4bd2-ab41-b461b31378ab None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:40.030079 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 370/740] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:40.030996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298829d-7fd3-4bd2-ab41-b461b31378ab None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:40.047399 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dace043-7e9a-4f68-848e-3499862e9efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:40.048327 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dace043-7e9a-4f68-848e-3499862e9efc None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:40.048619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dace043-7e9a-4f68-848e-3499862e9efc None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:40.048908 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dace043-7e9a-4f68-848e-3499862e9efc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:40.061329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dace043-7e9a-4f68-848e-3499862e9efc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:40.069839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-4dace043-7e9a-4f68-848e-3499862e9efc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:55:40.069839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:40.069839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:40.069839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:40.069839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:40.069839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:40.069839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:40.069839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:40.069839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:40.069839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:40.069839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:40.069839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:40.069839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:40.069839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:40.069839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:40.069839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:40.070826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:40.070826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:40.070826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:40.070826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:40.070826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:40.070826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:40.070826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:40.070826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:40.070826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:40.070826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:40.070826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:40.070826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:40.070826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:40.070826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:40.070826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:40.070826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:40.071734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:40.071734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:40.071734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:40.071734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:40.071734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:40.071734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:40.071734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:40.071734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:40.071734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:40.071734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:40.071734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:55:40.071734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:40.071734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 371/741] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:55:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:40.072486 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dace043-7e9a-4f68-848e-3499862e9efc None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:40.089115 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:40.146892 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298829d-7fd3-4bd2-ab41-b461b31378ab None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:40.151230 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:40.186981 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ff12c-d760-4873-a8d6-81411dbd76d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:40.187660 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ff12c-d760-4873-a8d6-81411dbd76d8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:40.187943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ff12c-d760-4873-a8d6-81411dbd76d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:40.188223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ff12c-d760-4873-a8d6-81411dbd76d8 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:40.188460 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dace043-7e9a-4f68-848e-3499862e9efc None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:40.189065 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ff12c-d760-4873-a8d6-81411dbd76d8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:40.189375 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ff12c-d760-4873-a8d6-81411dbd76d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:40.190831 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ff12c-d760-4873-a8d6-81411dbd76d8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:40.214675 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 371/742] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Jul 14 11:55:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:40.216413 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db283f10-986e-4135-b4d0-cecfdfd379b7 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:40.216708 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db283f10-986e-4135-b4d0-cecfdfd379b7 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:40.216989 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db283f10-986e-4135-b4d0-cecfdfd379b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:40.228265 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf34f8e-c81c-429d-b655-a431c8bbb45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:40.229192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf34f8e-c81c-429d-b655-a431c8bbb45a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:40.229582 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf34f8e-c81c-429d-b655-a431c8bbb45a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:40.229988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf34f8e-c81c-429d-b655-a431c8bbb45a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:40.235623 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-db283f10-986e-4135-b4d0-cecfdfd379b7 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:40.236835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-db283f10-986e-4135-b4d0-cecfdfd379b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:40.301313 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf34f8e-c81c-429d-b655-a431c8bbb45a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:40.303263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf34f8e-c81c-429d-b655-a431c8bbb45a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:40.311832 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 372/743] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:40 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:40.312898 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db283f10-986e-4135-b4d0-cecfdfd379b7 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:40.350580 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:40.394767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:40.424007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db283f10-986e-4135-b4d0-cecfdfd379b7 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:40.434636 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 372/744] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:55:40 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:40.435711 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf34f8e-c81c-429d-b655-a431c8bbb45a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:40.467143 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aad09f-8a79-49c0-906c-7ea3c5e5dd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:40.467821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aad09f-8a79-49c0-906c-7ea3c5e5dd49 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:40.468132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aad09f-8a79-49c0-906c-7ea3c5e5dd49 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:40.468415 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aad09f-8a79-49c0-906c-7ea3c5e5dd49 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:40.469161 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aad09f-8a79-49c0-906c-7ea3c5e5dd49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:40.469538 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aad09f-8a79-49c0-906c-7ea3c5e5dd49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:40.470939 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aad09f-8a79-49c0-906c-7ea3c5e5dd49 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:40.479769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 373/745] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:55:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:40.480425 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aad09f-8a79-49c0-906c-7ea3c5e5dd49 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:40.549536 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf34f8e-c81c-429d-b655-a431c8bbb45a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:40.584406 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33fe79-1f79-4a23-97b5-4536460e1817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:40.585214 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33fe79-1f79-4a23-97b5-4536460e1817 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:40.585594 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33fe79-1f79-4a23-97b5-4536460e1817 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:40.585971 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33fe79-1f79-4a23-97b5-4536460e1817 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:40.593284 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:40.599282 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aad09f-8a79-49c0-906c-7ea3c5e5dd49 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:40.628375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:40.639294 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc8624-13a3-45c1-806d-ee801941bc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:40.639976 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc8624-13a3-45c1-806d-ee801941bc45 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:40.640264 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc8624-13a3-45c1-806d-ee801941bc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:40.640546 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc8624-13a3-45c1-806d-ee801941bc45 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:40.641274 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc8624-13a3-45c1-806d-ee801941bc45 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:40.642753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc8624-13a3-45c1-806d-ee801941bc45 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:40.656270 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 374/746] 10.222.0.79 () {60 vars in 1141 bytes} [Thu Jul 14 11:55:40 2022] POST /identity/v3/services => generated 240 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:55:40.657002 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc8624-13a3-45c1-806d-ee801941bc45 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:40.675690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33fe79-1f79-4a23-97b5-4536460e1817 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:40.677440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33fe79-1f79-4a23-97b5-4536460e1817 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:40.842869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc8624-13a3-45c1-806d-ee801941bc45 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:40.845983 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 373/747] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:55:40 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:40.851795 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33fe79-1f79-4a23-97b5-4536460e1817 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:40.905128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f03e2c-a21f-4fb0-8e89-a0757c5e8884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:40.906544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f03e2c-a21f-4fb0-8e89-a0757c5e8884 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:40.907096 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f03e2c-a21f-4fb0-8e89-a0757c5e8884 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:40.907731 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f03e2c-a21f-4fb0-8e89-a0757c5e8884 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:40.926977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f03e2c-a21f-4fb0-8e89-a0757c5e8884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:40.929752 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f03e2c-a21f-4fb0-8e89-a0757c5e8884 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:40.948710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:40.958599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-81f03e2c-a21f-4fb0-8e89-a0757c5e8884 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:40.958599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:40.958599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:40.958599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:40.958599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:40.958599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:40.958599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:40.958599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:40.958599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:40.958599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:40.958599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:40.958599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:40.958599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:40.958599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:40.958599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:40.959519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:40.959519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:40.959519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:40.959519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:40.959519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:40.959519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:40.959519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:40.959519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:40.959519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:40.959519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:40.959519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:40.959519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:40.959519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:40.959519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:40.959519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:40.959519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:40.959519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:40.960387 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:40.960387 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:40.960387 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:40.960387 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:40.960387 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 375/748] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:40.960651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f03e2c-a21f-4fb0-8e89-a0757c5e8884 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:40.974233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:41.005484 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33fe79-1f79-4a23-97b5-4536460e1817 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:41.050997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a09c2-3df2-4bb7-b29e-16f6cad01204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:41.052308 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a09c2-3df2-4bb7-b29e-16f6cad01204 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:41.052735 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a09c2-3df2-4bb7-b29e-16f6cad01204 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:41.053545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a09c2-3df2-4bb7-b29e-16f6cad01204 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:41.068411 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a09c2-3df2-4bb7-b29e-16f6cad01204 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:41.070774 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a09c2-3df2-4bb7-b29e-16f6cad01204 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:41.077940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f03e2c-a21f-4fb0-8e89-a0757c5e8884 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:41.093219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-a35a09c2-3df2-4bb7-b29e-16f6cad01204 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:41.093219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:41.093219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:41.093219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:41.093219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:41.093219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:41.093219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:41.093219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:41.093219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:41.093219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:41.093219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:41.093219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:41.093219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:41.093219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:41.093219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:41.094331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:41.094331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:41.094331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:41.094331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:41.094331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:41.094331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:41.094331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:41.094331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:41.094331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:41.094331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:41.094331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:41.094331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:41.094331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:41.094331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:41.094331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:41.094331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:41.094331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:41.095429 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:41.095429 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:41.095429 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:41.095429 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:41.097642 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 374/749] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:41.098777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a09c2-3df2-4bb7-b29e-16f6cad01204 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:41.122798 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3185c9d-b887-4b7b-9b4d-b85c78d097c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:41.123703 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3185c9d-b887-4b7b-9b4d-b85c78d097c0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:41.124064 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3185c9d-b887-4b7b-9b4d-b85c78d097c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:41.124401 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3185c9d-b887-4b7b-9b4d-b85c78d097c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:41.136035 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3185c9d-b887-4b7b-9b4d-b85c78d097c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:41.137617 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3185c9d-b887-4b7b-9b4d-b85c78d097c0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:41.162287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-d3185c9d-b887-4b7b-9b4d-b85c78d097c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:41.162287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:41.162287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:41.162287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:41.162287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:41.162287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:41.162287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:41.162287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:41.162287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:41.162287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:41.162287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:41.162287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:41.162287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:41.162287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:41.162287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:41.163211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:41.163211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:41.163211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:41.163211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:41.163211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:41.163211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:41.163211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:41.163211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:41.163211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:41.163211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:41.163211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:41.163211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:41.163211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:41.163211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:41.163211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:41.163211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:41.163211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:41.164093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:41.164093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:41.164093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:41.164093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:41.167618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 376/750] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:41.168596 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3185c9d-b887-4b7b-9b4d-b85c78d097c0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:41.242790 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a09c2-3df2-4bb7-b29e-16f6cad01204 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:41.250901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:41.272830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:41.288908 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3185c9d-b887-4b7b-9b4d-b85c78d097c0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:41.295670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8d40c-cb9a-432e-a61f-197f99a78503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:41.296346 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8d40c-cb9a-432e-a61f-197f99a78503 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:41.296635 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8d40c-cb9a-432e-a61f-197f99a78503 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:41.296916 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8d40c-cb9a-432e-a61f-197f99a78503 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:41.297643 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8d40c-cb9a-432e-a61f-197f99a78503 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:41.297956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8d40c-cb9a-432e-a61f-197f99a78503 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:41.299924 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8d40c-cb9a-432e-a61f-197f99a78503 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:41.318580 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 375/751] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:41.319762 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8d40c-cb9a-432e-a61f-197f99a78503 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:41.333241 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85085ea6-2b73-4ed1-853a-bd982f941318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:41.334720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85085ea6-2b73-4ed1-853a-bd982f941318 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:41.335362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85085ea6-2b73-4ed1-853a-bd982f941318 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:41.335966 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85085ea6-2b73-4ed1-853a-bd982f941318 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:41.336889 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85085ea6-2b73-4ed1-853a-bd982f941318 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:41.337413 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85085ea6-2b73-4ed1-853a-bd982f941318 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:41.339711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85085ea6-2b73-4ed1-853a-bd982f941318 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:41.358545 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 377/752] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:41.359798 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85085ea6-2b73-4ed1-853a-bd982f941318 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:41.456258 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8d40c-cb9a-432e-a61f-197f99a78503 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:41.485155 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85085ea6-2b73-4ed1-853a-bd982f941318 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:41.502170 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc77c99-c720-4f74-acb6-154788487731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:41.503524 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc77c99-c720-4f74-acb6-154788487731 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:41.504253 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc77c99-c720-4f74-acb6-154788487731 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:41.504686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc77c99-c720-4f74-acb6-154788487731 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:41.505822 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc77c99-c720-4f74-acb6-154788487731 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:41.506844 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:41.507069 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc77c99-c720-4f74-acb6-154788487731 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:41.509124 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc77c99-c720-4f74-acb6-154788487731 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:41.527856 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 376/753] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:41.528983 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc77c99-c720-4f74-acb6-154788487731 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:41.533344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32241713-baea-4406-a242-f76578a1c513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:41.534139 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32241713-baea-4406-a242-f76578a1c513 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:41.534544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32241713-baea-4406-a242-f76578a1c513 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:41.534923 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32241713-baea-4406-a242-f76578a1c513 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:41.547890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32241713-baea-4406-a242-f76578a1c513 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:41.550254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32241713-baea-4406-a242-f76578a1c513 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:41.569362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-32241713-baea-4406-a242-f76578a1c513 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:41.569362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:41.569362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:41.569362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:41.569362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:41.569362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:41.569362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:41.569362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:41.569362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:41.569362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:41.569362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:41.569362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:41.569362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:55:41.569362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:55:41.569362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:55:41.570480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:55:41.570480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:41.570480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:41.570480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:41.570480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:41.570480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:41.570480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:41.570480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:41.570480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:41.570480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:41.570480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:41.570480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:41.570480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:41.570480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:41.570480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:41.570480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:41.570480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:41.571410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:55:41.571410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:55:41.571410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:55:41.571410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:55:41.571410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:55:41.571410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:55:41.571410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:41.571410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:41.578261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 378/754] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:41.578261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32241713-baea-4406-a242-f76578a1c513 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:41.589093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:41.657738 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc77c99-c720-4f74-acb6-154788487731 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:41.691842 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32241713-baea-4406-a242-f76578a1c513 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:41.700295 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089532aa-c770-46f3-ac5f-22ad3e8bc7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:41.701402 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089532aa-c770-46f3-ac5f-22ad3e8bc7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:41.701870 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089532aa-c770-46f3-ac5f-22ad3e8bc7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:41.702299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089532aa-c770-46f3-ac5f-22ad3e8bc7f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:41.712456 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089532aa-c770-46f3-ac5f-22ad3e8bc7f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:41.714256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089532aa-c770-46f3-ac5f-22ad3e8bc7f3 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:41.731165 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-089532aa-c770-46f3-ac5f-22ad3e8bc7f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:55:41.731165 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:41.731165 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:41.731165 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:41.731165 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:41.731165 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:41.731165 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:41.731165 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:41.731165 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:41.731165 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:41.731165 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:41.731165 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:41.731165 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:55:41.731165 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:55:41.731165 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:55:41.731165 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:55:41.732377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:41.732377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:41.732377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:55:41.732377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:41.732377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:55:41.732377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:41.732377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:41.732377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:41.732377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:41.732377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:41.732377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:41.732377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:41.732377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:41.732377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:41.732377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:41.732377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:41.732377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:41.732377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:41.733413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:41.733413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:41.733413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:55:41.733413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:55:41.733413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:55:41.733413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:55:41.733413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:55:41.733413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:55:41.733413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:55:41.733413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:41.740490 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 377/755] 10.222.0.79 () {56 vars in 1093 bytes} [Thu Jul 14 11:55:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:41.741957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089532aa-c770-46f3-ac5f-22ad3e8bc7f3 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:41.851020 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e4f74-b67f-46ee-8ad5-70640a282cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:41.852030 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e4f74-b67f-46ee-8ad5-70640a282cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:41.852384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e4f74-b67f-46ee-8ad5-70640a282cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:41.852727 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e4f74-b67f-46ee-8ad5-70640a282cc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:41.861283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e4f74-b67f-46ee-8ad5-70640a282cc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:41.863063 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e4f74-b67f-46ee-8ad5-70640a282cc1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:41.864254 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089532aa-c770-46f3-ac5f-22ad3e8bc7f3 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:41.866199 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:41.878307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-5f2e4f74-b67f-46ee-8ad5-70640a282cc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:41.878307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:41.878307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:41.878307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:41.878307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:41.878307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:41.878307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:41.878307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:41.878307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:41.878307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:41.878307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:41.878307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:41.878307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:55:41.878307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:55:41.878307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:55:41.879390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:55:41.879390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:41.879390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:41.879390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:41.879390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:41.879390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:41.879390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:41.879390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:41.879390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:41.879390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:41.879390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:41.879390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:41.879390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:41.879390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:41.879390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:41.879390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:41.879390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:41.880339 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:55:41.880339 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:55:41.880339 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:55:41.880339 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:55:41.880339 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:55:41.880339 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:55:41.880339 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:41.880339 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:41.885662 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 379/756] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:41.886948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e4f74-b67f-46ee-8ad5-70640a282cc1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:41.912918 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f016b5e-8765-4904-9598-306afd7503f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:41.914048 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f016b5e-8765-4904-9598-306afd7503f0 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:41.914903 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f016b5e-8765-4904-9598-306afd7503f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:41.915272 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f016b5e-8765-4904-9598-306afd7503f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:41.916581 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f016b5e-8765-4904-9598-306afd7503f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:41.916997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f016b5e-8765-4904-9598-306afd7503f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:41.918604 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f016b5e-8765-4904-9598-306afd7503f0 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:41.938829 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:41.942145 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 378/757] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:55:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:41.943204 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f016b5e-8765-4904-9598-306afd7503f0 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:42.009047 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e4f74-b67f-46ee-8ad5-70640a282cc1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:42.046109 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a2c2a-b71a-4995-87c5-1356b8c29460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:42.046822 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a2c2a-b71a-4995-87c5-1356b8c29460 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:42.047088 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a2c2a-b71a-4995-87c5-1356b8c29460 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:42.047358 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a2c2a-b71a-4995-87c5-1356b8c29460 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:42.048196 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a2c2a-b71a-4995-87c5-1356b8c29460 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:42.048505 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a2c2a-b71a-4995-87c5-1356b8c29460 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:42.050000 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a2c2a-b71a-4995-87c5-1356b8c29460 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:42.052346 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f016b5e-8765-4904-9598-306afd7503f0 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:42.073297 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 380/758] 10.222.0.79 () {56 vars in 1133 bytes} [Thu Jul 14 11:55:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:42.074440 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a2c2a-b71a-4995-87c5-1356b8c29460 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:42.089135 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27c409-786c-499d-8cd1-386f81110b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:42.089904 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27c409-786c-499d-8cd1-386f81110b83 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:42.090154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27c409-786c-499d-8cd1-386f81110b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:42.090355 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27c409-786c-499d-8cd1-386f81110b83 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:42.091181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27c409-786c-499d-8cd1-386f81110b83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:42.091495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27c409-786c-499d-8cd1-386f81110b83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:42.092922 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27c409-786c-499d-8cd1-386f81110b83 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:42.109735 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 379/759] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:55:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:42.109735 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d5791-6be4-4f12-9085-bd8832ee8416 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:42.109735 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d5791-6be4-4f12-9085-bd8832ee8416 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:42.109735 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d5791-6be4-4f12-9085-bd8832ee8416 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:42.109735 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 380/760] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:42.109735 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d5791-6be4-4f12-9085-bd8832ee8416 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:42.136845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:42.186334 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:42.193854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a2c2a-b71a-4995-87c5-1356b8c29460 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:42.222545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d5791-6be4-4f12-9085-bd8832ee8416 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:42.231675 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100d94e-30bf-41f3-981b-bfaac6c62225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:42.231960 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100d94e-30bf-41f3-981b-bfaac6c62225 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:42.232213 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100d94e-30bf-41f3-981b-bfaac6c62225 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:42.232494 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100d94e-30bf-41f3-981b-bfaac6c62225 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:42.233339 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100d94e-30bf-41f3-981b-bfaac6c62225 None admin] RBAC: Adding query filter params (role.id=73743e14bfe849198f3a8b549163f32b, scope.project.id=66f531bc924b41faa64743923afac319, user.id=f64d942793a5493787c3e5c7815bc134) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:42.233652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100d94e-30bf-41f3-981b-bfaac6c62225 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:42.235167 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100d94e-30bf-41f3-981b-bfaac6c62225 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:42.241269 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 381/761] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:55:42 2022] GET /identity/v3/role_assignments?user.id=f64d942793a5493787c3e5c7815bc134&scope.project.id=66f531bc924b41faa64743923afac319&role.id=73743e14bfe849198f3a8b549163f32b => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:42.247555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100d94e-30bf-41f3-981b-bfaac6c62225 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:42.270698 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18eede-5c70-4b21-a0fd-dae3206e1e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:42.271431 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18eede-5c70-4b21-a0fd-dae3206e1e2d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:42.271763 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18eede-5c70-4b21-a0fd-dae3206e1e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:42.272086 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18eede-5c70-4b21-a0fd-dae3206e1e2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:42.284563 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18eede-5c70-4b21-a0fd-dae3206e1e2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:42.285797 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18eede-5c70-4b21-a0fd-dae3206e1e2d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:42.307539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-bd18eede-5c70-4b21-a0fd-dae3206e1e2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:42.307539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:42.307539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:42.307539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:42.307539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:42.307539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:42.307539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:42.307539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:42.307539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:42.307539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:42.307539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:42.307539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:42.307539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:42.307539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:42.307539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:42.308485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:42.308485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:42.308485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:42.308485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:42.308485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:42.308485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:42.308485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:42.308485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:42.308485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:42.308485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:42.308485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:42.308485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:42.308485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:42.308485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:42.308485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:42.308485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:42.308485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:42.309362 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:42.309362 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:42.309362 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:42.309362 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:42.313855 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 381/762] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:42.315440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee2554-e1c0-44ba-ad6d-b84b14794702 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:42.315785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee2554-e1c0-44ba-ad6d-b84b14794702 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:42.316073 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee2554-e1c0-44ba-ad6d-b84b14794702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:42.335155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-ddee2554-e1c0-44ba-ad6d-b84b14794702 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:42.336395 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ddee2554-e1c0-44ba-ad6d-b84b14794702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:42.404623 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100d94e-30bf-41f3-981b-bfaac6c62225 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:42.423319 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 382/763] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:55:42.424661 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee2554-e1c0-44ba-ad6d-b84b14794702 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:42.429187 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:42.446912 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2997624-6c32-4394-af9a-a54954482309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:42.448638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2997624-6c32-4394-af9a-a54954482309 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:42.449208 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2997624-6c32-4394-af9a-a54954482309 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:42.449688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2997624-6c32-4394-af9a-a54954482309 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:42.450772 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2997624-6c32-4394-af9a-a54954482309 None admin] RBAC: Adding query filter params (role.id=eff4f9bbb7064bc1a0f9fc55a05fea51, scope.project.id=66f531bc924b41faa64743923afac319, user.id=969ee98dfe644ef2a016860aa1585317) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:42.451319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2997624-6c32-4394-af9a-a54954482309 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:42.453113 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2997624-6c32-4394-af9a-a54954482309 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:42.460041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 382/764] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:55:42 2022] GET /identity/v3/role_assignments?user.id=969ee98dfe644ef2a016860aa1585317&scope.project.id=66f531bc924b41faa64743923afac319&role.id=eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:42.462357 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2997624-6c32-4394-af9a-a54954482309 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:42.523924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:42.620147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee2554-e1c0-44ba-ad6d-b84b14794702 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:42.667037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78966b-3f6a-4785-b205-514bd1a79b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:42.667722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78966b-3f6a-4785-b205-514bd1a79b8a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:42.668172 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78966b-3f6a-4785-b205-514bd1a79b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:42.668454 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78966b-3f6a-4785-b205-514bd1a79b8a None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:42.669384 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78966b-3f6a-4785-b205-514bd1a79b8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:42.669823 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78966b-3f6a-4785-b205-514bd1a79b8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:42.671256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78966b-3f6a-4785-b205-514bd1a79b8a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:42.692335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 383/765] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:42.693434 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78966b-3f6a-4785-b205-514bd1a79b8a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:42.699490 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2997624-6c32-4394-af9a-a54954482309 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:42.740422 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662d28e-8084-4ed2-ad49-8671ec59bd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:42.741664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662d28e-8084-4ed2-ad49-8671ec59bd00 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:42.742207 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662d28e-8084-4ed2-ad49-8671ec59bd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:42.742710 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662d28e-8084-4ed2-ad49-8671ec59bd00 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:42.743582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0662d28e-8084-4ed2-ad49-8671ec59bd00 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:42.745252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0662d28e-8084-4ed2-ad49-8671ec59bd00 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:42.758755 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-0662d28e-8084-4ed2-ad49-8671ec59bd00 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:55:42.758755 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:42.758755 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:55:42.758755 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:55:42.758755 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:55:42.758755 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:55:42.758755 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:55:42.758755 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:55:42.758755 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:55:42.758755 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:42.758755 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:55:42.758755 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:42.758755 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:42.758755 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:42.758755 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:42.758755 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:42.759714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:42.759714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:42.759714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:42.759714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:42.759714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:42.759714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:42.759714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:42.759714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:55:42.759714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:55:42.759714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:55:42.759714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:55:42.759714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:42.759714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:42.759714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:42.759714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:42.759714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:42.761231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:42.761231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:42.761231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:42.761231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:42.761231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:42.761231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:42.761231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:42.761231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:42.761231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:42.761231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:42.761231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:42.761231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:55:42.761231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:55:42.761231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:55:42.761231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:42.764249 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 383/766] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Jul 14 11:55:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:42.770790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662d28e-8084-4ed2-ad49-8671ec59bd00 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:42.779920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:42.842036 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78966b-3f6a-4785-b205-514bd1a79b8a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:42.905018 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba49be-c385-4139-81d6-89ef34030915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:42.906089 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba49be-c385-4139-81d6-89ef34030915 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:42.906373 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba49be-c385-4139-81d6-89ef34030915 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:42.906692 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba49be-c385-4139-81d6-89ef34030915 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:42.915694 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba49be-c385-4139-81d6-89ef34030915 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:42.917733 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba49be-c385-4139-81d6-89ef34030915 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:42.930273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:42.939693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-e4ba49be-c385-4139-81d6-89ef34030915 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:42.939693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:42.939693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:42.939693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:42.939693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:42.939693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:42.939693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:42.939693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:42.939693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:42.939693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:42.939693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:42.939693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:42.939693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:55:42.939693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:55:42.939693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:55:42.940624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:55:42.940624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:42.940624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:42.940624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:42.940624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:42.940624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:42.940624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:42.940624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:42.940624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:42.940624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:42.940624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:42.940624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:42.940624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:42.940624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:42.940624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:42.940624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:42.940624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:42.941908 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:55:42.941908 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:55:42.941908 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:55:42.941908 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:55:42.941908 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:55:42.941908 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:55:42.941908 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:42.941908 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:42.941908 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 384/767] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:42.943028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27981b7b-164c-49ab-8bdf-591a01a75227 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:42.943320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27981b7b-164c-49ab-8bdf-591a01a75227 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:42.943602 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27981b7b-164c-49ab-8bdf-591a01a75227 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:42.944907 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 385/768] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:42.949851 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27981b7b-164c-49ab-8bdf-591a01a75227 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:42.955691 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662d28e-8084-4ed2-ad49-8671ec59bd00 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:42.992964 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9bef4-2ef1-4ac2-9d49-9b2194e298f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:42.993637 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9bef4-2ef1-4ac2-9d49-9b2194e298f3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:42.993925 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9bef4-2ef1-4ac2-9d49-9b2194e298f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:42.994223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9bef4-2ef1-4ac2-9d49-9b2194e298f3 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:42.995048 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9bef4-2ef1-4ac2-9d49-9b2194e298f3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:42.995363 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9bef4-2ef1-4ac2-9d49-9b2194e298f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:42.996916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9bef4-2ef1-4ac2-9d49-9b2194e298f3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:43.002592 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 384/769] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Jul 14 11:55:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:43.004003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cc4e6-3764-4e4e-94c2-a4553d4465a6 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:43.004297 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cc4e6-3764-4e4e-94c2-a4553d4465a6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:43.004575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cc4e6-3764-4e4e-94c2-a4553d4465a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:43.022143 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3a4cc4e6-3764-4e4e-94c2-a4553d4465a6 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:43.023408 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3a4cc4e6-3764-4e4e-94c2-a4553d4465a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:43.090240 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27981b7b-164c-49ab-8bdf-591a01a75227 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:43.115444 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 385/770] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:55:43.116695 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:43.117231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cc4e6-3764-4e4e-94c2-a4553d4465a6 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:43.130064 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf399ccc-9a11-49b0-ac87-8a9f39cfe890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:43.130792 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf399ccc-9a11-49b0-ac87-8a9f39cfe890 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:43.131116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf399ccc-9a11-49b0-ac87-8a9f39cfe890 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:43.131398 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf399ccc-9a11-49b0-ac87-8a9f39cfe890 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:43.132249 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf399ccc-9a11-49b0-ac87-8a9f39cfe890 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:43.132568 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf399ccc-9a11-49b0-ac87-8a9f39cfe890 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:43.134083 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf399ccc-9a11-49b0-ac87-8a9f39cfe890 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:43.147157 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 386/771] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:55:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:43.155504 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf399ccc-9a11-49b0-ac87-8a9f39cfe890 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:43.230632 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:43.258126 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cc4e6-3764-4e4e-94c2-a4553d4465a6 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:43.276434 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf399ccc-9a11-49b0-ac87-8a9f39cfe890 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:43.308459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee960f-d0fc-4e7f-83c7-2e95eb1e7b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:43.310688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee960f-d0fc-4e7f-83c7-2e95eb1e7b2a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:43.311277 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee960f-d0fc-4e7f-83c7-2e95eb1e7b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:43.311788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee960f-d0fc-4e7f-83c7-2e95eb1e7b2a None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:43.312973 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee960f-d0fc-4e7f-83c7-2e95eb1e7b2a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:43.313611 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee960f-d0fc-4e7f-83c7-2e95eb1e7b2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:43.314883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c218a10-3589-459f-8ec4-75a708acd494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:43.315392 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee960f-d0fc-4e7f-83c7-2e95eb1e7b2a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:43.316039 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c218a10-3589-459f-8ec4-75a708acd494 None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:43.316427 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c218a10-3589-459f-8ec4-75a708acd494 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:43.316808 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c218a10-3589-459f-8ec4-75a708acd494 None admin] PATH_INFO: `/v3/projects/66f531bc924b41faa64743923afac319/users/e41a4d3a822c403fad048764a0edf209/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:43.318991 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c218a10-3589-459f-8ec4-75a708acd494 None admin] RBAC: Authorizing `identity:create_grant(project_id=66f531bc924b41faa64743923afac319, user_id=e41a4d3a822c403fad048764a0edf209, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:43.320544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c218a10-3589-459f-8ec4-75a708acd494 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:43.322418 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 386/772] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Jul 14 11:55:43 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:43.323428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee960f-d0fc-4e7f-83c7-2e95eb1e7b2a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:43.343285 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 387/773] 10.222.0.79 () {58 vars in 1439 bytes} [Thu Jul 14 11:55:43 2022] PUT /identity/v3/projects/66f531bc924b41faa64743923afac319/users/e41a4d3a822c403fad048764a0edf209/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:55:43.344321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c218a10-3589-459f-8ec4-75a708acd494 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:43.403998 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:43.449831 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee960f-d0fc-4e7f-83c7-2e95eb1e7b2a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:43.466694 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c218a10-3589-459f-8ec4-75a708acd494 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:43.490385 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa46e63-67f0-4c75-8be4-3601e8424fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:43.491573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa46e63-67f0-4c75-8be4-3601e8424fec None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:43.492009 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa46e63-67f0-4c75-8be4-3601e8424fec None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:43.492561 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa46e63-67f0-4c75-8be4-3601e8424fec None admin] PATH_INFO: `/v3/services/network` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:43.493595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa46e63-67f0-4c75-8be4-3601e8424fec None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:43.496968 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa46e63-67f0-4c75-8be4-3601e8424fec None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:43.504463 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48837f80-9786-4f94-8166-5ccb2940ce76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:43.505225 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48837f80-9786-4f94-8166-5ccb2940ce76 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:43.505588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48837f80-9786-4f94-8166-5ccb2940ce76 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:43.505946 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48837f80-9786-4f94-8166-5ccb2940ce76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:43.506878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48837f80-9786-4f94-8166-5ccb2940ce76 None admin] RBAC: Adding query filter params (interface=public, service_id=dcf96be0b4454fbd9a26cf4869aba692, region_id=RegionOne) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:43.507269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48837f80-9786-4f94-8166-5ccb2940ce76 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:43.508754 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48837f80-9786-4f94-8166-5ccb2940ce76 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:43.512502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-cfa46e63-67f0-4c75-8be4-3601e8424fec None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:55:43.512502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:43.512502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:55:43.512502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:55:43.512502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:55:43.512502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:55:43.512502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:55:43.512502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:55:43.512502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:55:43.512502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:43.512502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:55:43.512502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:43.512502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:43.512502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:43.512502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:43.512502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:43.512502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:43.513536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:43.513536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:43.513536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:43.513536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:43.513536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:43.513536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:43.513536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:55:43.513536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:55:43.513536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:55:43.513536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:55:43.513536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:43.513536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:43.513536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:43.513536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:43.513536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:43.513536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:43.514366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:43.514366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:43.514366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:43.514366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:43.514366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:43.514366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:43.514366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:43.514366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:43.514366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:43.514366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:43.514366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:55:43.514366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:55:43.514366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:55:43.514366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:43.517080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 387/774] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:43 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:43.522985 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 388/775] 10.222.0.79 () {56 vars in 1251 bytes} [Thu Jul 14 11:55:43 2022] GET /identity/v3/endpoints?service_id=dcf96be0b4454fbd9a26cf4869aba692&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:43.524384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa46e63-67f0-4c75-8be4-3601e8424fec None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:43.524774 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48837f80-9786-4f94-8166-5ccb2940ce76 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:43.546363 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:43.639005 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48837f80-9786-4f94-8166-5ccb2940ce76 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:43.649537 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:43.680786 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085ed19-0c69-4bd6-a204-2b89b6bea797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:43.680786 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085ed19-0c69-4bd6-a204-2b89b6bea797 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:43.680786 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085ed19-0c69-4bd6-a204-2b89b6bea797 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:43.680786 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085ed19-0c69-4bd6-a204-2b89b6bea797 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:43.681267 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085ed19-0c69-4bd6-a204-2b89b6bea797 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:43.681891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085ed19-0c69-4bd6-a204-2b89b6bea797 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:43.688312 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 389/776] 10.222.0.79 () {56 vars in 1087 bytes} [Thu Jul 14 11:55:43 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:43.717717 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa46e63-67f0-4c75-8be4-3601e8424fec None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:43.759127 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a77144-17f8-4050-b6dc-49be1503bc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:43.760338 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a77144-17f8-4050-b6dc-49be1503bc18 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:43.760776 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a77144-17f8-4050-b6dc-49be1503bc18 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:43.761203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a77144-17f8-4050-b6dc-49be1503bc18 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:43.762107 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a77144-17f8-4050-b6dc-49be1503bc18 None admin] RBAC: Adding query filter params (name=network) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:43.762603 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a77144-17f8-4050-b6dc-49be1503bc18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:43.764254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a77144-17f8-4050-b6dc-49be1503bc18 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:43.770294 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 388/777] 10.222.0.79 () {56 vars in 1112 bytes} [Thu Jul 14 11:55:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:43.778759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085ed19-0c69-4bd6-a204-2b89b6bea797 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:43.907490 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085ed19-0c69-4bd6-a204-2b89b6bea797 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:43.942553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389dfb35-2b80-44fa-b6ee-03008c2433f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:43.943198 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389dfb35-2b80-44fa-b6ee-03008c2433f1 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:43.943514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389dfb35-2b80-44fa-b6ee-03008c2433f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:43.943764 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389dfb35-2b80-44fa-b6ee-03008c2433f1 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:43.944479 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389dfb35-2b80-44fa-b6ee-03008c2433f1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:43.944794 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389dfb35-2b80-44fa-b6ee-03008c2433f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:43.946198 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389dfb35-2b80-44fa-b6ee-03008c2433f1 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:43.954800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 390/778] 10.222.0.79 () {56 vars in 1112 bytes} [Thu Jul 14 11:55:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:55:43.958081 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a77144-17f8-4050-b6dc-49be1503bc18 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:44.067396 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:44.101707 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a77144-17f8-4050-b6dc-49be1503bc18 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:44.147424 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556df8c8-63cd-4f46-8dca-7ffb88b10628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:44.148104 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556df8c8-63cd-4f46-8dca-7ffb88b10628 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:44.148388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556df8c8-63cd-4f46-8dca-7ffb88b10628 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:44.148663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556df8c8-63cd-4f46-8dca-7ffb88b10628 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:44.149454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556df8c8-63cd-4f46-8dca-7ffb88b10628 None admin] RBAC: Adding query filter params (interface=public, service_id=095a5e37a2f845ff9909abb5e064e4e9, region_id=RegionOne) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:44.149766 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556df8c8-63cd-4f46-8dca-7ffb88b10628 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:44.151705 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556df8c8-63cd-4f46-8dca-7ffb88b10628 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:44.165331 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 389/779] 10.222.0.79 () {56 vars in 1251 bytes} [Thu Jul 14 11:55:43 2022] GET /identity/v3/endpoints?service_id=095a5e37a2f845ff9909abb5e064e4e9&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:44.170700 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389dfb35-2b80-44fa-b6ee-03008c2433f1 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:44.218905 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:44.290665 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389dfb35-2b80-44fa-b6ee-03008c2433f1 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:44.344137 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557c126-d444-4e30-87c9-3e4ae46ace45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:44.344879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557c126-d444-4e30-87c9-3e4ae46ace45 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:44.345162 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557c126-d444-4e30-87c9-3e4ae46ace45 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:44.345477 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557c126-d444-4e30-87c9-3e4ae46ace45 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:44.346165 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557c126-d444-4e30-87c9-3e4ae46ace45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:44.347645 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557c126-d444-4e30-87c9-3e4ae46ace45 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:44.353715 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 391/780] 10.222.0.79 () {56 vars in 1087 bytes} [Thu Jul 14 11:55:44 2022] GET /identity/v3/services => generated 772 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:44.654653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42bc8e-9e44-4c69-812d-95856c9df56c None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:44.655205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42bc8e-9e44-4c69-812d-95856c9df56c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:44.655205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42bc8e-9e44-4c69-812d-95856c9df56c None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:44.656833 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 390/781] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:44.661962 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9ee35-30dd-41fe-9a00-761fa12326fb None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:44.662257 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9ee35-30dd-41fe-9a00-761fa12326fb None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:44.662568 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9ee35-30dd-41fe-9a00-761fa12326fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:44.803152 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-12b9ee35-30dd-41fe-9a00-761fa12326fb None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:44.804358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-12b9ee35-30dd-41fe-9a00-761fa12326fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:44.903845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 392/782] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:55:44.916559 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40636044-6c01-4a50-86ac-3deb91e95fa7 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:44.917161 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40636044-6c01-4a50-86ac-3deb91e95fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:44.917645 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40636044-6c01-4a50-86ac-3deb91e95fa7 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:44.919558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 391/783] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:44.925347 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2c52a-de28-424b-b7c5-49bca6303a5a None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:44.925642 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2c52a-de28-424b-b7c5-49bca6303a5a None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:44.925925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2c52a-de28-424b-b7c5-49bca6303a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:44.946582 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-1ca2c52a-de28-424b-b7c5-49bca6303a5a None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:44.948404 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-1ca2c52a-de28-424b-b7c5-49bca6303a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:44.955490 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40636044-6c01-4a50-86ac-3deb91e95fa7 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:44.995905 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:45.074829 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 393/784] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:55:45.100939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2c52a-de28-424b-b7c5-49bca6303a5a None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:45.118834 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40636044-6c01-4a50-86ac-3deb91e95fa7 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:45.172881 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa74547-a336-4764-9174-2fce30d3f95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:45.173594 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa74547-a336-4764-9174-2fce30d3f95a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:45.174054 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa74547-a336-4764-9174-2fce30d3f95a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:45.174331 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa74547-a336-4764-9174-2fce30d3f95a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:45.190122 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:45.199043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa74547-a336-4764-9174-2fce30d3f95a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:45.209488 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-7aa74547-a336-4764-9174-2fce30d3f95a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:45.209488 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:45.209488 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:45.209488 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:45.209488 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:45.209488 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:45.209488 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:45.209488 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:45.209488 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:45.209488 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:45.209488 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:45.209488 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:45.209488 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:45.209488 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:45.209488 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:45.209488 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:45.210452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:45.210452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:45.210452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:45.210452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:45.210452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:45.210452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:45.210452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:45.210452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:45.210452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:45.210452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:45.210452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:45.210452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:45.210452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:45.210452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:45.210452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:45.210452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:45.211312 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:45.211312 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:45.211312 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:45.211312 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:45.211312 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:45.211312 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:45.211312 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:45.211312 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:45.211312 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:45.211312 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:45.211312 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:45.211312 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:45.214689 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 392/785] 10.222.0.79 () {56 vars in 1102 bytes} [Thu Jul 14 11:55:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:45.220263 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa74547-a336-4764-9174-2fce30d3f95a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:45.283796 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2c52a-de28-424b-b7c5-49bca6303a5a None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:45.355258 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbc109-3d37-4bce-a59a-e1c54d54f80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:45.356069 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbc109-3d37-4bce-a59a-e1c54d54f80c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:45.356358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbc109-3d37-4bce-a59a-e1c54d54f80c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:45.356629 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbc109-3d37-4bce-a59a-e1c54d54f80c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:45.387540 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbc109-3d37-4bce-a59a-e1c54d54f80c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:45.395317 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-fdfbc109-3d37-4bce-a59a-e1c54d54f80c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:55:45.395317 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:45.395317 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:45.395317 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:45.395317 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:45.395317 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:45.395317 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:45.395317 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:45.395317 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:45.395317 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:45.395317 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:45.395317 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:45.395317 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:45.395317 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:45.395317 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:45.395317 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:45.396284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:45.396284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:45.396284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:45.396284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:45.396284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:45.396284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:45.396284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:45.396284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:45.396284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:45.396284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:45.396284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:45.396284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:45.396284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:45.396284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:45.396284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:45.396284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:45.397105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:45.397105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:45.397105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:45.397105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:45.397105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:45.397105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:45.397105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:45.397105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:45.397105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:45.397105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:45.397105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:55:45.397105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:45.397105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 394/786] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:55:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:55:45.403743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbc109-3d37-4bce-a59a-e1c54d54f80c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:45.414650 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa74547-a336-4764-9174-2fce30d3f95a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:45.454909 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:45.497482 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441d8c0-3254-4b00-a144-84080f5b2b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:45.498171 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441d8c0-3254-4b00-a144-84080f5b2b17 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:45.498453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441d8c0-3254-4b00-a144-84080f5b2b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:45.498756 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441d8c0-3254-4b00-a144-84080f5b2b17 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:45.499513 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441d8c0-3254-4b00-a144-84080f5b2b17 None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:45.499822 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441d8c0-3254-4b00-a144-84080f5b2b17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:45.501187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441d8c0-3254-4b00-a144-84080f5b2b17 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:45.532804 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 393/787] 10.222.0.79 () {56 vars in 1103 bytes} [Thu Jul 14 11:55:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:45.542061 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441d8c0-3254-4b00-a144-84080f5b2b17 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:45.587438 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbc109-3d37-4bce-a59a-e1c54d54f80c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:45.651277 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:45.652910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edd706-5519-4f4a-b0bc-b308665eac37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:45.653847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edd706-5519-4f4a-b0bc-b308665eac37 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:45.654130 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edd706-5519-4f4a-b0bc-b308665eac37 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:45.654405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edd706-5519-4f4a-b0bc-b308665eac37 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:45.655183 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3edd706-5519-4f4a-b0bc-b308665eac37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:45.655494 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3edd706-5519-4f4a-b0bc-b308665eac37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:45.657673 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3edd706-5519-4f4a-b0bc-b308665eac37 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:45.676327 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 395/788] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:55:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:45.695715 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edd706-5519-4f4a-b0bc-b308665eac37 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:45.721607 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441d8c0-3254-4b00-a144-84080f5b2b17 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:45.790487 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb498c-9f3a-4bc8-ad7e-766f36b92bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:45.791891 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb498c-9f3a-4bc8-ad7e-766f36b92bec None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:45.792170 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb498c-9f3a-4bc8-ad7e-766f36b92bec None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:45.792442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb498c-9f3a-4bc8-ad7e-766f36b92bec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:45.811534 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb498c-9f3a-4bc8-ad7e-766f36b92bec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:45.813577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb498c-9f3a-4bc8-ad7e-766f36b92bec None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:45.846470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-aafb498c-9f3a-4bc8-ad7e-766f36b92bec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:45.846470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:45.846470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:45.846470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:45.846470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:45.846470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:45.846470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:45.846470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:45.846470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:45.846470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:45.846470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:45.846470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:45.846470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:45.846470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:45.846470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:45.848591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:45.848591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:45.848591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:45.848591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:45.848591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:45.848591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:45.848591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:45.848591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:45.848591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:45.848591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:45.848591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:45.848591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:45.848591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:45.848591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:45.848591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:45.848591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:45.848591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:45.850814 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:45.850814 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:45.850814 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:45.850814 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:45.850814 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 394/789] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:45.853669 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb498c-9f3a-4bc8-ad7e-766f36b92bec None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:45.859790 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:45.894398 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edd706-5519-4f4a-b0bc-b308665eac37 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:45.942425 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6a708-9bbc-428b-b613-5e9aa8a8036b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:45.943742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6a708-9bbc-428b-b613-5e9aa8a8036b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:45.944301 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6a708-9bbc-428b-b613-5e9aa8a8036b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:45.944582 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6a708-9bbc-428b-b613-5e9aa8a8036b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:45.961134 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6a708-9bbc-428b-b613-5e9aa8a8036b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:45.962630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6a708-9bbc-428b-b613-5e9aa8a8036b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:45.984758 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb498c-9f3a-4bc8-ad7e-766f36b92bec None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:45.987992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-38a6a708-9bbc-428b-b613-5e9aa8a8036b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:45.987992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:45.987992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:45.987992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:45.987992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:45.987992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:45.987992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:45.987992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:45.987992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:45.987992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:45.987992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:45.987992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:45.987992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:45.987992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:45.987992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:45.988833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:45.988833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:45.988833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:45.988833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:45.988833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:45.988833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:45.988833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:45.988833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:45.988833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:45.988833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:45.988833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:45.988833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:45.988833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:45.988833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:45.988833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:45.988833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:45.988833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:45.989696 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:45.989696 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:45.989696 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:45.989696 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:45.992155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 396/790] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:55:45.993770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd7dfe-31fe-4f79-b8b2-b51b1076d936 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:45.994808 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd7dfe-31fe-4f79-b8b2-b51b1076d936 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:45.995284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd7dfe-31fe-4f79-b8b2-b51b1076d936 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:46.001903 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 397/791] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:46.003476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd7dfe-31fe-4f79-b8b2-b51b1076d936 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:46.006361 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:46.031235 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a1d6c-fe06-403f-9323-e7f8795b152a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:46.031908 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a1d6c-fe06-403f-9323-e7f8795b152a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:46.032188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a1d6c-fe06-403f-9323-e7f8795b152a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:46.032506 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a1d6c-fe06-403f-9323-e7f8795b152a None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:46.033236 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a1d6c-fe06-403f-9323-e7f8795b152a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:46.033541 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a1d6c-fe06-403f-9323-e7f8795b152a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:46.035340 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a1d6c-fe06-403f-9323-e7f8795b152a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:46.048322 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 395/792] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:46.049708 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982634ea-ddcf-40ef-b2c9-86978437bd98 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:46.049997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982634ea-ddcf-40ef-b2c9-86978437bd98 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:46.050277 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982634ea-ddcf-40ef-b2c9-86978437bd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:46.068925 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-982634ea-ddcf-40ef-b2c9-86978437bd98 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:46.070226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-982634ea-ddcf-40ef-b2c9-86978437bd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:46.143591 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd7dfe-31fe-4f79-b8b2-b51b1076d936 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:46.154511 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 396/793] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:55:46.154511 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982634ea-ddcf-40ef-b2c9-86978437bd98 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:46.195909 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba9a63-e8aa-4403-a184-e0760f182ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:46.196621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba9a63-e8aa-4403-a184-e0760f182ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:46.196904 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba9a63-e8aa-4403-a184-e0760f182ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:46.197174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba9a63-e8aa-4403-a184-e0760f182ac7 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:46.198420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba9a63-e8aa-4403-a184-e0760f182ac7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:46.198855 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba9a63-e8aa-4403-a184-e0760f182ac7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:46.200441 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba9a63-e8aa-4403-a184-e0760f182ac7 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:46.201886 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:46.215280 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 398/794] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:46.220691 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba9a63-e8aa-4403-a184-e0760f182ac7 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:46.285810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982634ea-ddcf-40ef-b2c9-86978437bd98 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:46.288332 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:46.332143 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c95e7-77f4-4404-8762-31f6b17f2194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:46.333615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c95e7-77f4-4404-8762-31f6b17f2194 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:46.334237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c95e7-77f4-4404-8762-31f6b17f2194 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:46.334717 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c95e7-77f4-4404-8762-31f6b17f2194 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:46.338882 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba9a63-e8aa-4403-a184-e0760f182ac7 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:46.347132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c95e7-77f4-4404-8762-31f6b17f2194 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:46.348589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c95e7-77f4-4404-8762-31f6b17f2194 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:46.370464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-8f2c95e7-77f4-4404-8762-31f6b17f2194 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 11:55:46.370464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:46.370464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:46.370464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:46.370464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:46.370464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:46.370464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:46.370464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:46.370464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:46.370464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:46.370464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:46.370464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:46.370464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:55:46.370464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:55:46.370464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:55:46.370464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:55:46.371475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:46.371475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:46.371475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:55:46.371475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:46.371475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:55:46.371475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:46.371475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:46.371475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:46.371475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:46.371475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:46.371475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:46.371475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:46.371475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:46.371475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:46.371475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:46.371475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:46.371475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:46.371475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:46.372390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:46.372390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:46.372390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:55:46.372390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:55:46.372390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:55:46.372390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:55:46.372390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:55:46.372390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:55:46.372390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 11:55:46.372390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:46.375209 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 397/795] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Jul 14 11:55:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:46.376635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c95e7-77f4-4404-8762-31f6b17f2194 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:46.380107 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1b400-52cb-4ade-a749-f0259afe7269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:46.381079 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1b400-52cb-4ade-a749-f0259afe7269 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:46.382355 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1b400-52cb-4ade-a749-f0259afe7269 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:46.382355 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1b400-52cb-4ade-a749-f0259afe7269 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:46.398631 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1b400-52cb-4ade-a749-f0259afe7269 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:46.407094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-0db1b400-52cb-4ade-a749-f0259afe7269 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:55:46.407094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:46.407094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:46.407094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:46.407094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:46.407094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:46.407094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:46.407094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:46.407094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:46.407094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:46.407094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:46.407094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:46.407094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:46.407094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:46.407094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:46.407094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:46.409838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:46.409838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:46.409838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:46.409838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:46.409838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:46.409838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:46.409838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:46.409838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:46.409838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:46.409838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:46.409838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:46.409838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:46.409838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:46.409838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:46.409838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:46.409838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:46.411669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:46.411669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:46.411669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:46.411669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:46.411669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:46.411669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:46.411669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:46.411669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:46.411669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:46.411669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:46.411669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:55:46.411669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:46.411669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 399/796] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:55:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:46.411669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1b400-52cb-4ade-a749-f0259afe7269 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:46.470208 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:46.502123 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c95e7-77f4-4404-8762-31f6b17f2194 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:46.518245 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1b400-52cb-4ade-a749-f0259afe7269 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:46.539374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb641c42-eba1-4e62-b23f-9787cb32a5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:46.540114 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb641c42-eba1-4e62-b23f-9787cb32a5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:46.540404 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb641c42-eba1-4e62-b23f-9787cb32a5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:46.540689 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb641c42-eba1-4e62-b23f-9787cb32a5a8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:46.549302 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb641c42-eba1-4e62-b23f-9787cb32a5a8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:46.550963 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb641c42-eba1-4e62-b23f-9787cb32a5a8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:46.557018 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beeed98-2ba1-4d71-9e70-5cbe02a382b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:46.557695 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeed98-2ba1-4d71-9e70-5cbe02a382b4 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:46.557983 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeed98-2ba1-4d71-9e70-5cbe02a382b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:46.558263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeed98-2ba1-4d71-9e70-5cbe02a382b4 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:46.559144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beeed98-2ba1-4d71-9e70-5cbe02a382b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:46.559461 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beeed98-2ba1-4d71-9e70-5cbe02a382b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:46.560887 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beeed98-2ba1-4d71-9e70-5cbe02a382b4 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:46.566137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-bb641c42-eba1-4e62-b23f-9787cb32a5a8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 11:55:46.566137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:46.566137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:46.566137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:46.566137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:46.566137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:46.566137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:46.566137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:46.566137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:46.566137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:46.566137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:46.566137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:46.566137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:55:46.566137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:55:46.566137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:55:46.566137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:55:46.567250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:46.567250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:46.567250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:55:46.567250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:46.567250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:55:46.567250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:46.567250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:46.567250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:46.567250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:46.567250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:46.567250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:46.567250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:46.567250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:46.567250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:46.567250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:46.567250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:46.567250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:46.567250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:46.568868 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:46.568868 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:46.568868 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:55:46.568868 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:55:46.568868 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:55:46.568868 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:55:46.568868 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:55:46.568868 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:55:46.568868 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 11:55:46.568868 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:46.568868 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 398/797] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:55:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:46.573258 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a28bb-d96e-4b76-ad68-945dc95316f1 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:46.573552 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a28bb-d96e-4b76-ad68-945dc95316f1 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:46.573830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a28bb-d96e-4b76-ad68-945dc95316f1 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:46.575315 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 399/798] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:46.575945 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a28bb-d96e-4b76-ad68-945dc95316f1 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:46.589507 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 400/799] 10.222.0.79 () {56 vars in 1149 bytes} [Thu Jul 14 11:55:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:46.589507 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beeed98-2ba1-4d71-9e70-5cbe02a382b4 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:46.604399 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:46.698810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a28bb-d96e-4b76-ad68-945dc95316f1 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:46.706754 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beeed98-2ba1-4d71-9e70-5cbe02a382b4 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:46.721477 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:46.744126 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e36c0-f452-4041-b9c8-8ab1e97c3761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:46.744831 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e36c0-f452-4041-b9c8-8ab1e97c3761 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:46.745120 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e36c0-f452-4041-b9c8-8ab1e97c3761 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:46.745401 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e36c0-f452-4041-b9c8-8ab1e97c3761 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:46.746156 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e36c0-f452-4041-b9c8-8ab1e97c3761 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:46.746470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e36c0-f452-4041-b9c8-8ab1e97c3761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:46.747861 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e36c0-f452-4041-b9c8-8ab1e97c3761 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:46.749569 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c1d5f-4213-472d-909c-5011af64088d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:46.750248 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c1d5f-4213-472d-909c-5011af64088d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:46.750569 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c1d5f-4213-472d-909c-5011af64088d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:46.750850 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c1d5f-4213-472d-909c-5011af64088d None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:46.751693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c1d5f-4213-472d-909c-5011af64088d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:46.752011 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c1d5f-4213-472d-909c-5011af64088d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:46.753458 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c1d5f-4213-472d-909c-5011af64088d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:46.758386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 400/800] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:55:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:46.759985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0c723-cb00-42c1-8731-f4ba82380388 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:46.760454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0c723-cb00-42c1-8731-f4ba82380388 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:46.760733 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0c723-cb00-42c1-8731-f4ba82380388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:46.776207 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 401/801] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Jul 14 11:55:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:46.777354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c1d5f-4213-472d-909c-5011af64088d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:46.778744 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-b5b0c723-cb00-42c1-8731-f4ba82380388 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:46.779937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b5b0c723-cb00-42c1-8731-f4ba82380388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:46.852869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 401/802] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:55:46.854157 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0c723-cb00-42c1-8731-f4ba82380388 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:46.872387 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:46.886592 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c1d5f-4213-472d-909c-5011af64088d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:46.921881 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d9198-6a74-4561-9dae-a93e3a22693f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:46.922694 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d9198-6a74-4561-9dae-a93e3a22693f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:46.922979 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d9198-6a74-4561-9dae-a93e3a22693f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:46.923253 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d9198-6a74-4561-9dae-a93e3a22693f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:46.934060 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d9198-6a74-4561-9dae-a93e3a22693f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:46.935530 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d9198-6a74-4561-9dae-a93e3a22693f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:46.952801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-101d9198-6a74-4561-9dae-a93e3a22693f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:46.952801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:46.952801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:46.952801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:46.952801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:46.952801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:46.952801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:46.952801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:46.952801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:46.952801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:46.952801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:46.952801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:46.952801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:46.952801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:46.952801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:46.953920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:46.953920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:46.953920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:46.953920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:46.953920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:46.953920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:46.953920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:46.953920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:46.953920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:46.953920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:46.953920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:46.953920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:46.953920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:46.953920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:46.953920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:46.953920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:46.953920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:46.955040 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:46.955040 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:46.955040 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:46.955040 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:46.955040 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 402/803] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:46.955377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d9198-6a74-4561-9dae-a93e3a22693f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:46.961588 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0c723-cb00-42c1-8731-f4ba82380388 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:46.983587 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:46.997988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9f53e-6d4e-41f2-a328-e4e0a4965e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:46.998818 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9f53e-6d4e-41f2-a328-e4e0a4965e9b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:46.999103 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9f53e-6d4e-41f2-a328-e4e0a4965e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:46.999378 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9f53e-6d4e-41f2-a328-e4e0a4965e9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:47.009855 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9f53e-6d4e-41f2-a328-e4e0a4965e9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:47.011319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9f53e-6d4e-41f2-a328-e4e0a4965e9b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:47.028456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-19d9f53e-6d4e-41f2-a328-e4e0a4965e9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:47.028456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:47.028456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:47.028456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:47.028456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:47.028456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:47.028456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:47.028456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:47.028456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:47.028456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:47.028456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:47.028456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:47.028456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:47.028456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:47.028456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:47.029386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:47.029386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:47.029386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:47.029386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:47.029386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:47.029386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:47.029386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:47.029386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:47.029386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:47.029386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:47.029386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:47.029386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:47.029386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:47.029386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:47.029386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:47.029386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:47.029386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:47.030264 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:47.030264 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:47.030264 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:47.030264 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:47.030264 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 402/804] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:47.031052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7089ed1-85d6-415a-9bdd-1bc74dc133cb None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:47.031340 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7089ed1-85d6-415a-9bdd-1bc74dc133cb None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:47.031614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7089ed1-85d6-415a-9bdd-1bc74dc133cb None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:47.033017 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 403/805] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:47.033630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7089ed1-85d6-415a-9bdd-1bc74dc133cb None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:47.062759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d9198-6a74-4561-9dae-a93e3a22693f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:47.096325 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71420e01-c2ab-434b-988e-e911bf450ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:47.097137 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71420e01-c2ab-434b-988e-e911bf450ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:47.097398 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71420e01-c2ab-434b-988e-e911bf450ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:47.097676 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71420e01-c2ab-434b-988e-e911bf450ac2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:47.105590 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:47.109278 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71420e01-c2ab-434b-988e-e911bf450ac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:47.110975 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71420e01-c2ab-434b-988e-e911bf450ac2 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:47.128733 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-71420e01-c2ab-434b-988e-e911bf450ac2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:47.128733 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:47.128733 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:47.128733 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:47.128733 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:47.128733 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:47.128733 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:47.128733 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:47.128733 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:47.128733 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:47.128733 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:47.128733 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:47.128733 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:47.128733 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:47.128733 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:47.129690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:47.129690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:47.129690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:47.129690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:47.129690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:47.129690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:47.129690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:47.129690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:47.129690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:47.129690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:47.129690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:47.129690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:47.129690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:47.129690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:47.129690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:47.129690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:47.129690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:47.130596 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:47.130596 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:47.130596 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:47.130596 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:47.130596 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 403/806] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:47.130884 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71420e01-c2ab-434b-988e-e911bf450ac2 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:47.153179 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7089ed1-85d6-415a-9bdd-1bc74dc133cb None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:47.187551 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db31fdb-3495-40bc-82ca-8113b4f918d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:47.188369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db31fdb-3495-40bc-82ca-8113b4f918d3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:47.188657 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db31fdb-3495-40bc-82ca-8113b4f918d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:47.188934 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db31fdb-3495-40bc-82ca-8113b4f918d3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:47.189591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db31fdb-3495-40bc-82ca-8113b4f918d3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:47.190998 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db31fdb-3495-40bc-82ca-8113b4f918d3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:47.203128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-8db31fdb-3495-40bc-82ca-8113b4f918d3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:55:47.203128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:47.203128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:55:47.203128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:55:47.203128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:55:47.203128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:55:47.203128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:55:47.203128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:55:47.203128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:55:47.203128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:47.203128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:55:47.203128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:47.203128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:47.203128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:47.203128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:47.203128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:47.214233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:47.214233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:47.214233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:47.214233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:47.214233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:47.214233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:47.214233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:47.214233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:55:47.214233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:55:47.214233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:55:47.214233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:55:47.214233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:47.214233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:47.214233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:47.214233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:47.214233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:47.215151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:47.215151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:47.215151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:47.215151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:47.215151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:47.215151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:47.215151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:47.215151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:47.215151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:47.215151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:47.215151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:47.215151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:55:47.215151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:55:47.215151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:55:47.215151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:47.215151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 404/807] 10.222.0.79 () {56 vars in 1129 bytes} [Thu Jul 14 11:55:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:47.216622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db31fdb-3495-40bc-82ca-8113b4f918d3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:47.216783 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:47.245343 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71420e01-c2ab-434b-988e-e911bf450ac2 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:47.279997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbeb72-b3b9-4c18-901f-c7c822d528e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:47.280661 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbeb72-b3b9-4c18-901f-c7c822d528e4 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:47.280944 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbeb72-b3b9-4c18-901f-c7c822d528e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:47.281228 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbeb72-b3b9-4c18-901f-c7c822d528e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:47.281962 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbeb72-b3b9-4c18-901f-c7c822d528e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:47.282270 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbeb72-b3b9-4c18-901f-c7c822d528e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:47.283749 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbeb72-b3b9-4c18-901f-c7c822d528e4 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:47.296229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 404/808] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:47.297498 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf8de0-f044-4e5f-adf2-6ae808141f7c None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:47.297785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf8de0-f044-4e5f-adf2-6ae808141f7c None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:47.298061 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf8de0-f044-4e5f-adf2-6ae808141f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:47.316088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-16cf8de0-f044-4e5f-adf2-6ae808141f7c None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:47.317334 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-16cf8de0-f044-4e5f-adf2-6ae808141f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:47.323435 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db31fdb-3495-40bc-82ca-8113b4f918d3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:47.359586 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:47.367277 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb218375-605b-4b10-81c1-ba8537575e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:47.368044 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb218375-605b-4b10-81c1-ba8537575e8b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:47.368332 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb218375-605b-4b10-81c1-ba8537575e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:47.368610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb218375-605b-4b10-81c1-ba8537575e8b None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:47.369392 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb218375-605b-4b10-81c1-ba8537575e8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:47.369700 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb218375-605b-4b10-81c1-ba8537575e8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:47.371114 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb218375-605b-4b10-81c1-ba8537575e8b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:47.383626 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 405/809] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:47.384474 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb218375-605b-4b10-81c1-ba8537575e8b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:47.408041 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 405/810] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:55:47.408900 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf8de0-f044-4e5f-adf2-6ae808141f7c None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:47.470899 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:47.485031 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb218375-605b-4b10-81c1-ba8537575e8b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:47.511112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf8de0-f044-4e5f-adf2-6ae808141f7c None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:47.518432 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e6eaa-0e23-4f70-b384-ac7b637a49ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:47.519127 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e6eaa-0e23-4f70-b384-ac7b637a49ff None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:47.519416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e6eaa-0e23-4f70-b384-ac7b637a49ff None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:47.519702 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e6eaa-0e23-4f70-b384-ac7b637a49ff None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:47.520421 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e6eaa-0e23-4f70-b384-ac7b637a49ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:47.520731 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e6eaa-0e23-4f70-b384-ac7b637a49ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:47.522134 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e6eaa-0e23-4f70-b384-ac7b637a49ff None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:47.533669 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 406/811] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:47.534466 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e6eaa-0e23-4f70-b384-ac7b637a49ff None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:47.545500 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60388e46-c491-48c6-b28d-0c14bfab7e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:47.546168 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60388e46-c491-48c6-b28d-0c14bfab7e4a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:47.546450 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60388e46-c491-48c6-b28d-0c14bfab7e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:47.546758 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60388e46-c491-48c6-b28d-0c14bfab7e4a None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:47.547467 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60388e46-c491-48c6-b28d-0c14bfab7e4a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:47.547786 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60388e46-c491-48c6-b28d-0c14bfab7e4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:47.549152 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60388e46-c491-48c6-b28d-0c14bfab7e4a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:47.553885 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 406/812] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Jul 14 11:55:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:47.554707 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60388e46-c491-48c6-b28d-0c14bfab7e4a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:47.585827 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:47.637508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e6eaa-0e23-4f70-b384-ac7b637a49ff None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:47.653719 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60388e46-c491-48c6-b28d-0c14bfab7e4a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:47.671854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f94607-4e1b-4f31-8047-54a11aeacdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:47.672643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f94607-4e1b-4f31-8047-54a11aeacdd4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:47.672946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f94607-4e1b-4f31-8047-54a11aeacdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:47.673218 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f94607-4e1b-4f31-8047-54a11aeacdd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:47.679846 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:47.680173 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f94607-4e1b-4f31-8047-54a11aeacdd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:47.681640 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f94607-4e1b-4f31-8047-54a11aeacdd4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:47.688127 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2691ae-7189-4d33-9def-5b8ba014143a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:47.688902 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2691ae-7189-4d33-9def-5b8ba014143a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:47.689182 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2691ae-7189-4d33-9def-5b8ba014143a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:47.689449 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2691ae-7189-4d33-9def-5b8ba014143a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:47.695693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-c9f94607-4e1b-4f31-8047-54a11aeacdd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:47.695693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:47.695693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:47.695693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:47.695693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:47.695693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:47.695693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:47.695693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:47.695693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:47.695693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:47.695693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:47.695693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:47.695693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:55:47.695693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:55:47.695693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:55:47.696582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:55:47.696582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:47.696582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:47.696582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:47.696582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:47.696582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:47.696582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:47.696582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:47.696582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:47.696582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:47.696582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:47.696582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:47.696582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:47.696582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:47.696582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:47.696582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:47.696582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:47.697995 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:55:47.697995 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:55:47.697995 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:55:47.697995 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:55:47.697995 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:55:47.697995 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:55:47.697995 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:47.697995 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:47.698536 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2691ae-7189-4d33-9def-5b8ba014143a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:47.698613 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 407/813] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:47.698613 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f94607-4e1b-4f31-8047-54a11aeacdd4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:47.698749 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2691ae-7189-4d33-9def-5b8ba014143a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:47.714098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-9e2691ae-7189-4d33-9def-5b8ba014143a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:55:47.714098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:47.714098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:47.714098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:47.714098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:47.714098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:47.714098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:47.714098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:47.714098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:47.714098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:47.714098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:47.714098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:47.714098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:55:47.714098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:55:47.714098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:55:47.714098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:55:47.715147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:47.715147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:47.715147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:55:47.715147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:47.715147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:55:47.715147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:47.715147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:47.715147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:47.715147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:47.715147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:47.715147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:47.715147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:47.715147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:47.715147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:47.715147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:47.715147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:47.715147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:47.715147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:47.716071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:47.716071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:47.716071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:55:47.716071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:55:47.716071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:55:47.716071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:55:47.716071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:55:47.716071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:55:47.716071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:55:47.716071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:47.716071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 407/814] 10.222.0.79 () {56 vars in 1093 bytes} [Thu Jul 14 11:55:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:47.716640 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2691ae-7189-4d33-9def-5b8ba014143a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:47.802673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f94607-4e1b-4f31-8047-54a11aeacdd4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:47.813208 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:47.822160 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2691ae-7189-4d33-9def-5b8ba014143a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:47.837426 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2fc17-a0d1-4f5f-9ae5-84b2876c3c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:47.838829 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2fc17-a0d1-4f5f-9ae5-84b2876c3c67 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:47.839115 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2fc17-a0d1-4f5f-9ae5-84b2876c3c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:47.839389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2fc17-a0d1-4f5f-9ae5-84b2876c3c67 None admin] PATH_INFO: `/v3/services/network` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:47.840036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2fc17-a0d1-4f5f-9ae5-84b2876c3c67 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:47.841389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2fc17-a0d1-4f5f-9ae5-84b2876c3c67 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:47.852916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-28d2fc17-a0d1-4f5f-9ae5-84b2876c3c67 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:55:47.852916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:47.852916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:55:47.852916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:55:47.852916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:55:47.852916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:55:47.852916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:55:47.852916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:55:47.852916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:55:47.852916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:47.852916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:55:47.852916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:47.852916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:47.852916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:47.852916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:47.852916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:47.852916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:47.853919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:47.853919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:47.853919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:47.853919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:47.853919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:47.853919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:47.853919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:55:47.853919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:55:47.853919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:55:47.853919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:55:47.853919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:47.853919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:47.853919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:47.853919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:47.853919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:47.853919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:47.854928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:47.854928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:47.854928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:47.854928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:47.854928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:47.854928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:47.854928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:47.854928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:47.854928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:47.854928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:47.854928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:55:47.854928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:55:47.854928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:55:47.854928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:47.854928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 408/815] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:47 2022] GET /identity/v3/services/network => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:47.856324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2fc17-a0d1-4f5f-9ae5-84b2876c3c67 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:47.860540 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a27bbd-0af1-4715-815b-27cd395e348e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:47.861328 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a27bbd-0af1-4715-815b-27cd395e348e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:47.861614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a27bbd-0af1-4715-815b-27cd395e348e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:47.861887 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a27bbd-0af1-4715-815b-27cd395e348e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:47.868983 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a27bbd-0af1-4715-815b-27cd395e348e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:47.870426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a27bbd-0af1-4715-815b-27cd395e348e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:47.884321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-10a27bbd-0af1-4715-815b-27cd395e348e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:47.884321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:47.884321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:47.884321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:47.884321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:47.884321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:47.884321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:47.884321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:47.884321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:47.884321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:47.884321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:47.884321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:47.884321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:55:47.884321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:55:47.884321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:55:47.885729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:55:47.885729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:47.885729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:47.885729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:47.885729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:47.885729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:47.885729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:47.885729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:47.885729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:47.885729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:47.885729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:47.885729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:47.885729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:47.885729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:47.885729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:47.885729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:47.885729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:47.886668 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:55:47.886668 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:55:47.886668 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:55:47.886668 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:55:47.886668 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:55:47.886668 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:55:47.886668 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:47.886668 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:47.886668 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 408/816] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:47.887228 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a27bbd-0af1-4715-815b-27cd395e348e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:47.935754 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:47.955769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2fc17-a0d1-4f5f-9ae5-84b2876c3c67 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:47.985445 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a27bbd-0af1-4715-815b-27cd395e348e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:47.988578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934ffdc-1f71-44a1-8382-14d0f8b825c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:47.989248 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934ffdc-1f71-44a1-8382-14d0f8b825c5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:47.989537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934ffdc-1f71-44a1-8382-14d0f8b825c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:47.989816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934ffdc-1f71-44a1-8382-14d0f8b825c5 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:47.990555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934ffdc-1f71-44a1-8382-14d0f8b825c5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:47.990871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934ffdc-1f71-44a1-8382-14d0f8b825c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:47.992232 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934ffdc-1f71-44a1-8382-14d0f8b825c5 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:47.997545 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 409/817] 10.222.0.79 () {56 vars in 1124 bytes} [Thu Jul 14 11:55:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:47.998341 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934ffdc-1f71-44a1-8382-14d0f8b825c5 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:48.019192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aeb349-5a83-461d-bf29-302c07766344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:48.019841 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aeb349-5a83-461d-bf29-302c07766344 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:48.020125 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aeb349-5a83-461d-bf29-302c07766344 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:48.020396 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aeb349-5a83-461d-bf29-302c07766344 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:48.021168 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aeb349-5a83-461d-bf29-302c07766344 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:48.021536 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aeb349-5a83-461d-bf29-302c07766344 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:48.022933 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aeb349-5a83-461d-bf29-302c07766344 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:48.034372 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 409/818] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:55:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:48.035217 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aeb349-5a83-461d-bf29-302c07766344 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:48.038109 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:48.099177 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934ffdc-1f71-44a1-8382-14d0f8b825c5 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:48.133935 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17481cbe-a07e-419f-bf5b-54333b06e6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:48.134616 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aeb349-5a83-461d-bf29-302c07766344 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:48.134754 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17481cbe-a07e-419f-bf5b-54333b06e6cd None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:48.135456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17481cbe-a07e-419f-bf5b-54333b06e6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:48.135738 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17481cbe-a07e-419f-bf5b-54333b06e6cd None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:48.136568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17481cbe-a07e-419f-bf5b-54333b06e6cd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:48.136875 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17481cbe-a07e-419f-bf5b-54333b06e6cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:48.138295 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17481cbe-a07e-419f-bf5b-54333b06e6cd None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:48.144078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:48.155598 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 410/819] 10.222.0.79 () {56 vars in 1133 bytes} [Thu Jul 14 11:55:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:48.156430 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17481cbe-a07e-419f-bf5b-54333b06e6cd None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:48.170214 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313b2a0-5ef6-466b-ab87-7cb05bd418a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:48.170989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313b2a0-5ef6-466b-ab87-7cb05bd418a9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:48.171340 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313b2a0-5ef6-466b-ab87-7cb05bd418a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:48.171681 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313b2a0-5ef6-466b-ab87-7cb05bd418a9 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:48.172445 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313b2a0-5ef6-466b-ab87-7cb05bd418a9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:48.172849 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313b2a0-5ef6-466b-ab87-7cb05bd418a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:48.174118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313b2a0-5ef6-466b-ab87-7cb05bd418a9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:48.178775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 410/820] 10.222.0.79 () {56 vars in 1112 bytes} [Thu Jul 14 11:55:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:48.179525 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313b2a0-5ef6-466b-ab87-7cb05bd418a9 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:48.252703 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:48.258678 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17481cbe-a07e-419f-bf5b-54333b06e6cd None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:48.279111 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313b2a0-5ef6-466b-ab87-7cb05bd418a9 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:48.295170 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741a3f5-e14f-49d8-8899-14ff3914014a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:48.295835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741a3f5-e14f-49d8-8899-14ff3914014a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:48.296116 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741a3f5-e14f-49d8-8899-14ff3914014a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:48.296388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741a3f5-e14f-49d8-8899-14ff3914014a None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:48.297170 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741a3f5-e14f-49d8-8899-14ff3914014a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:48.297478 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741a3f5-e14f-49d8-8899-14ff3914014a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:48.298926 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741a3f5-e14f-49d8-8899-14ff3914014a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:48.310573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 411/821] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:55:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:48.312744 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448566df-1850-4be8-85e1-9edce02d6544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:48.313397 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448566df-1850-4be8-85e1-9edce02d6544 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:48.313680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448566df-1850-4be8-85e1-9edce02d6544 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:48.313953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448566df-1850-4be8-85e1-9edce02d6544 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:48.314718 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448566df-1850-4be8-85e1-9edce02d6544 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:48.315418 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741a3f5-e14f-49d8-8899-14ff3914014a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:48.316083 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448566df-1850-4be8-85e1-9edce02d6544 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:48.342450 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 411/822] 10.222.0.79 () {60 vars in 1144 bytes} [Thu Jul 14 11:55:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:55:48.343344 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448566df-1850-4be8-85e1-9edce02d6544 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:48.380028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:48.441698 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741a3f5-e14f-49d8-8899-14ff3914014a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:48.474319 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448566df-1850-4be8-85e1-9edce02d6544 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:48.484474 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3907ae9-0f4f-4f8e-b2ad-042e96e11233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:48.485388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3907ae9-0f4f-4f8e-b2ad-042e96e11233 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:48.485676 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3907ae9-0f4f-4f8e-b2ad-042e96e11233 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:48.485953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3907ae9-0f4f-4f8e-b2ad-042e96e11233 None admin] PATH_INFO: `/v3/projects/66f531bc924b41faa64743923afac319/users/f64d942793a5493787c3e5c7815bc134/roles/73743e14bfe849198f3a8b549163f32b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:48.503165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3907ae9-0f4f-4f8e-b2ad-042e96e11233 None admin] RBAC: Authorizing `identity:create_grant(project_id=66f531bc924b41faa64743923afac319, user_id=f64d942793a5493787c3e5c7815bc134, role_id=73743e14bfe849198f3a8b549163f32b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:48.504624 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3907ae9-0f4f-4f8e-b2ad-042e96e11233 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:48.516414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4432d8-a3c4-4cc3-8640-14f2dc802781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:48.517310 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4432d8-a3c4-4cc3-8640-14f2dc802781 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:48.517596 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4432d8-a3c4-4cc3-8640-14f2dc802781 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:48.517871 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4432d8-a3c4-4cc3-8640-14f2dc802781 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:48.526608 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 412/823] 10.222.0.79 () {58 vars in 1439 bytes} [Thu Jul 14 11:55:48 2022] PUT /identity/v3/projects/66f531bc924b41faa64743923afac319/users/f64d942793a5493787c3e5c7815bc134/roles/73743e14bfe849198f3a8b549163f32b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:55:48.527681 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3907ae9-0f4f-4f8e-b2ad-042e96e11233 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:48.540799 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:48.631720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4432d8-a3c4-4cc3-8640-14f2dc802781 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:48.634455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4432d8-a3c4-4cc3-8640-14f2dc802781 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:48.665798 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:48.677834 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3907ae9-0f4f-4f8e-b2ad-042e96e11233 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:48.722196 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a1900-5a20-4eec-aa77-4e2585db8851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:48.723288 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a1900-5a20-4eec-aa77-4e2585db8851 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:48.723666 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a1900-5a20-4eec-aa77-4e2585db8851 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:48.723954 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a1900-5a20-4eec-aa77-4e2585db8851 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:48.724819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a1900-5a20-4eec-aa77-4e2585db8851 None admin] RBAC: Adding query filter params (type=network) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:48.725102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a1900-5a20-4eec-aa77-4e2585db8851 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:48.727399 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a1900-5a20-4eec-aa77-4e2585db8851 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:48.738979 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 413/824] 10.222.0.79 () {56 vars in 1112 bytes} [Thu Jul 14 11:55:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:48.739599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a1900-5a20-4eec-aa77-4e2585db8851 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:48.769394 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 412/825] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:55:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:55:48.770690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4432d8-a3c4-4cc3-8640-14f2dc802781 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:48.838304 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:48.882590 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a1900-5a20-4eec-aa77-4e2585db8851 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:48.907230 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4432d8-a3c4-4cc3-8640-14f2dc802781 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:48.933634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c23b57-6102-4905-8495-e13ac12e6d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:48.934897 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c23b57-6102-4905-8495-e13ac12e6d2f None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:48.934897 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c23b57-6102-4905-8495-e13ac12e6d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:48.935097 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c23b57-6102-4905-8495-e13ac12e6d2f None admin] PATH_INFO: `/v3/projects/66f531bc924b41faa64743923afac319/users/969ee98dfe644ef2a016860aa1585317/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:48.938083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c23b57-6102-4905-8495-e13ac12e6d2f None admin] RBAC: Authorizing `identity:create_grant(project_id=66f531bc924b41faa64743923afac319, user_id=969ee98dfe644ef2a016860aa1585317, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:48.940255 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:48.940500 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c23b57-6102-4905-8495-e13ac12e6d2f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:48.954170 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c01ae9-b040-466d-9672-697843fb238f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:48.955259 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c01ae9-b040-466d-9672-697843fb238f None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:48.955755 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c01ae9-b040-466d-9672-697843fb238f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:48.956253 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c01ae9-b040-466d-9672-697843fb238f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:48.957293 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c01ae9-b040-466d-9672-697843fb238f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:48.958928 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c01ae9-b040-466d-9672-697843fb238f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:48.966783 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 414/826] 10.222.0.79 () {58 vars in 1439 bytes} [Thu Jul 14 11:55:48 2022] PUT /identity/v3/projects/66f531bc924b41faa64743923afac319/users/969ee98dfe644ef2a016860aa1585317/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:55:48.966783 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c23b57-6102-4905-8495-e13ac12e6d2f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:48.995038 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 413/827] 10.222.0.79 () {60 vars in 1144 bytes} [Thu Jul 14 11:55:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:55:49.120473 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c23b57-6102-4905-8495-e13ac12e6d2f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:49.154163 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:49.173823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e62ac-05ad-4bb4-9e97-f128e687d246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:49.175111 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e62ac-05ad-4bb4-9e97-f128e687d246 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:49.175628 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e62ac-05ad-4bb4-9e97-f128e687d246 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:49.176123 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e62ac-05ad-4bb4-9e97-f128e687d246 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:49.190788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e62ac-05ad-4bb4-9e97-f128e687d246 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:49.192735 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e62ac-05ad-4bb4-9e97-f128e687d246 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:49.212952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-c34e62ac-05ad-4bb4-9e97-f128e687d246 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:49.212952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:49.212952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:49.212952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:49.212952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:49.212952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:49.212952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:49.212952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:49.212952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:49.212952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:49.212952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:49.212952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:49.212952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:49.212952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:49.212952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:49.214472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:49.214472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:49.214472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:49.214472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:49.214472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:49.214472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:49.214472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:49.214472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:49.214472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:49.214472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:49.214472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:49.214472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:49.214472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:49.214472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:49.214472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:49.214472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:49.214472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:49.215474 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:49.215474 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:49.215474 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:49.215474 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:49.217843 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 415/828] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:49.223303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c01ae9-b040-466d-9672-697843fb238f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:49.340461 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c01ae9-b040-466d-9672-697843fb238f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:49.379498 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83d91d-2192-4efc-bc29-fd03718670cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:49.380105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83d91d-2192-4efc-bc29-fd03718670cc None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:49.380388 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83d91d-2192-4efc-bc29-fd03718670cc None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:49.380659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83d91d-2192-4efc-bc29-fd03718670cc None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:49.381402 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83d91d-2192-4efc-bc29-fd03718670cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:49.381694 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83d91d-2192-4efc-bc29-fd03718670cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:49.383104 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83d91d-2192-4efc-bc29-fd03718670cc None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:49.397282 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 414/829] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:49.403616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e62ac-05ad-4bb4-9e97-f128e687d246 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:49.516867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e62ac-05ad-4bb4-9e97-f128e687d246 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:49.557642 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1598ee0-e5af-4617-bb0a-eeb378a5a43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:49.558813 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1598ee0-e5af-4617-bb0a-eeb378a5a43b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:49.559103 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1598ee0-e5af-4617-bb0a-eeb378a5a43b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:49.559378 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1598ee0-e5af-4617-bb0a-eeb378a5a43b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:49.569793 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1598ee0-e5af-4617-bb0a-eeb378a5a43b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:49.571683 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1598ee0-e5af-4617-bb0a-eeb378a5a43b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:49.589083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-d1598ee0-e5af-4617-bb0a-eeb378a5a43b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:49.589083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:49.589083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:49.589083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:49.589083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:49.589083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:49.589083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:49.589083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:49.589083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:49.589083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:49.589083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:49.589083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:49.589083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:55:49.589083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:55:49.589083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:55:49.590229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:55:49.590229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:49.590229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:49.590229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:49.590229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:49.590229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:49.590229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:49.590229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:49.590229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:49.590229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:49.590229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:49.590229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:49.590229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:49.590229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:49.590229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:49.590229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:49.590229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:49.591128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:55:49.591128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:55:49.591128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:55:49.591128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:55:49.591128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:55:49.591128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:55:49.591128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:49.591128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:49.591128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 416/830] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:55:49.596042 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83d91d-2192-4efc-bc29-fd03718670cc None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:49.649316 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:49.713331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83d91d-2192-4efc-bc29-fd03718670cc None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:49.759685 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b7b77-f9b5-4489-b7a3-9ae984e3cf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:49.760356 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b7b77-f9b5-4489-b7a3-9ae984e3cf7d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:49.762524 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b7b77-f9b5-4489-b7a3-9ae984e3cf7d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:49.762524 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b7b77-f9b5-4489-b7a3-9ae984e3cf7d None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:49.762524 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b7b77-f9b5-4489-b7a3-9ae984e3cf7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:49.762524 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b7b77-f9b5-4489-b7a3-9ae984e3cf7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:49.763448 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b7b77-f9b5-4489-b7a3-9ae984e3cf7d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:49.776319 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 415/831] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:55:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:49.781972 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1598ee0-e5af-4617-bb0a-eeb378a5a43b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:49.824831 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:49.889961 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1598ee0-e5af-4617-bb0a-eeb378a5a43b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:49.925573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d766b10-a3be-4123-90ec-3426cafc16a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:49.926245 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d766b10-a3be-4123-90ec-3426cafc16a6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:49.926810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d766b10-a3be-4123-90ec-3426cafc16a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:49.927092 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d766b10-a3be-4123-90ec-3426cafc16a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:49.927941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d766b10-a3be-4123-90ec-3426cafc16a6 None admin] RBAC: Adding query filter params (role.id=eff4f9bbb7064bc1a0f9fc55a05fea51, scope.project.id=66f531bc924b41faa64743923afac319, user.id=e41a4d3a822c403fad048764a0edf209) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:49.928258 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d766b10-a3be-4123-90ec-3426cafc16a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:49.929743 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d766b10-a3be-4123-90ec-3426cafc16a6 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:49.937617 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 417/832] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:55:49 2022] GET /identity/v3/role_assignments?user.id=e41a4d3a822c403fad048764a0edf209&scope.project.id=66f531bc924b41faa64743923afac319&role.id=eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:50.576116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcfa84-d512-4436-8da2-85e8edbc7dc2 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:50.576546 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcfa84-d512-4436-8da2-85e8edbc7dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:50.576719 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcfa84-d512-4436-8da2-85e8edbc7dc2 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:50.578344 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 416/833] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:50.583842 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673e5ce-c0df-49f3-8d09-c7186e7caf82 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:50.584182 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673e5ce-c0df-49f3-8d09-c7186e7caf82 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:50.584474 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673e5ce-c0df-49f3-8d09-c7186e7caf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:50.602432 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-b673e5ce-c0df-49f3-8d09-c7186e7caf82 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:50.603676 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b673e5ce-c0df-49f3-8d09-c7186e7caf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:50.677331 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 418/834] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:55:50.700440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcfa84-d512-4436-8da2-85e8edbc7dc2 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:50.816936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:50.822727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcfa84-d512-4436-8da2-85e8edbc7dc2 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:50.869590 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cf651-9f68-4d98-aad0-a1b5a9512395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:50.870306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cf651-9f68-4d98-aad0-a1b5a9512395 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:50.870612 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cf651-9f68-4d98-aad0-a1b5a9512395 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:50.870884 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cf651-9f68-4d98-aad0-a1b5a9512395 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:50.871542 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99cf651-9f68-4d98-aad0-a1b5a9512395 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:50.872916 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99cf651-9f68-4d98-aad0-a1b5a9512395 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:50.885709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-d99cf651-9f68-4d98-aad0-a1b5a9512395 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:55:50.885709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:50.885709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:55:50.885709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:55:50.885709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:55:50.885709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:55:50.885709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:55:50.885709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:55:50.885709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:55:50.885709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:50.885709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:55:50.885709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:50.885709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:50.885709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:50.885709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:50.885709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:50.885709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:50.886812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:50.886812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:50.886812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:50.886812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:50.886812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:50.886812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:50.886812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:55:50.886812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:55:50.886812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:55:50.886812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:55:50.886812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:50.886812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:50.886812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:50.886812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:50.886812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:50.886812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:50.887650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:50.887650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:50.887650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:50.887650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:50.887650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:50.887650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:50.887650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:50.887650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:50.887650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:50.887650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:50.887650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:55:50.887650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:55:50.887650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:55:50.887650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:50.887650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 417/835] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Jul 14 11:55:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:50.895090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673e5ce-c0df-49f3-8d09-c7186e7caf82 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:50.927364 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:50.928734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5544355-544c-44b8-8c38-523afaf2789f None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:50.928989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5544355-544c-44b8-8c38-523afaf2789f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:50.929229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5544355-544c-44b8-8c38-523afaf2789f None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:50.931080 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 418/836] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:55:50.937183 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91759187-0b4d-4dbf-bddb-c5bab0573f33 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:50.937468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91759187-0b4d-4dbf-bddb-c5bab0573f33 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:50.937738 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91759187-0b4d-4dbf-bddb-c5bab0573f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:50.955043 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-91759187-0b4d-4dbf-bddb-c5bab0573f33 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:50.956239 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-91759187-0b4d-4dbf-bddb-c5bab0573f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:51.007992 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673e5ce-c0df-49f3-8d09-c7186e7caf82 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:51.030607 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 419/837] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:55:51.046177 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac3809-ace7-4d8e-83cb-5f5671a0f7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:51.047250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac3809-ace7-4d8e-83cb-5f5671a0f7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:51.047810 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91759187-0b4d-4dbf-bddb-c5bab0573f33 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:51.047933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac3809-ace7-4d8e-83cb-5f5671a0f7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:51.048421 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac3809-ace7-4d8e-83cb-5f5671a0f7b5 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:51.049377 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac3809-ace7-4d8e-83cb-5f5671a0f7b5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:51.050000 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac3809-ace7-4d8e-83cb-5f5671a0f7b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:51.052089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac3809-ace7-4d8e-83cb-5f5671a0f7b5 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:51.058271 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 419/838] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Jul 14 11:55:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:51.064028 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac3809-ace7-4d8e-83cb-5f5671a0f7b5 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:51.149643 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:51.158724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91759187-0b4d-4dbf-bddb-c5bab0573f33 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:51.185274 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:51.193299 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac3809-ace7-4d8e-83cb-5f5671a0f7b5 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:51.199665 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b11516b-7af0-4946-b957-5e8d3de5fe6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:51.200699 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11516b-7af0-4946-b957-5e8d3de5fe6d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:51.201188 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11516b-7af0-4946-b957-5e8d3de5fe6d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:51.201671 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11516b-7af0-4946-b957-5e8d3de5fe6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:51.212901 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b11516b-7af0-4946-b957-5e8d3de5fe6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:51.220842 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-6b11516b-7af0-4946-b957-5e8d3de5fe6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:51.220842 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:51.220842 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:51.220842 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:51.220842 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:51.220842 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:51.220842 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:51.220842 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:51.220842 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:51.220842 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:51.220842 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:51.220842 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:51.220842 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:51.220842 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:51.220842 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:51.220842 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:51.221779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:51.221779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:51.221779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:51.221779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:51.221779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:51.221779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:51.221779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:51.221779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:51.221779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:51.221779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:51.221779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:51.221779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:51.221779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:51.221779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:51.221779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:51.221779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:51.222630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:51.222630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:51.222630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:51.222630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:51.222630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:51.222630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:51.222630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:51.222630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:51.222630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:51.222630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:51.222630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:55:51.222630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:51.229554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 420/839] 10.222.0.79 () {56 vars in 1102 bytes} [Thu Jul 14 11:55:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:55:51.229554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd53202-2fef-44dc-82bc-a3057a306415 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:51.229554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd53202-2fef-44dc-82bc-a3057a306415 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:51.229554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd53202-2fef-44dc-82bc-a3057a306415 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:51.230313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e071cc-8eb8-431a-9df9-fb5cbcf71a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:51.231047 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e071cc-8eb8-431a-9df9-fb5cbcf71a96 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:51.231338 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e071cc-8eb8-431a-9df9-fb5cbcf71a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:51.231610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e071cc-8eb8-431a-9df9-fb5cbcf71a96 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:51.231915 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 421/840] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:51.233034 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd53202-2fef-44dc-82bc-a3057a306415 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:51.236010 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e071cc-8eb8-431a-9df9-fb5cbcf71a96 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:51.236573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e071cc-8eb8-431a-9df9-fb5cbcf71a96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:51.239193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e071cc-8eb8-431a-9df9-fb5cbcf71a96 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:51.248433 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 420/841] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Jul 14 11:55:51 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:51.254556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b246a-f32f-410d-9d3f-99f42cfcf843 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:51.254556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b246a-f32f-410d-9d3f-99f42cfcf843 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:51.254556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b246a-f32f-410d-9d3f-99f42cfcf843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:51.271362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e51b246a-f32f-410d-9d3f-99f42cfcf843 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:51.272643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e51b246a-f32f-410d-9d3f-99f42cfcf843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:51.352906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 421/842] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:55:51.376187 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd53202-2fef-44dc-82bc-a3057a306415 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:51.378010 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b246a-f32f-410d-9d3f-99f42cfcf843 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:51.423147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42920c-e376-4afd-841b-7b3902634f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:51.424826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42920c-e376-4afd-841b-7b3902634f93 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:51.424826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42920c-e376-4afd-841b-7b3902634f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:51.424826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42920c-e376-4afd-841b-7b3902634f93 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:51.425071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42920c-e376-4afd-841b-7b3902634f93 None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:51.425861 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42920c-e376-4afd-841b-7b3902634f93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:51.429076 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42920c-e376-4afd-841b-7b3902634f93 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:51.439057 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 422/843] 10.222.0.79 () {56 vars in 1103 bytes} [Thu Jul 14 11:55:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:51.445182 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42920c-e376-4afd-841b-7b3902634f93 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:51.473047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:51.502424 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b246a-f32f-410d-9d3f-99f42cfcf843 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:51.526974 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:51.543687 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28047ad-0f89-4949-80da-4c4afe34fa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:51.543955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28047ad-0f89-4949-80da-4c4afe34fa89 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:51.544242 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28047ad-0f89-4949-80da-4c4afe34fa89 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:51.544514 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28047ad-0f89-4949-80da-4c4afe34fa89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:51.556373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28047ad-0f89-4949-80da-4c4afe34fa89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:51.565360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-a28047ad-0f89-4949-80da-4c4afe34fa89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:55:51.565360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:51.565360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:51.565360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:51.565360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:51.565360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:51.565360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:51.565360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:51.565360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:51.565360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:51.565360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:51.565360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:51.565360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:51.565360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:51.565360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:51.565360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:51.566536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:51.566536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:51.566536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:51.566536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:51.566536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:51.566536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:51.566536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:51.566536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:51.566536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:51.566536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:51.566536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:51.566536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:51.566536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:51.566536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:51.566536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:51.566536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:51.567491 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:51.567491 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:51.567491 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:51.567491 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:51.567491 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:51.567491 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:51.567491 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:51.567491 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:51.567491 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:51.567491 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:51.567491 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:55:51.567491 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:51.571670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 422/844] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:55:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:55:51.572673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28047ad-0f89-4949-80da-4c4afe34fa89 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:51.581926 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42920c-e376-4afd-841b-7b3902634f93 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:51.628116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890dd62-df6f-4726-8880-1bfeccece5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:51.629382 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890dd62-df6f-4726-8880-1bfeccece5ec None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:51.630145 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890dd62-df6f-4726-8880-1bfeccece5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:51.630658 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890dd62-df6f-4726-8880-1bfeccece5ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:51.645553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1890dd62-df6f-4726-8880-1bfeccece5ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:51.647502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1890dd62-df6f-4726-8880-1bfeccece5ec None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:51.671358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-1890dd62-df6f-4726-8880-1bfeccece5ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:51.671358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:51.671358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:51.671358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:51.671358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:51.671358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:51.671358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:51.671358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:51.671358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:51.671358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:51.671358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:51.671358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:51.671358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:51.671358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:51.671358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:51.672311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:51.672311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:51.672311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:51.672311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:51.672311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:51.672311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:51.672311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:51.672311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:51.672311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:51.672311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:51.672311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:51.672311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:51.672311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:51.672311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:51.672311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:51.672311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:51.672311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:51.673228 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:51.673228 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:51.673228 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:51.673228 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:51.677814 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 423/845] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:55:51.678826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890dd62-df6f-4726-8880-1bfeccece5ec None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:51.697405 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28047ad-0f89-4949-80da-4c4afe34fa89 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:51.756166 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6998cf-619c-4510-ac15-d434d63836b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:51.756390 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:51.758105 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6998cf-619c-4510-ac15-d434d63836b8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:51.758872 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6998cf-619c-4510-ac15-d434d63836b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:51.759719 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6998cf-619c-4510-ac15-d434d63836b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:51.760468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6998cf-619c-4510-ac15-d434d63836b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:51.760932 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6998cf-619c-4510-ac15-d434d63836b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:51.763669 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6998cf-619c-4510-ac15-d434d63836b8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:51.775817 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 423/846] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:55:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:55:51.784944 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6998cf-619c-4510-ac15-d434d63836b8 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:51.798012 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890dd62-df6f-4726-8880-1bfeccece5ec None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:51.799583 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:51.834309 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18c400-3012-4740-b347-bfd775ad3e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:51.835027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18c400-3012-4740-b347-bfd775ad3e45 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:51.835313 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18c400-3012-4740-b347-bfd775ad3e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:51.835590 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18c400-3012-4740-b347-bfd775ad3e45 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:51.836356 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18c400-3012-4740-b347-bfd775ad3e45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:51.836681 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18c400-3012-4740-b347-bfd775ad3e45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:51.838721 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18c400-3012-4740-b347-bfd775ad3e45 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:51.856377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 424/847] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:51.857472 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18c400-3012-4740-b347-bfd775ad3e45 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:51.904602 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6998cf-619c-4510-ac15-d434d63836b8 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:51.943008 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11732ec-0eb8-4f33-9d88-1f1d2f0dffef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:51.944217 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11732ec-0eb8-4f33-9d88-1f1d2f0dffef None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:51.944728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11732ec-0eb8-4f33-9d88-1f1d2f0dffef None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:51.945301 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11732ec-0eb8-4f33-9d88-1f1d2f0dffef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:51.958253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11732ec-0eb8-4f33-9d88-1f1d2f0dffef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:51.960264 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11732ec-0eb8-4f33-9d88-1f1d2f0dffef None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:51.962351 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18c400-3012-4740-b347-bfd775ad3e45 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:51.979505 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-c11732ec-0eb8-4f33-9d88-1f1d2f0dffef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:51.979505 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:51.979505 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:51.979505 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:51.979505 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:51.979505 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:51.979505 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:51.979505 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:51.979505 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:51.979505 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:51.979505 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:51.979505 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:51.979505 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:51.979505 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:51.979505 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:51.980458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:51.980458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:51.980458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:51.980458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:51.980458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:51.980458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:51.980458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:51.980458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:51.980458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:51.980458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:51.980458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:51.980458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:51.980458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:51.980458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:51.980458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:51.980458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:51.980458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:51.981344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:51.981344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:51.981344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:51.981344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:51.988124 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 424/848] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:55:51.989404 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11732ec-0eb8-4f33-9d88-1f1d2f0dffef None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:51.989973 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:52.000260 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e897dd-f1ef-4cf8-be67-620fecda474d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:52.001080 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e897dd-f1ef-4cf8-be67-620fecda474d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:52.001367 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e897dd-f1ef-4cf8-be67-620fecda474d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:52.001644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e897dd-f1ef-4cf8-be67-620fecda474d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:52.010562 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e897dd-f1ef-4cf8-be67-620fecda474d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:52.012068 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e897dd-f1ef-4cf8-be67-620fecda474d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:52.028303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-24e897dd-f1ef-4cf8-be67-620fecda474d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 11:55:52.028303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:52.028303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:52.028303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:52.028303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:52.028303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:52.028303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:52.028303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:52.028303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:52.028303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:52.028303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:52.028303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:52.028303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:55:52.028303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:55:52.028303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:55:52.028303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:55:52.029336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:52.029336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:52.029336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:55:52.029336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:52.029336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:55:52.029336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:52.029336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:52.029336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:52.029336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:52.029336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:52.029336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:52.029336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:52.029336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:52.029336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:52.029336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:52.029336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:52.029336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:52.029336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:52.030264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:52.030264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:52.030264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:55:52.030264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:55:52.030264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:55:52.030264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:55:52.030264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:55:52.030264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:55:52.030264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 11:55:52.030264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:52.034208 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 425/849] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Jul 14 11:55:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:52.035537 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e897dd-f1ef-4cf8-be67-620fecda474d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:52.071315 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:52.114136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11732ec-0eb8-4f33-9d88-1f1d2f0dffef None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:52.140903 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e897dd-f1ef-4cf8-be67-620fecda474d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:52.150911 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bd34b-673a-414c-9f03-e5b1aa10d000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:52.151692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bd34b-673a-414c-9f03-e5b1aa10d000 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:52.151980 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bd34b-673a-414c-9f03-e5b1aa10d000 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:52.152257 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bd34b-673a-414c-9f03-e5b1aa10d000 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:52.152972 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087bd34b-673a-414c-9f03-e5b1aa10d000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:52.153279 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087bd34b-673a-414c-9f03-e5b1aa10d000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:52.154924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087bd34b-673a-414c-9f03-e5b1aa10d000 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:52.174545 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 425/850] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:52.174545 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024c93f-f2a6-44b0-b424-622814e40dbd None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:52.174545 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024c93f-f2a6-44b0-b424-622814e40dbd None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:52.174545 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024c93f-f2a6-44b0-b424-622814e40dbd None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:52.174545 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 426/851] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:52.175086 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024c93f-f2a6-44b0-b424-622814e40dbd None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:52.181560 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266da353-0ee4-4d51-bd3b-382e4e522565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:52.182820 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266da353-0ee4-4d51-bd3b-382e4e522565 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:52.183109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266da353-0ee4-4d51-bd3b-382e4e522565 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:52.183385 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266da353-0ee4-4d51-bd3b-382e4e522565 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:52.184222 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266da353-0ee4-4d51-bd3b-382e4e522565 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:52.184533 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266da353-0ee4-4d51-bd3b-382e4e522565 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:52.185966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266da353-0ee4-4d51-bd3b-382e4e522565 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:52.204192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 426/852] 10.222.0.79 () {56 vars in 1149 bytes} [Thu Jul 14 11:55:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:52.205369 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c38321-1466-4c3f-a7c0-83bea3adcf3a None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:52.205656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c38321-1466-4c3f-a7c0-83bea3adcf3a None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:52.205932 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c38321-1466-4c3f-a7c0-83bea3adcf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:52.224327 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-12c38321-1466-4c3f-a7c0-83bea3adcf3a None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:52.226857 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-12c38321-1466-4c3f-a7c0-83bea3adcf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:52.277635 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:52.295867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024c93f-f2a6-44b0-b424-622814e40dbd None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:52.306277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 427/853] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:55:52.307786 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c38321-1466-4c3f-a7c0-83bea3adcf3a None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:52.326544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:52.341300 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374301a-1fe1-486e-9f5e-26b061a8ab52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:52.342103 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374301a-1fe1-486e-9f5e-26b061a8ab52 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:52.342387 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374301a-1fe1-486e-9f5e-26b061a8ab52 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:52.342690 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374301a-1fe1-486e-9f5e-26b061a8ab52 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:52.350683 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374301a-1fe1-486e-9f5e-26b061a8ab52 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:52.352125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374301a-1fe1-486e-9f5e-26b061a8ab52 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:52.367880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-d374301a-1fe1-486e-9f5e-26b061a8ab52 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 11:55:52.367880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:52.367880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:52.367880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:52.367880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:52.367880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:52.367880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:52.367880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:52.367880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:52.367880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:52.367880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:52.367880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:52.367880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:55:52.367880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:55:52.367880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:55:52.367880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:55:52.368850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:52.368850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:52.368850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:55:52.368850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:52.368850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:55:52.368850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:52.368850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:52.368850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:52.368850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:52.368850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:52.368850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:52.368850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:52.368850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:52.368850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:52.368850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:52.368850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:52.368850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:52.368850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:52.370324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:52.370324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:52.370324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:55:52.370324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:55:52.370324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:55:52.370324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:55:52.370324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:55:52.370324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:55:52.370324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 11:55:52.370324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:52.370324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 427/854] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:55:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:52.370949 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374301a-1fe1-486e-9f5e-26b061a8ab52 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:52.439206 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c38321-1466-4c3f-a7c0-83bea3adcf3a None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:52.477797 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a7988-1126-482b-b94d-8c0884ca42dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:52.478465 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a7988-1126-482b-b94d-8c0884ca42dd None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:52.479232 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a7988-1126-482b-b94d-8c0884ca42dd None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:52.479504 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a7988-1126-482b-b94d-8c0884ca42dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:52.488500 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374301a-1fe1-486e-9f5e-26b061a8ab52 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:52.524968 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27b7dd-f1e1-441e-abcd-ca8a28c5588e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:52.526374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27b7dd-f1e1-441e-abcd-ca8a28c5588e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:52.526694 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27b7dd-f1e1-441e-abcd-ca8a28c5588e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:52.526975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27b7dd-f1e1-441e-abcd-ca8a28c5588e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:52.527652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27b7dd-f1e1-441e-abcd-ca8a28c5588e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:52.529044 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27b7dd-f1e1-441e-abcd-ca8a28c5588e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:52.531637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:52.543828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-0e27b7dd-f1e1-441e-abcd-ca8a28c5588e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:55:52.543828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:52.543828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:55:52.543828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:55:52.543828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:55:52.543828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:55:52.543828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:55:52.543828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:55:52.543828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:55:52.543828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:52.543828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:55:52.543828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:52.543828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:52.543828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:52.543828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:52.543828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:52.545001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:52.545001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:52.545001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:52.545001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:52.545001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:52.545001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:52.545001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:52.545001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:55:52.545001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:55:52.545001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:55:52.545001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:55:52.545001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:52.545001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:52.545001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:52.545001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:52.545001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:52.547363 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:52.547363 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:52.547363 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:52.547363 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:52.547363 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:52.547363 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:52.547363 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:52.547363 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:52.547363 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:52.547363 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:52.547363 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:52.547363 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:55:52.547363 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:55:52.547363 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:55:52.547363 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:52.547363 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 428/855] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Jul 14 11:55:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:52.548200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27b7dd-f1e1-441e-abcd-ca8a28c5588e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:52.570681 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a7988-1126-482b-b94d-8c0884ca42dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:52.572204 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a7988-1126-482b-b94d-8c0884ca42dd None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:52.604357 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:52.657929 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27b7dd-f1e1-441e-abcd-ca8a28c5588e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:52.686896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 428/856] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:55:52 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:55:52.687995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a7988-1126-482b-b94d-8c0884ca42dd None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:52.697286 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac4f66-5a9e-4bfb-a6bc-44fd04964c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:52.698080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac4f66-5a9e-4bfb-a6bc-44fd04964c90 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:52.698376 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac4f66-5a9e-4bfb-a6bc-44fd04964c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:52.698689 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac4f66-5a9e-4bfb-a6bc-44fd04964c90 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:52.699534 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac4f66-5a9e-4bfb-a6bc-44fd04964c90 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:52.699850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac4f66-5a9e-4bfb-a6bc-44fd04964c90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:52.701291 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac4f66-5a9e-4bfb-a6bc-44fd04964c90 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:52.722005 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 429/857] 10.222.0.79 () {56 vars in 1135 bytes} [Thu Jul 14 11:55:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:52.722838 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac4f66-5a9e-4bfb-a6bc-44fd04964c90 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:52.783899 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:52.810015 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a7988-1126-482b-b94d-8c0884ca42dd None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:52.837305 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac4f66-5a9e-4bfb-a6bc-44fd04964c90 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:52.846547 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:52.846791 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10d917-9203-4312-b4d4-db69a68f7738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:52.847391 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10d917-9203-4312-b4d4-db69a68f7738 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:52.847675 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10d917-9203-4312-b4d4-db69a68f7738 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:52.847950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10d917-9203-4312-b4d4-db69a68f7738 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:52.848649 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10d917-9203-4312-b4d4-db69a68f7738 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:52.848960 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10d917-9203-4312-b4d4-db69a68f7738 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:52.850343 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10d917-9203-4312-b4d4-db69a68f7738 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:52.855132 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 429/858] 10.222.0.79 () {56 vars in 1126 bytes} [Thu Jul 14 11:55:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:52.855925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10d917-9203-4312-b4d4-db69a68f7738 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:52.888740 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77c528-c1df-485c-800e-f637e4d03624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:52.889883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77c528-c1df-485c-800e-f637e4d03624 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:52.890640 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77c528-c1df-485c-800e-f637e4d03624 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:52.891389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77c528-c1df-485c-800e-f637e4d03624 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:52.905143 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77c528-c1df-485c-800e-f637e4d03624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:52.907429 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77c528-c1df-485c-800e-f637e4d03624 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:52.931555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-0b77c528-c1df-485c-800e-f637e4d03624 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:52.931555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:52.931555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:52.931555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:52.931555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:52.931555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:52.931555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:52.931555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:52.931555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:52.931555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:52.931555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:52.931555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:52.931555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:52.931555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:52.931555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:52.932530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:52.932530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:52.932530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:52.932530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:52.932530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:52.932530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:52.932530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:52.932530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:52.932530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:52.932530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:52.932530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:52.932530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:52.932530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:52.932530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:52.932530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:52.932530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:52.932530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:52.938597 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:52.938597 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:52.938597 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:52.938597 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:52.938597 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 430/859] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:52.938597 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77c528-c1df-485c-800e-f637e4d03624 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:52.961634 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10d917-9203-4312-b4d4-db69a68f7738 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:52.997579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbacac2-3714-4de9-aa83-42572c808bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:52.998142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbacac2-3714-4de9-aa83-42572c808bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:52.998425 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbacac2-3714-4de9-aa83-42572c808bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:52.998732 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbacac2-3714-4de9-aa83-42572c808bc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:53.011489 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:53.056508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77c528-c1df-485c-800e-f637e4d03624 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:53.073359 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbacac2-3714-4de9-aa83-42572c808bc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:53.074847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbacac2-3714-4de9-aa83-42572c808bc7 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:53.101077 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a4c8e-7586-4787-b2a2-651deac4ac50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:53.101784 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a4c8e-7586-4787-b2a2-651deac4ac50 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:53.102068 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a4c8e-7586-4787-b2a2-651deac4ac50 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:53.102345 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a4c8e-7586-4787-b2a2-651deac4ac50 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:53.103082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a4c8e-7586-4787-b2a2-651deac4ac50 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:53.103701 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a4c8e-7586-4787-b2a2-651deac4ac50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:53.104893 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a4c8e-7586-4787-b2a2-651deac4ac50 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:53.109880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 431/860] 10.222.0.79 () {56 vars in 1126 bytes} [Thu Jul 14 11:55:52 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:53.110558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a4c8e-7586-4787-b2a2-651deac4ac50 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:53.141448 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:53.219328 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 430/861] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:55:52 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:55:53.229303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbacac2-3714-4de9-aa83-42572c808bc7 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:53.253322 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a4c8e-7586-4787-b2a2-651deac4ac50 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:53.287275 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:53.297222 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce17660-b69b-4e2d-99ff-fd7505a1a4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:53.297904 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce17660-b69b-4e2d-99ff-fd7505a1a4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:53.298191 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce17660-b69b-4e2d-99ff-fd7505a1a4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:53.298462 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce17660-b69b-4e2d-99ff-fd7505a1a4d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:53.299778 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce17660-b69b-4e2d-99ff-fd7505a1a4d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:53.299778 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce17660-b69b-4e2d-99ff-fd7505a1a4d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:53.301006 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce17660-b69b-4e2d-99ff-fd7505a1a4d2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:53.315297 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 432/862] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:53.320756 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce17660-b69b-4e2d-99ff-fd7505a1a4d2 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:53.364827 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbacac2-3714-4de9-aa83-42572c808bc7 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:53.416573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:53.416773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45402d7-5ae1-4482-80a2-3ccf845a66e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:53.418250 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45402d7-5ae1-4482-80a2-3ccf845a66e4 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:53.418707 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45402d7-5ae1-4482-80a2-3ccf845a66e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:53.419216 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45402d7-5ae1-4482-80a2-3ccf845a66e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:53.437530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce17660-b69b-4e2d-99ff-fd7505a1a4d2 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:53.438206 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45402d7-5ae1-4482-80a2-3ccf845a66e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:53.440998 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45402d7-5ae1-4482-80a2-3ccf845a66e4 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:53.473654 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66780e-7d6a-48c0-92f4-c3f38bff3c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:53.474118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-e45402d7-5ae1-4482-80a2-3ccf845a66e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:53.474118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:53.474118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:53.474118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:53.474118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:53.474118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:53.474118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:53.474118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:53.474118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:53.474118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:53.474118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:53.474118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:53.474118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:53.474118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:53.474118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:53.475109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:53.475109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:53.475109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:53.475109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:53.475109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:53.475109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:53.475109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:53.475109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:53.475109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:53.475109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:53.475109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:53.475109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:53.475109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:53.475109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:53.475109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:53.475109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:53.475109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:53.476154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:53.476154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:53.476154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:53.476154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:53.476830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 431/863] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:53.477285 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66780e-7d6a-48c0-92f4-c3f38bff3c01 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:53.477704 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66780e-7d6a-48c0-92f4-c3f38bff3c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:53.478101 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66780e-7d6a-48c0-92f4-c3f38bff3c01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:53.479157 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac3311-495e-4428-9259-2a1e4c708b8e None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:53.479669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac3311-495e-4428-9259-2a1e4c708b8e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:53.480175 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac3311-495e-4428-9259-2a1e4c708b8e None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:53.482798 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 432/864] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:53.484142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac3311-495e-4428-9259-2a1e4c708b8e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:53.491916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66780e-7d6a-48c0-92f4-c3f38bff3c01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:53.493418 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66780e-7d6a-48c0-92f4-c3f38bff3c01 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:53.508572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-5f66780e-7d6a-48c0-92f4-c3f38bff3c01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:53.508572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:53.508572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:53.508572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:53.508572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:53.508572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:53.508572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:53.508572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:53.508572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:53.508572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:53.508572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:53.508572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:53.508572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:55:53.508572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:55:53.508572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:55:53.509723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:55:53.509723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:53.509723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:53.509723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:53.509723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:53.509723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:53.509723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:53.509723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:53.509723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:53.509723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:53.509723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:53.509723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:53.509723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:53.509723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:53.509723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:53.509723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:53.509723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:53.511330 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:55:53.511330 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:55:53.511330 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:55:53.511330 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:55:53.511330 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:55:53.511330 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:55:53.511330 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:53.511330 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:53.511330 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 433/865] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:55:53.513987 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce30b8-7c03-4928-8586-8a2d2cb913e5 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:53.514558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce30b8-7c03-4928-8586-8a2d2cb913e5 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:53.515014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce30b8-7c03-4928-8586-8a2d2cb913e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:53.533012 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-b2ce30b8-7c03-4928-8586-8a2d2cb913e5 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:53.534220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b2ce30b8-7c03-4928-8586-8a2d2cb913e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:53.606644 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 434/866] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:55:53.607786 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce30b8-7c03-4928-8586-8a2d2cb913e5 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:53.613646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:53.630083 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac3311-495e-4428-9259-2a1e4c708b8e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:53.668815 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be705de0-5b62-4181-8eca-13d52eae9b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:53.669487 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be705de0-5b62-4181-8eca-13d52eae9b7c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:53.669772 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be705de0-5b62-4181-8eca-13d52eae9b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:53.670049 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be705de0-5b62-4181-8eca-13d52eae9b7c None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:53.670823 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be705de0-5b62-4181-8eca-13d52eae9b7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:53.671137 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be705de0-5b62-4181-8eca-13d52eae9b7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:53.672521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be705de0-5b62-4181-8eca-13d52eae9b7c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:53.685411 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 433/867] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:53.686447 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be705de0-5b62-4181-8eca-13d52eae9b7c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:53.702295 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:53.743720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce30b8-7c03-4928-8586-8a2d2cb913e5 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:53.800283 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be705de0-5b62-4181-8eca-13d52eae9b7c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:53.813013 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1e875-7c68-4c6a-816f-09add4a85d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:53.814112 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1e875-7c68-4c6a-816f-09add4a85d08 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:53.814643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1e875-7c68-4c6a-816f-09add4a85d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:53.815135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1e875-7c68-4c6a-816f-09add4a85d08 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:53.816473 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1e875-7c68-4c6a-816f-09add4a85d08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:53.817030 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1e875-7c68-4c6a-816f-09add4a85d08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:53.819490 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1e875-7c68-4c6a-816f-09add4a85d08 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:53.838773 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 435/868] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:55:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:53.839910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1e875-7c68-4c6a-816f-09add4a85d08 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:53.840171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5d406-bb47-465d-93d4-a77c8d826244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:53.840849 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5d406-bb47-465d-93d4-a77c8d826244 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:53.841148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5d406-bb47-465d-93d4-a77c8d826244 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:53.841419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5d406-bb47-465d-93d4-a77c8d826244 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:53.842150 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5d406-bb47-465d-93d4-a77c8d826244 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:53.843808 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5d406-bb47-465d-93d4-a77c8d826244 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:53.860912 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 434/869] 10.222.0.79 () {60 vars in 1141 bytes} [Thu Jul 14 11:55:53 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:55:53.861746 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5d406-bb47-465d-93d4-a77c8d826244 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:53.891086 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:54.003060 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1e875-7c68-4c6a-816f-09add4a85d08 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:54.011477 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5d406-bb47-465d-93d4-a77c8d826244 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:54.050125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:54.055627 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7a7ad-26a2-4366-bbb4-c752e6190ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:54.057108 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7a7ad-26a2-4366-bbb4-c752e6190ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:54.057394 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7a7ad-26a2-4366-bbb4-c752e6190ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:54.057671 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7a7ad-26a2-4366-bbb4-c752e6190ed6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:54.058031 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63dba2e-4ff8-425d-92c6-d20ee57f9dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:54.058537 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7a7ad-26a2-4366-bbb4-c752e6190ed6 None admin] RBAC: Adding query filter params (role.id=73743e14bfe849198f3a8b549163f32b, scope.project.id=66f531bc924b41faa64743923afac319, user.id=f64d942793a5493787c3e5c7815bc134) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:54.058857 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7a7ad-26a2-4366-bbb4-c752e6190ed6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:54.058969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dba2e-4ff8-425d-92c6-d20ee57f9dcc None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:54.059155 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dba2e-4ff8-425d-92c6-d20ee57f9dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:54.059439 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dba2e-4ff8-425d-92c6-d20ee57f9dcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:54.060306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7a7ad-26a2-4366-bbb4-c752e6190ed6 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:54.067083 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 435/870] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:55:53 2022] GET /identity/v3/role_assignments?user.id=f64d942793a5493787c3e5c7815bc134&scope.project.id=66f531bc924b41faa64743923afac319&role.id=73743e14bfe849198f3a8b549163f32b => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:54.067834 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63dba2e-4ff8-425d-92c6-d20ee57f9dcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:54.069270 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63dba2e-4ff8-425d-92c6-d20ee57f9dcc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:54.086311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-b63dba2e-4ff8-425d-92c6-d20ee57f9dcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:54.086311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:54.086311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:54.086311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:54.086311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:54.086311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:54.086311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:54.086311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:54.086311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:54.086311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:54.086311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:54.086311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:54.086311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:55:54.086311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:55:54.086311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:55:54.087313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:55:54.087313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:54.087313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:54.087313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:54.087313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:54.087313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:54.087313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:54.087313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:54.087313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:54.087313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:54.087313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:54.087313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:54.087313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:54.087313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:54.087313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:54.087313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:54.087313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:54.088866 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:55:54.088866 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:55:54.088866 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:55:54.088866 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:55:54.088866 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:55:54.088866 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:55:54.088866 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:54.088866 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:54.089885 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 436/871] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:54.095353 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7a7ad-26a2-4366-bbb4-c752e6190ed6 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:54.176189 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:54.212176 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7a7ad-26a2-4366-bbb4-c752e6190ed6 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:54.252703 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502980b-0562-4fea-9e3a-f1f2dc74c803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:54.253386 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502980b-0562-4fea-9e3a-f1f2dc74c803 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:54.253673 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502980b-0562-4fea-9e3a-f1f2dc74c803 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:54.253949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502980b-0562-4fea-9e3a-f1f2dc74c803 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:54.254797 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502980b-0562-4fea-9e3a-f1f2dc74c803 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:54.255115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502980b-0562-4fea-9e3a-f1f2dc74c803 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:54.256576 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502980b-0562-4fea-9e3a-f1f2dc74c803 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:54.270987 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 436/872] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:55:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:54.276761 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63dba2e-4ff8-425d-92c6-d20ee57f9dcc None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:54.406054 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63dba2e-4ff8-425d-92c6-d20ee57f9dcc None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:54.444355 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feccefc-65cd-468a-999d-e41415e81aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:54.445034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feccefc-65cd-468a-999d-e41415e81aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:54.445320 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feccefc-65cd-468a-999d-e41415e81aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:54.445601 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feccefc-65cd-468a-999d-e41415e81aa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:54.446443 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feccefc-65cd-468a-999d-e41415e81aa6 None admin] RBAC: Adding query filter params (role.id=eff4f9bbb7064bc1a0f9fc55a05fea51, scope.project.id=66f531bc924b41faa64743923afac319, user.id=969ee98dfe644ef2a016860aa1585317) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:54.446790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feccefc-65cd-468a-999d-e41415e81aa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:54.448825 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feccefc-65cd-468a-999d-e41415e81aa6 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:54.455753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 437/873] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:55:54 2022] GET /identity/v3/role_assignments?user.id=969ee98dfe644ef2a016860aa1585317&scope.project.id=66f531bc924b41faa64743923afac319&role.id=eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:55.236479 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c378d-f574-4a2d-9922-f28d3e475301 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:55.237303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c378d-f574-4a2d-9922-f28d3e475301 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:55.237303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c378d-f574-4a2d-9922-f28d3e475301 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:55.238727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 437/874] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:55.244612 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517434d6-a352-4f66-840a-bcb0dcdadfe0 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:55.245146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517434d6-a352-4f66-840a-bcb0dcdadfe0 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:55.245146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517434d6-a352-4f66-840a-bcb0dcdadfe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:55.262928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-517434d6-a352-4f66-840a-bcb0dcdadfe0 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:55.264147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-517434d6-a352-4f66-840a-bcb0dcdadfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:55.318477 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:55.339834 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 438/875] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:55 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:55:55.363110 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c378d-f574-4a2d-9922-f28d3e475301 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:55.480464 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c378d-f574-4a2d-9922-f28d3e475301 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:55.512958 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:55.518514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004e5a3-e8a6-472d-8b4f-fa3b2a98d90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:55.519205 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004e5a3-e8a6-472d-8b4f-fa3b2a98d90a None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:55.519491 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004e5a3-e8a6-472d-8b4f-fa3b2a98d90a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:55.519855 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004e5a3-e8a6-472d-8b4f-fa3b2a98d90a None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:55.521071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004e5a3-e8a6-472d-8b4f-fa3b2a98d90a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:55.523619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004e5a3-e8a6-472d-8b4f-fa3b2a98d90a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:55.547503 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 438/876] 10.222.0.79 () {60 vars in 1141 bytes} [Thu Jul 14 11:55:55 2022] POST /identity/v3/services => generated 269 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:55:56.092037 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f851f3f-4ea8-4126-a1d0-50ab03ae947f None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:56.092325 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f851f3f-4ea8-4126-a1d0-50ab03ae947f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:56.092765 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f851f3f-4ea8-4126-a1d0-50ab03ae947f None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:56.094567 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 439/877] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:56.100427 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511154ba-a4d7-4dd3-aeae-c9d690be5bec None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:56.101059 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511154ba-a4d7-4dd3-aeae-c9d690be5bec None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:56.101559 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511154ba-a4d7-4dd3-aeae-c9d690be5bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:56.120184 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-511154ba-a4d7-4dd3-aeae-c9d690be5bec None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:56.121883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-511154ba-a4d7-4dd3-aeae-c9d690be5bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:56.199269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 439/878] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:55:56.222392 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f851f3f-4ea8-4126-a1d0-50ab03ae947f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:56.332436 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f851f3f-4ea8-4126-a1d0-50ab03ae947f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:56.339047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd354578-a449-4a47-9d28-918d712090c7 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:56.340407 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd354578-a449-4a47-9d28-918d712090c7 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:56.340898 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd354578-a449-4a47-9d28-918d712090c7 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:56.346809 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 440/879] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:56.349072 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7efe97-47a8-4382-b162-5a292289c401 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:56.349579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7efe97-47a8-4382-b162-5a292289c401 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:56.350088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7efe97-47a8-4382-b162-5a292289c401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:56.367870 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-5b7efe97-47a8-4382-b162-5a292289c401 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:56.370175 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5b7efe97-47a8-4382-b162-5a292289c401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:56.371475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2b07e-a247-44a6-8cb4-18f0d71bc99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:56.372287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2b07e-a247-44a6-8cb4-18f0d71bc99c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:56.372572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2b07e-a247-44a6-8cb4-18f0d71bc99c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:56.372852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2b07e-a247-44a6-8cb4-18f0d71bc99c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:56.373543 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2b07e-a247-44a6-8cb4-18f0d71bc99c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:56.376256 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2b07e-a247-44a6-8cb4-18f0d71bc99c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:56.395041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-51c2b07e-a247-44a6-8cb4-18f0d71bc99c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:55:56.395041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:56.395041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:55:56.395041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:55:56.395041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:55:56.395041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:55:56.395041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:55:56.395041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:55:56.395041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:55:56.395041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:56.395041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:55:56.395041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:56.395041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:56.395041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:56.395041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:56.395041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:56.395041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:56.396078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:56.396078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:56.396078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:56.396078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:56.396078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:56.396078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:56.396078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:55:56.396078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:55:56.396078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:55:56.396078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:55:56.396078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:56.396078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:56.396078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:56.396078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:56.396078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:56.396078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:56.396883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:56.396883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:56.396883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:56.396883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:56.396883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:56.396883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:56.396883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:56.396883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:56.396883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:56.396883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:56.396883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:55:56.396883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:55:56.396883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:55:56.396883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:56.397656 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 440/880] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Jul 14 11:55:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:56.406160 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2b07e-a247-44a6-8cb4-18f0d71bc99c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:56.463279 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:56.475908 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 441/881] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:55:56.499777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7efe97-47a8-4382-b162-5a292289c401 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:56.528435 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2b07e-a247-44a6-8cb4-18f0d71bc99c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:56.553157 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:56.569969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5074f6-ed9f-4c65-a4d0-f215585a73b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:56.570681 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5074f6-ed9f-4c65-a4d0-f215585a73b5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:56.570966 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5074f6-ed9f-4c65-a4d0-f215585a73b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:56.571237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5074f6-ed9f-4c65-a4d0-f215585a73b5 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:56.572461 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5074f6-ed9f-4c65-a4d0-f215585a73b5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:56.572759 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5074f6-ed9f-4c65-a4d0-f215585a73b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:56.574127 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5074f6-ed9f-4c65-a4d0-f215585a73b5 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:56.579437 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 441/882] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Jul 14 11:55:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:56.582533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b0d92-7070-417e-9e0a-4986d248cf91 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:56.582533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b0d92-7070-417e-9e0a-4986d248cf91 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:56.582533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b0d92-7070-417e-9e0a-4986d248cf91 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:56.582817 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 442/883] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:56.589853 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797d3dc-ff86-49f2-a1dc-d489b054d94b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:56.590143 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797d3dc-ff86-49f2-a1dc-d489b054d94b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:56.590419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797d3dc-ff86-49f2-a1dc-d489b054d94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:56.607552 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a797d3dc-ff86-49f2-a1dc-d489b054d94b None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:56.608651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a797d3dc-ff86-49f2-a1dc-d489b054d94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:56.617500 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7efe97-47a8-4382-b162-5a292289c401 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:56.661441 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4514180-5219-47ca-8c05-23eaad2b9287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:56.662323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4514180-5219-47ca-8c05-23eaad2b9287 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:56.662760 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4514180-5219-47ca-8c05-23eaad2b9287 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:56.663044 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4514180-5219-47ca-8c05-23eaad2b9287 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:56.675401 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4514180-5219-47ca-8c05-23eaad2b9287 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:55:56.684343 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 443/884] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:55:56.684686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-b4514180-5219-47ca-8c05-23eaad2b9287 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 11:55:56.684686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:56.684686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:56.684686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:56.684686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:56.684686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:56.684686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:56.684686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:56.684686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:56.684686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:56.684686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:56.684686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:56.684686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:55:56.684686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:55:56.684686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:55:56.684686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:55:56.685623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:55:56.685623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:55:56.685623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:55:56.685623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:55:56.685623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:56.685623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:56.685623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:56.685623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:56.685623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:56.685623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:56.685623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:56.685623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:56.685623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:56.685623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:56.685623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:56.685623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:56.686482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:56.686482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:56.686482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:56.686482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:56.686482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:55:56.686482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:55:56.686482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:55:56.686482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:55:56.686482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:55:56.686482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:55:56.686482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 11:55:56.686482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:56.690922 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 442/885] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Jul 14 11:55:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:56.691214 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797d3dc-ff86-49f2-a1dc-d489b054d94b None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:56.691838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4514180-5219-47ca-8c05-23eaad2b9287 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:56.752326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:56.815291 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797d3dc-ff86-49f2-a1dc-d489b054d94b None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:56.821844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4514180-5219-47ca-8c05-23eaad2b9287 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:56.833365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:56.860701 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f1578-cd32-4459-9c7d-a0e19b525a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:56.861912 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f1578-cd32-4459-9c7d-a0e19b525a06 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:56.862652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f1578-cd32-4459-9c7d-a0e19b525a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:56.863099 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f1578-cd32-4459-9c7d-a0e19b525a06 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:56.863961 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f1578-cd32-4459-9c7d-a0e19b525a06 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:56.864552 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f1578-cd32-4459-9c7d-a0e19b525a06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:56.866568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f1578-cd32-4459-9c7d-a0e19b525a06 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:56.872615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 444/886] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Jul 14 11:55:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:56.873254 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1b54d-b7cd-4c56-8e84-868f2808ca6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:56.873758 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f1578-cd32-4459-9c7d-a0e19b525a06 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:56.874355 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1b54d-b7cd-4c56-8e84-868f2808ca6a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:56.874900 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1b54d-b7cd-4c56-8e84-868f2808ca6a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:56.875348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1b54d-b7cd-4c56-8e84-868f2808ca6a None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:56.876550 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1b54d-b7cd-4c56-8e84-868f2808ca6a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:56.877055 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1b54d-b7cd-4c56-8e84-868f2808ca6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:56.879511 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1b54d-b7cd-4c56-8e84-868f2808ca6a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:56.889508 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 443/887] 10.222.0.79 () {56 vars in 1115 bytes} [Thu Jul 14 11:55:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:56.890356 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1b54d-b7cd-4c56-8e84-868f2808ca6a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:56.996785 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f1578-cd32-4459-9c7d-a0e19b525a06 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:57.011818 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:57.017733 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1b54d-b7cd-4c56-8e84-868f2808ca6a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:57.051619 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e86297-a548-457d-b36c-354771421aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:57.052894 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e86297-a548-457d-b36c-354771421aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:57.053350 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e86297-a548-457d-b36c-354771421aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:57.053938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e86297-a548-457d-b36c-354771421aa1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:57.055123 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e86297-a548-457d-b36c-354771421aa1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:57.057525 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e86297-a548-457d-b36c-354771421aa1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:57.068527 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18d8e8-c962-4894-8a05-33e80bb062aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:57.069185 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18d8e8-c962-4894-8a05-33e80bb062aa None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:57.069491 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18d8e8-c962-4894-8a05-33e80bb062aa None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:57.069840 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18d8e8-c962-4894-8a05-33e80bb062aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:57.070663 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18d8e8-c962-4894-8a05-33e80bb062aa None admin] RBAC: Adding query filter params (interface=public, service_id=ac421ed8c72344d193dfb2606c0663d6, region_id=RegionOne) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:57.070982 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18d8e8-c962-4894-8a05-33e80bb062aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:57.072388 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18d8e8-c962-4894-8a05-33e80bb062aa None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:57.073040 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-94e86297-a548-457d-b36c-354771421aa1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:55:57.073040 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:57.073040 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:55:57.073040 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:55:57.073040 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:55:57.073040 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:55:57.073040 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:55:57.073040 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:55:57.073040 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:55:57.073040 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:57.073040 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:55:57.073040 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:57.073040 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:57.073040 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:57.073040 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:57.073040 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:57.073040 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:57.074145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:57.074145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:57.074145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:57.074145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:57.074145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:57.074145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:57.074145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:55:57.074145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:55:57.074145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:55:57.074145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:55:57.074145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:57.074145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:57.074145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:57.074145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:57.074145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:57.074145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:57.075015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:57.075015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:57.075015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:57.075015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:57.075015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:57.075015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:57.075015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:57.075015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:57.075015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:57.075015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:57.075015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:55:57.075015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:55:57.075015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:55:57.075015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:57.075015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 445/888] 10.222.0.79 () {56 vars in 1126 bytes} [Thu Jul 14 11:55:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:57.075826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e86297-a548-457d-b36c-354771421aa1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:57.082654 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 444/889] 10.222.0.79 () {56 vars in 1251 bytes} [Thu Jul 14 11:55:56 2022] GET /identity/v3/endpoints?service_id=ac421ed8c72344d193dfb2606c0663d6&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:57.083910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18d8e8-c962-4894-8a05-33e80bb062aa None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:57.125435 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:57.186598 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e86297-a548-457d-b36c-354771421aa1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:57.198922 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18d8e8-c962-4894-8a05-33e80bb062aa None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:57.224638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cf75b-8c99-441d-98ed-af69881a0a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:57.225496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cf75b-8c99-441d-98ed-af69881a0a2a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:57.225891 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cf75b-8c99-441d-98ed-af69881a0a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:57.226180 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cf75b-8c99-441d-98ed-af69881a0a2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:57.236323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831211b-88af-49be-856b-ee3ce8424548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:57.237009 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831211b-88af-49be-856b-ee3ce8424548 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:57.237303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831211b-88af-49be-856b-ee3ce8424548 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:57.237605 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831211b-88af-49be-856b-ee3ce8424548 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:57.238315 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831211b-88af-49be-856b-ee3ce8424548 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:57.238416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748cf75b-8c99-441d-98ed-af69881a0a2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:57.238660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831211b-88af-49be-856b-ee3ce8424548 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:57.239819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748cf75b-8c99-441d-98ed-af69881a0a2a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:57.240046 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831211b-88af-49be-856b-ee3ce8424548 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:57.250412 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 445/890] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Jul 14 11:55:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:57.250412 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831211b-88af-49be-856b-ee3ce8424548 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:57.263043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-748cf75b-8c99-441d-98ed-af69881a0a2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:57.263043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:57.263043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:57.263043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:57.263043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:57.263043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:57.263043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:57.263043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:57.263043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:57.263043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:57.263043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:57.263043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:57.263043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:57.263043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:57.263043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:57.264938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:57.264938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:57.264938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:57.264938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:57.264938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:57.264938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:57.264938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:57.264938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:57.264938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:57.264938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:57.264938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:57.264938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:57.264938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:57.264938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:57.264938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:57.264938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:57.264938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:57.266680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:57.266680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:57.266680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:57.266680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:57.266680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 446/891] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:57.266680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cf75b-8c99-441d-98ed-af69881a0a2a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:57.297511 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:57.366899 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:57.371607 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831211b-88af-49be-856b-ee3ce8424548 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:57.392251 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cf75b-8c99-441d-98ed-af69881a0a2a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:57.411519 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2395c1-5551-4fc5-9561-6189fe8a8f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:57.412418 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2395c1-5551-4fc5-9561-6189fe8a8f8c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:57.412852 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2395c1-5551-4fc5-9561-6189fe8a8f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:57.413303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2395c1-5551-4fc5-9561-6189fe8a8f8c None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:57.414115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2395c1-5551-4fc5-9561-6189fe8a8f8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:57.415732 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2395c1-5551-4fc5-9561-6189fe8a8f8c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:57.422230 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 446/892] 10.222.0.79 () {56 vars in 1087 bytes} [Thu Jul 14 11:55:57 2022] GET /identity/v3/services => generated 1268 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:55:57.423258 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2395c1-5551-4fc5-9561-6189fe8a8f8c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:57.428879 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e3a9e-1eb4-42f2-8f74-0dd865480dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:57.429676 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e3a9e-1eb4-42f2-8f74-0dd865480dae None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:57.430030 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e3a9e-1eb4-42f2-8f74-0dd865480dae None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:57.430377 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e3a9e-1eb4-42f2-8f74-0dd865480dae None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:57.431293 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e3a9e-1eb4-42f2-8f74-0dd865480dae None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:57.431669 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e3a9e-1eb4-42f2-8f74-0dd865480dae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:57.433611 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e3a9e-1eb4-42f2-8f74-0dd865480dae None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:57.450536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 447/893] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Jul 14 11:55:57 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:57.570676 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2395c1-5551-4fc5-9561-6189fe8a8f8c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:57.615305 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897899c-8afc-4099-81c4-6525a15001d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:57.615980 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897899c-8afc-4099-81c4-6525a15001d0 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:57.616268 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897899c-8afc-4099-81c4-6525a15001d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:57.616545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897899c-8afc-4099-81c4-6525a15001d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:57.617268 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897899c-8afc-4099-81c4-6525a15001d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:57.617575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897899c-8afc-4099-81c4-6525a15001d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:57.619023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897899c-8afc-4099-81c4-6525a15001d0 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:57.632794 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 447/894] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:57.638805 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e3a9e-1eb4-42f2-8f74-0dd865480dae None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:57.701233 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120dea6-df8b-44dd-97a7-65a809734bb8 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:57.701586 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120dea6-df8b-44dd-97a7-65a809734bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:57.701792 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120dea6-df8b-44dd-97a7-65a809734bb8 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:57.703481 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 448/895] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:55:57.711341 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5c306-f71b-45c6-98eb-f2b495819803 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:57.711755 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5c306-f71b-45c6-98eb-f2b495819803 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:57.712135 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5c306-f71b-45c6-98eb-f2b495819803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:57.730282 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-06c5c306-f71b-45c6-98eb-f2b495819803 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:57.731664 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-06c5c306-f71b-45c6-98eb-f2b495819803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:57.750543 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:57.753556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:57.769319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e3a9e-1eb4-42f2-8f74-0dd865480dae None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:57.811388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbf84a-4d3a-43b8-8b29-9156b46fb221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:57.813304 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbf84a-4d3a-43b8-8b29-9156b46fb221 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:57.814126 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbf84a-4d3a-43b8-8b29-9156b46fb221 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:57.814623 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbf84a-4d3a-43b8-8b29-9156b46fb221 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:57.826534 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 449/896] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:55:57.832355 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bbf84a-4d3a-43b8-8b29-9156b46fb221 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:57.834040 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bbf84a-4d3a-43b8-8b29-9156b46fb221 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:57.843782 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5c306-f71b-45c6-98eb-f2b495819803 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:57.855823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-b0bbf84a-4d3a-43b8-8b29-9156b46fb221 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 11:55:57.855823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:57.855823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:57.855823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:57.855823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:57.855823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:57.855823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:57.855823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:57.855823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:57.855823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:57.855823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:57.855823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:57.855823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:55:57.855823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:55:57.855823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:55:57.855823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:55:57.856821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:57.856821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:57.856821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:55:57.856821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:57.856821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:55:57.856821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:55:57.856821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:57.856821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:57.856821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:57.856821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:57.856821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:57.856821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:57.856821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:57.856821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:57.856821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:57.856821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:57.856821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:57.856821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:57.857741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:57.857741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:57.857741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:55:57.857741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:55:57.857741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:55:57.857741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:55:57.857741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:55:57.857741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:55:57.857741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 11:55:57.857741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:57.861979 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 448/897] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Jul 14 11:55:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:57.863374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbf84a-4d3a-43b8-8b29-9156b46fb221 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:57.973715 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbf84a-4d3a-43b8-8b29-9156b46fb221 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:57.980653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5c306-f71b-45c6-98eb-f2b495819803 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:58.011480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2f8f6-13bc-436e-8ca9-fa4a1a7f913e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:58.012211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2f8f6-13bc-436e-8ca9-fa4a1a7f913e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:58.012499 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2f8f6-13bc-436e-8ca9-fa4a1a7f913e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:58.012780 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2f8f6-13bc-436e-8ca9-fa4a1a7f913e None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:58.013735 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2f8f6-13bc-436e-8ca9-fa4a1a7f913e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:58.014001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2f8f6-13bc-436e-8ca9-fa4a1a7f913e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:58.015543 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2f8f6-13bc-436e-8ca9-fa4a1a7f913e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:58.028198 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9b79a-59bb-4f57-8c64-42e09b856a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:58.029357 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9b79a-59bb-4f57-8c64-42e09b856a93 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:58.029839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9b79a-59bb-4f57-8c64-42e09b856a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:58.030309 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9b79a-59bb-4f57-8c64-42e09b856a93 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:58.031203 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9b79a-59bb-4f57-8c64-42e09b856a93 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:58.033667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9b79a-59bb-4f57-8c64-42e09b856a93 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:58.039355 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 449/898] 10.222.0.79 () {56 vars in 1149 bytes} [Thu Jul 14 11:55:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:58.041570 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2f8f6-13bc-436e-8ca9-fa4a1a7f913e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:58.050286 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:58.053552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-dca9b79a-59bb-4f57-8c64-42e09b856a93 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:55:58.053552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:58.053552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:55:58.053552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:55:58.053552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:55:58.053552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:55:58.053552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:55:58.053552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:55:58.053552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:55:58.053552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:58.053552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:55:58.053552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:58.053552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:58.053552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:58.053552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:58.053552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:58.054767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:58.054767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:58.054767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:58.054767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:58.054767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:58.054767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:58.054767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:58.054767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:55:58.054767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:55:58.054767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:55:58.054767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:55:58.054767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:58.054767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:58.054767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:58.054767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:58.054767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:58.055874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:58.055874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:58.055874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:58.055874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:58.055874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:58.055874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:58.055874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:58.055874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:58.055874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:58.055874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:58.055874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:58.055874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:55:58.055874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:55:58.055874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:55:58.055874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:58.064470 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 450/899] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Jul 14 11:55:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:55:58.065227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9b79a-59bb-4f57-8c64-42e09b856a93 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:58.086843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:58.170765 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2f8f6-13bc-436e-8ca9-fa4a1a7f913e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:58.193805 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9b79a-59bb-4f57-8c64-42e09b856a93 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:58.211734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e5287-1331-442a-9f51-f9ac535652bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:58.213671 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e5287-1331-442a-9f51-f9ac535652bd None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:58.214166 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e5287-1331-442a-9f51-f9ac535652bd None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:58.214912 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e5287-1331-442a-9f51-f9ac535652bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:58.234422 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5598f-9f5c-48b9-821c-8b7118feada4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:58.235066 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5598f-9f5c-48b9-821c-8b7118feada4 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:58.235352 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5598f-9f5c-48b9-821c-8b7118feada4 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:58.235628 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5598f-9f5c-48b9-821c-8b7118feada4 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:58.236339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5598f-9f5c-48b9-821c-8b7118feada4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:58.236790 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5598f-9f5c-48b9-821c-8b7118feada4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:58.238262 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5598f-9f5c-48b9-821c-8b7118feada4 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:58.248225 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 451/900] 10.222.0.79 () {56 vars in 1126 bytes} [Thu Jul 14 11:55:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:55:58.249630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5598f-9f5c-48b9-821c-8b7118feada4 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:58.302672 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e5287-1331-442a-9f51-f9ac535652bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:58.305480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e5287-1331-442a-9f51-f9ac535652bd None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:58.316473 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:58.352556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:58.376162 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5598f-9f5c-48b9-821c-8b7118feada4 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:58.415803 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10f97d-c163-4665-ba3b-f8b1fb04a613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:58.416911 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10f97d-c163-4665-ba3b-f8b1fb04a613 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:58.417028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10f97d-c163-4665-ba3b-f8b1fb04a613 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:58.417289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10f97d-c163-4665-ba3b-f8b1fb04a613 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:58.418003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10f97d-c163-4665-ba3b-f8b1fb04a613 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:58.418394 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10f97d-c163-4665-ba3b-f8b1fb04a613 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:58.420036 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10f97d-c163-4665-ba3b-f8b1fb04a613 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:58.433359 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 452/901] 10.222.0.79 () {56 vars in 1126 bytes} [Thu Jul 14 11:55:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:55:58.434596 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10f97d-c163-4665-ba3b-f8b1fb04a613 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:58.482474 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 450/902] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:55:58 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:55:58.483313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e5287-1331-442a-9f51-f9ac535652bd None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:58.557611 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10f97d-c163-4665-ba3b-f8b1fb04a613 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:58.594462 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd993d8c-de92-4622-b316-5737a9726e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:58.594852 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd993d8c-de92-4622-b316-5737a9726e36 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:58.595111 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd993d8c-de92-4622-b316-5737a9726e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:58.595385 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd993d8c-de92-4622-b316-5737a9726e36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:58.596205 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd993d8c-de92-4622-b316-5737a9726e36 None admin] RBAC: Adding query filter params (interface=public, service_id=0393829f60b9412bac5c8ee40a939fed, region_id=RegionOne) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:58.596635 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd993d8c-de92-4622-b316-5737a9726e36 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:58.597959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd993d8c-de92-4622-b316-5737a9726e36 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:58.608375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 453/903] 10.222.0.79 () {56 vars in 1251 bytes} [Thu Jul 14 11:55:58 2022] GET /identity/v3/endpoints?service_id=0393829f60b9412bac5c8ee40a939fed&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:58.609555 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd993d8c-de92-4622-b316-5737a9726e36 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:58.611532 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e5287-1331-442a-9f51-f9ac535652bd None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:58.620995 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:58.622954 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:58.655775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6154d0-fcaf-4d05-9792-2883071cd196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:58.656596 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6154d0-fcaf-4d05-9792-2883071cd196 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:58.656883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6154d0-fcaf-4d05-9792-2883071cd196 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:58.657163 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6154d0-fcaf-4d05-9792-2883071cd196 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:58.669123 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6154d0-fcaf-4d05-9792-2883071cd196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:58.674565 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6154d0-fcaf-4d05-9792-2883071cd196 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:58.694953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-ff6154d0-fcaf-4d05-9792-2883071cd196 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:58.694953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:58.694953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:58.694953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:58.694953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:58.694953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:58.694953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:58.694953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:58.694953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:58.694953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:58.694953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:58.694953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:58.694953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:55:58.694953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:55:58.694953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:55:58.696056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:55:58.696056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:58.696056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:58.696056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:58.696056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:58.696056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:58.696056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:58.696056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:58.696056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:58.696056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:58.696056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:58.696056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:58.696056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:58.696056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:58.696056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:58.696056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:58.696056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:58.697573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:55:58.697573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:55:58.697573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:55:58.697573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:58.701749 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 451/904] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:55:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:58.702774 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6154d0-fcaf-4d05-9792-2883071cd196 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:58.734661 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd993d8c-de92-4622-b316-5737a9726e36 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:58.776377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443452d7-cb34-478d-9fd1-59fbac642d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:58.777304 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443452d7-cb34-478d-9fd1-59fbac642d67 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:58.777738 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443452d7-cb34-478d-9fd1-59fbac642d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:58.778162 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443452d7-cb34-478d-9fd1-59fbac642d67 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:58.779033 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443452d7-cb34-478d-9fd1-59fbac642d67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:58.780608 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443452d7-cb34-478d-9fd1-59fbac642d67 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:58.787280 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 454/905] 10.222.0.79 () {56 vars in 1087 bytes} [Thu Jul 14 11:55:58 2022] GET /identity/v3/services => generated 1268 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:55:58.824952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6154d0-fcaf-4d05-9792-2883071cd196 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:58.864667 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ed0aa-4bf6-41aa-9e55-b9aa7c6cfc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:58.865364 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ed0aa-4bf6-41aa-9e55-b9aa7c6cfc4f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:58.865655 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ed0aa-4bf6-41aa-9e55-b9aa7c6cfc4f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:58.865938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ed0aa-4bf6-41aa-9e55-b9aa7c6cfc4f None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:58.866739 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ed0aa-4bf6-41aa-9e55-b9aa7c6cfc4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:58.867051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ed0aa-4bf6-41aa-9e55-b9aa7c6cfc4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:58.868462 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ed0aa-4bf6-41aa-9e55-b9aa7c6cfc4f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:58.886936 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 452/906] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:58.888673 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443452d7-cb34-478d-9fd1-59fbac642d67 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:58.967897 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:59.002984 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443452d7-cb34-478d-9fd1-59fbac642d67 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:59.038591 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed6d07-f539-465a-af7c-b7091723fc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:59.039404 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed6d07-f539-465a-af7c-b7091723fc35 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:59.039685 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed6d07-f539-465a-af7c-b7091723fc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:59.039960 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed6d07-f539-465a-af7c-b7091723fc35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:59.048199 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed6d07-f539-465a-af7c-b7091723fc35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:59.049689 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed6d07-f539-465a-af7c-b7091723fc35 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:59.065656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-74ed6d07-f539-465a-af7c-b7091723fc35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:59.065656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:59.065656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:59.065656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:59.065656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:59.065656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:59.065656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:59.065656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:59.065656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:59.065656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:59.065656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:59.065656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:59.065656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:55:59.065656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:55:59.065656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:55:59.066621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:55:59.066621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:59.066621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:59.066621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:59.066621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:59.066621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:59.066621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:59.066621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:59.066621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:59.066621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:59.066621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:59.066621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:59.066621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:59.066621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:59.066621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:59.066621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:59.066621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:59.067506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:55:59.067506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:55:59.067506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:55:59.067506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:55:59.067506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:55:59.067506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:55:59.067506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:55:59.067506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:55:59.067506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 455/907] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:55:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:59.074218 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ed0aa-4bf6-41aa-9e55-b9aa7c6cfc4f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:59.099028 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:59.186773 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ed0aa-4bf6-41aa-9e55-b9aa7c6cfc4f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:59.224000 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f245dec-d02b-4d08-bfe5-fb8ef1d20e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:59.225030 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f245dec-d02b-4d08-bfe5-fb8ef1d20e8f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:59.225519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f245dec-d02b-4d08-bfe5-fb8ef1d20e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:59.225990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f245dec-d02b-4d08-bfe5-fb8ef1d20e8f None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:59.227024 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f245dec-d02b-4d08-bfe5-fb8ef1d20e8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:59.227528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f245dec-d02b-4d08-bfe5-fb8ef1d20e8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:59.229212 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f245dec-d02b-4d08-bfe5-fb8ef1d20e8f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:59.242958 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 453/908] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:55:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:59.249673 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed6d07-f539-465a-af7c-b7091723fc35 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:59.358961 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed6d07-f539-465a-af7c-b7091723fc35 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:59.391538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:59.396873 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafad214-9ba1-480f-a691-da7db321a18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:59.397540 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafad214-9ba1-480f-a691-da7db321a18b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:59.397866 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafad214-9ba1-480f-a691-da7db321a18b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:59.398145 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafad214-9ba1-480f-a691-da7db321a18b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:59.399075 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafad214-9ba1-480f-a691-da7db321a18b None admin] RBAC: Adding query filter params (role.id=bfa252f4a7a643c7972c78c6ef2604fe, scope.project.id=66f531bc924b41faa64743923afac319, user.id=f64d942793a5493787c3e5c7815bc134) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:55:59.399394 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafad214-9ba1-480f-a691-da7db321a18b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:59.400882 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafad214-9ba1-480f-a691-da7db321a18b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:59.407489 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 456/909] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:55:59 2022] GET /identity/v3/role_assignments?user.id=f64d942793a5493787c3e5c7815bc134&scope.project.id=66f531bc924b41faa64743923afac319&role.id=bfa252f4a7a643c7972c78c6ef2604fe => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:55:59.606098 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f158423-3fce-402e-9485-120a7543b865 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:59.607021 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f158423-3fce-402e-9485-120a7543b865 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:59.607453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f158423-3fce-402e-9485-120a7543b865 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:59.609324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 454/910] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:59.613339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf1af3-c8ff-4bf3-a626-7070c40350ce None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:59.613636 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf1af3-c8ff-4bf3-a626-7070c40350ce None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:59.613925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf1af3-c8ff-4bf3-a626-7070c40350ce None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:59.614670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f3a1d-5918-45eb-ae48-2a8b007c37e7 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:59.615060 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f3a1d-5918-45eb-ae48-2a8b007c37e7 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:59.615436 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f3a1d-5918-45eb-ae48-2a8b007c37e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:59.615645 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 457/911] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:55:59.621215 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09656c-033e-4f2a-8bf8-883b492c7726 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:59.621505 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09656c-033e-4f2a-8bf8-883b492c7726 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:59.621784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09656c-033e-4f2a-8bf8-883b492c7726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:59.633383 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-380f3a1d-5918-45eb-ae48-2a8b007c37e7 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:59.635407 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-380f3a1d-5918-45eb-ae48-2a8b007c37e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:59.639743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-9c09656c-033e-4f2a-8bf8-883b492c7726 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:55:59.640941 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-9c09656c-033e-4f2a-8bf8-883b492c7726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:55:59.716199 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 455/913] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:55:59.718619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 458/913] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:55:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:55:59.740608 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f3a1d-5918-45eb-ae48-2a8b007c37e7 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:59.751373 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09656c-033e-4f2a-8bf8-883b492c7726 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:55:59.795547 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:59.860111 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09656c-033e-4f2a-8bf8-883b492c7726 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:59.874475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f3a1d-5918-45eb-ae48-2a8b007c37e7 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:55:59.888068 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:59.898573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03634e-93c6-466c-9969-9e66bbf9e49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:59.899258 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03634e-93c6-466c-9969-9e66bbf9e49a None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:59.899546 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03634e-93c6-466c-9969-9e66bbf9e49a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:59.899831 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03634e-93c6-466c-9969-9e66bbf9e49a None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:59.901126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03634e-93c6-466c-9969-9e66bbf9e49a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:59.902611 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03634e-93c6-466c-9969-9e66bbf9e49a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:59.916690 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42060f20-e104-4d86-9dd5-2c8049e61342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:55:59.917632 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42060f20-e104-4d86-9dd5-2c8049e61342 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:55:59.917915 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42060f20-e104-4d86-9dd5-2c8049e61342 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:55:59.918190 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42060f20-e104-4d86-9dd5-2c8049e61342 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:55:59.918712 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 459/914] 10.222.0.79 () {60 vars in 1141 bytes} [Thu Jul 14 11:55:59 2022] POST /identity/v3/services => generated 241 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:55:59.918915 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42060f20-e104-4d86-9dd5-2c8049e61342 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:55:59.920268 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42060f20-e104-4d86-9dd5-2c8049e61342 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:55:59.933826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-42060f20-e104-4d86-9dd5-2c8049e61342 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:55:59.933826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:59.933826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:55:59.933826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:55:59.933826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:55:59.933826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:55:59.933826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:55:59.933826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:55:59.933826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:55:59.933826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:59.933826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:55:59.933826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:59.933826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:55:59.933826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:55:59.933826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:55:59.933826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:55:59.933826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:55:59.934902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:55:59.934902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:55:59.934902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:55:59.934902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:55:59.934902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:55:59.934902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:55:59.934902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:55:59.934902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:55:59.934902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:55:59.934902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:55:59.934902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:55:59.934902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:55:59.934902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:55:59.934902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:55:59.934902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:55:59.934902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:55:59.935763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:55:59.935763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:55:59.935763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:55:59.935763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:55:59.935763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:55:59.935763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:55:59.935763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:55:59.935763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:55:59.935763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:55:59.935763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:55:59.935763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:55:59.935763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:55:59.935763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:55:59.935763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:55:59.935763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 456/915] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Jul 14 11:55:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:55:59.941751 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03634e-93c6-466c-9969-9e66bbf9e49a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:00.071571 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03634e-93c6-466c-9969-9e66bbf9e49a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:00.110652 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9659c-4cad-4a8b-a299-101d8331db13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:00.111256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9659c-4cad-4a8b-a299-101d8331db13 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:00.111545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9659c-4cad-4a8b-a299-101d8331db13 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:00.111826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9659c-4cad-4a8b-a299-101d8331db13 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:00.112543 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9659c-4cad-4a8b-a299-101d8331db13 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:00.112858 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9659c-4cad-4a8b-a299-101d8331db13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:00.114267 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9659c-4cad-4a8b-a299-101d8331db13 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:00.120659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 460/916] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Jul 14 11:55:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:00.125925 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42060f20-e104-4d86-9dd5-2c8049e61342 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:00.208068 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:00.241405 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42060f20-e104-4d86-9dd5-2c8049e61342 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:00.277669 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70f517-a4e9-47ea-b8be-394a1afb1003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:00.278358 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70f517-a4e9-47ea-b8be-394a1afb1003 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:00.278683 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70f517-a4e9-47ea-b8be-394a1afb1003 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:00.278965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70f517-a4e9-47ea-b8be-394a1afb1003 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:00.279684 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70f517-a4e9-47ea-b8be-394a1afb1003 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:00.280000 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70f517-a4e9-47ea-b8be-394a1afb1003 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:00.281382 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70f517-a4e9-47ea-b8be-394a1afb1003 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:00.287270 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 457/917] 10.222.0.79 () {56 vars in 1114 bytes} [Thu Jul 14 11:56:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:00.296025 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9659c-4cad-4a8b-a299-101d8331db13 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:00.347257 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:00.407004 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9659c-4cad-4a8b-a299-101d8331db13 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:00.444649 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdee393-0966-402b-9b32-61a267a65142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:00.445565 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdee393-0966-402b-9b32-61a267a65142 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:00.446029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdee393-0966-402b-9b32-61a267a65142 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:00.446450 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdee393-0966-402b-9b32-61a267a65142 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:00.447926 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdee393-0966-402b-9b32-61a267a65142 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:00.449485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdee393-0966-402b-9b32-61a267a65142 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:00.471212 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 461/918] 10.222.0.79 () {60 vars in 1144 bytes} [Thu Jul 14 11:56:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:56:00.998234 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb3765-c48d-454d-a033-21d6a4cd755f None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:00.999293 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb3765-c48d-454d-a033-21d6a4cd755f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:00.999785 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb3765-c48d-454d-a033-21d6a4cd755f None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:01.001764 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 458/919] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:01.007760 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c0172-e5c4-49bd-b8de-0f45aa4fba9e None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:01.008345 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c0172-e5c4-49bd-b8de-0f45aa4fba9e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:01.008827 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c0172-e5c4-49bd-b8de-0f45aa4fba9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:01.028113 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-a96c0172-e5c4-49bd-b8de-0f45aa4fba9e None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:01.029660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a96c0172-e5c4-49bd-b8de-0f45aa4fba9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:01.118651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 462/920] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:01.137056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb3765-c48d-454d-a033-21d6a4cd755f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:01.248670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb3765-c48d-454d-a033-21d6a4cd755f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:01.285067 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f393f9-9b71-4ef8-a382-834c87c182e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:01.285885 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f393f9-9b71-4ef8-a382-834c87c182e9 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:01.286351 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f393f9-9b71-4ef8-a382-834c87c182e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:01.286667 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f393f9-9b71-4ef8-a382-834c87c182e9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:01.287330 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f393f9-9b71-4ef8-a382-834c87c182e9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:01.288783 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f393f9-9b71-4ef8-a382-834c87c182e9 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:01.292400 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:01.304261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-39f393f9-9b71-4ef8-a382-834c87c182e9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:56:01.304261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:01.304261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:56:01.304261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:56:01.304261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:56:01.304261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:56:01.304261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:56:01.304261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:56:01.304261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:56:01.304261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:01.304261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:56:01.304261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:01.304261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:01.304261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:01.304261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:01.304261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:01.305389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:01.305389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:01.305389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:01.305389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:01.305389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:01.305389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:01.305389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:01.305389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:56:01.305389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:56:01.305389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:56:01.305389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:56:01.305389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:01.305389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:01.305389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:01.305389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:01.305389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:01.306850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:01.306850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:01.306850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:01.306850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:01.306850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:01.306850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:01.306850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:01.306850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:01.306850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:01.306850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:01.306850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:01.306850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:56:01.306850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:56:01.306850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:56:01.306850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:01.306850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 459/921] 10.222.0.79 () {56 vars in 1132 bytes} [Thu Jul 14 11:56:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:01.311891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c0172-e5c4-49bd-b8de-0f45aa4fba9e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:01.342318 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:01.420891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c0172-e5c4-49bd-b8de-0f45aa4fba9e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:01.458588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47e221-8ec4-4d4f-ad6f-af63a6f5c447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:01.459636 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47e221-8ec4-4d4f-ad6f-af63a6f5c447 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:01.460129 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47e221-8ec4-4d4f-ad6f-af63a6f5c447 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:01.460712 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47e221-8ec4-4d4f-ad6f-af63a6f5c447 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:01.462004 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47e221-8ec4-4d4f-ad6f-af63a6f5c447 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:01.463389 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47e221-8ec4-4d4f-ad6f-af63a6f5c447 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:01.466305 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47e221-8ec4-4d4f-ad6f-af63a6f5c447 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:01.482648 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 463/922] 10.222.0.79 () {56 vars in 1126 bytes} [Thu Jul 14 11:56:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:01.484477 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f393f9-9b71-4ef8-a382-834c87c182e9 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:01.560171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65580cf4-f862-47b5-aafb-3d9455ccd452 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:01.560361 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65580cf4-f862-47b5-aafb-3d9455ccd452 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:01.560644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65580cf4-f862-47b5-aafb-3d9455ccd452 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:01.562172 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 464/923] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:56:01.567983 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f47b8-2dfb-4216-9719-b22f1f2d8755 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:01.568278 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f47b8-2dfb-4216-9719-b22f1f2d8755 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:01.568549 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f47b8-2dfb-4216-9719-b22f1f2d8755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:01.586722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-de8f47b8-2dfb-4216-9719-b22f1f2d8755 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:01.588496 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-de8f47b8-2dfb-4216-9719-b22f1f2d8755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:01.599255 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f393f9-9b71-4ef8-a382-834c87c182e9 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:01.637310 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315350f-2ca1-44f7-8826-ebbea6679da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:01.638094 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315350f-2ca1-44f7-8826-ebbea6679da0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:01.638384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315350f-2ca1-44f7-8826-ebbea6679da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:01.638702 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315350f-2ca1-44f7-8826-ebbea6679da0 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:01.639426 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315350f-2ca1-44f7-8826-ebbea6679da0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:01.639741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315350f-2ca1-44f7-8826-ebbea6679da0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:01.641234 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315350f-2ca1-44f7-8826-ebbea6679da0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:01.647331 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 460/924] 10.222.0.79 () {56 vars in 1126 bytes} [Thu Jul 14 11:56:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:01.654328 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315350f-2ca1-44f7-8826-ebbea6679da0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:01.671189 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 465/925] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:01.693685 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f47b8-2dfb-4216-9719-b22f1f2d8755 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:01.730875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:01.740260 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:01.784953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315350f-2ca1-44f7-8826-ebbea6679da0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:01.819465 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f47b8-2dfb-4216-9719-b22f1f2d8755 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:01.822829 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870fc6d2-fa90-4861-85e3-bbe2e05fa4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:01.823790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fc6d2-fa90-4861-85e3-bbe2e05fa4b7 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:01.824283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fc6d2-fa90-4861-85e3-bbe2e05fa4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:01.824773 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fc6d2-fa90-4861-85e3-bbe2e05fa4b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:01.825738 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870fc6d2-fa90-4861-85e3-bbe2e05fa4b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:01.827374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870fc6d2-fa90-4861-85e3-bbe2e05fa4b7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:01.853444 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 461/926] 10.222.0.79 () {60 vars in 1144 bytes} [Thu Jul 14 11:56:01 2022] POST /identity/v3/endpoints => generated 347 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:56:01.876658 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c56dd-0c8d-4169-8586-5a5677eabb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:01.877928 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c56dd-0c8d-4169-8586-5a5677eabb60 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:01.878451 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c56dd-0c8d-4169-8586-5a5677eabb60 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:01.878996 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c56dd-0c8d-4169-8586-5a5677eabb60 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:01.893773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c56dd-0c8d-4169-8586-5a5677eabb60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:56:01.905051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-518c56dd-0c8d-4169-8586-5a5677eabb60 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 11:56:01.905051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:01.905051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:01.905051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:01.905051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:01.905051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:01.905051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:01.905051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:01.905051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:01.905051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:01.905051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:01.905051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:01.905051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:56:01.905051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:56:01.905051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:56:01.905051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:56:01.906348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:56:01.906348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:56:01.906348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:56:01.906348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:56:01.906348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:01.906348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:01.906348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:01.906348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:01.906348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:01.906348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:01.906348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:01.906348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:01.906348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:01.906348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:01.906348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:01.906348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:01.907254 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:01.907254 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:01.907254 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:01.907254 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:01.907254 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:56:01.907254 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:56:01.907254 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:56:01.907254 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:56:01.907254 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:56:01.907254 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:56:01.907254 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 11:56:01.907254 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:01.910415 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 466/927] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Jul 14 11:56:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:56:01.917353 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870fc6d2-fa90-4861-85e3-bbe2e05fa4b7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:02.037197 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870fc6d2-fa90-4861-85e3-bbe2e05fa4b7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:02.061925 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:02.082812 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dafd8-f182-4c6b-84f2-44210a531996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:02.083423 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dafd8-f182-4c6b-84f2-44210a531996 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:02.083713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dafd8-f182-4c6b-84f2-44210a531996 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:02.083995 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dafd8-f182-4c6b-84f2-44210a531996 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:02.084759 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465dafd8-f182-4c6b-84f2-44210a531996 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:02.085080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465dafd8-f182-4c6b-84f2-44210a531996 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:02.086450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465dafd8-f182-4c6b-84f2-44210a531996 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:02.089988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f38c9-d133-460f-94cc-b8226d04b659 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:02.090285 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f38c9-d133-460f-94cc-b8226d04b659 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:02.090581 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f38c9-d133-460f-94cc-b8226d04b659 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:02.092230 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 467/928] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:56:02.097620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac257cf-1741-42e5-8de3-12cc0183afa2 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:02.097911 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac257cf-1741-42e5-8de3-12cc0183afa2 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:02.098195 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac257cf-1741-42e5-8de3-12cc0183afa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:02.099786 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 462/929] 10.222.0.79 () {56 vars in 1115 bytes} [Thu Jul 14 11:56:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:02.106563 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dafd8-f182-4c6b-84f2-44210a531996 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:02.119679 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-5ac257cf-1741-42e5-8de3-12cc0183afa2 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:02.120984 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5ac257cf-1741-42e5-8de3-12cc0183afa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:02.196487 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 468/930] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:56:02.220814 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac257cf-1741-42e5-8de3-12cc0183afa2 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:02.233600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:02.237175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dafd8-f182-4c6b-84f2-44210a531996 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:02.285169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268667a-d298-4e0f-bcb2-1742836b493d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:02.286428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268667a-d298-4e0f-bcb2-1742836b493d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:02.286837 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268667a-d298-4e0f-bcb2-1742836b493d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:02.287224 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268667a-d298-4e0f-bcb2-1742836b493d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:02.303761 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268667a-d298-4e0f-bcb2-1742836b493d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:02.306385 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268667a-d298-4e0f-bcb2-1742836b493d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:02.329446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-8268667a-d298-4e0f-bcb2-1742836b493d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:56:02.329446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:02.329446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:02.329446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:02.329446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:02.329446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:02.329446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:02.329446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:02.329446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:02.329446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:02.329446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:02.329446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:02.329446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:56:02.329446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:56:02.329446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:56:02.330652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:56:02.330652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:02.330652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:02.330652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:02.330652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:02.330652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:02.330652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:02.330652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:02.330652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:02.330652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:02.330652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:02.330652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:02.330652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:02.330652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:02.330652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:02.330652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:02.330652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:02.331766 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:56:02.331766 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:56:02.331766 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:56:02.331766 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:02.338675 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 463/931] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:56:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:02.341529 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268667a-d298-4e0f-bcb2-1742836b493d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:02.347497 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac257cf-1741-42e5-8de3-12cc0183afa2 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:02.385008 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:02.403097 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f958d89-d609-4b34-9547-b1c41e6fa10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:02.404333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f958d89-d609-4b34-9547-b1c41e6fa10c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:02.404875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f958d89-d609-4b34-9547-b1c41e6fa10c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:02.405371 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f958d89-d609-4b34-9547-b1c41e6fa10c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:02.406571 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f958d89-d609-4b34-9547-b1c41e6fa10c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:02.408376 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f958d89-d609-4b34-9547-b1c41e6fa10c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:02.423218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-7f958d89-d609-4b34-9547-b1c41e6fa10c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:56:02.423218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:02.423218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:56:02.423218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:56:02.423218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:56:02.423218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:56:02.423218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:56:02.423218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:56:02.423218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:56:02.423218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:02.423218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:56:02.423218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:02.423218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:02.423218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:02.423218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:02.423218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:02.423218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:02.424651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:02.424651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:02.424651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:02.424651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:02.424651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:02.424651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:02.424651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:56:02.424651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:56:02.424651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:56:02.424651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:56:02.424651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:02.424651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:02.424651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:02.424651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:02.424651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:02.424651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:02.425482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:02.425482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:02.425482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:02.425482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:02.425482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:02.425482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:02.425482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:02.425482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:02.425482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:02.425482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:02.425482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:56:02.425482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:56:02.425482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:56:02.425482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:02.428668 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 469/932] 10.222.0.79 () {56 vars in 1126 bytes} [Thu Jul 14 11:56:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:56:02.435326 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f958d89-d609-4b34-9547-b1c41e6fa10c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:02.464610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268667a-d298-4e0f-bcb2-1742836b493d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:02.501541 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f3328-2a0f-4808-9481-706ef6f5b09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:02.502333 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f3328-2a0f-4808-9481-706ef6f5b09f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:02.502650 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f3328-2a0f-4808-9481-706ef6f5b09f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:02.502931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f3328-2a0f-4808-9481-706ef6f5b09f None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:02.503657 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f3328-2a0f-4808-9481-706ef6f5b09f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:02.503970 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f3328-2a0f-4808-9481-706ef6f5b09f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:02.505351 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f3328-2a0f-4808-9481-706ef6f5b09f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:02.511707 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:02.521599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 464/933] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:02.527373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f3328-2a0f-4808-9481-706ef6f5b09f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:02.554061 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f958d89-d609-4b34-9547-b1c41e6fa10c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:02.602042 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912c382-0c70-4dd9-a4a7-ae6529ae88f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:02.603667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912c382-0c70-4dd9-a4a7-ae6529ae88f8 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:02.603959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912c382-0c70-4dd9-a4a7-ae6529ae88f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:02.604375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912c382-0c70-4dd9-a4a7-ae6529ae88f8 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:02.605188 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912c382-0c70-4dd9-a4a7-ae6529ae88f8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:02.605630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912c382-0c70-4dd9-a4a7-ae6529ae88f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:02.607249 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912c382-0c70-4dd9-a4a7-ae6529ae88f8 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:02.617963 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 470/934] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Jul 14 11:56:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:02.620659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912c382-0c70-4dd9-a4a7-ae6529ae88f8 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:02.651335 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:02.662566 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f3328-2a0f-4808-9481-706ef6f5b09f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:02.705905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e797c-67a4-4496-a169-85b79ffad2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:02.706782 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e797c-67a4-4496-a169-85b79ffad2df None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:02.707064 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e797c-67a4-4496-a169-85b79ffad2df None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:02.707342 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e797c-67a4-4496-a169-85b79ffad2df None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:02.715497 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e797c-67a4-4496-a169-85b79ffad2df None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:02.716989 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e797c-67a4-4496-a169-85b79ffad2df None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:02.736670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-060e797c-67a4-4496-a169-85b79ffad2df None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 11:56:02.736670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:02.736670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:02.736670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:02.736670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:02.736670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:02.736670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:02.736670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:02.736670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:02.736670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:02.736670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:02.736670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:02.736670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:56:02.736670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:56:02.736670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:56:02.736670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:56:02.737661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:02.737661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:02.737661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:56:02.737661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:56:02.737661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:56:02.737661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:56:02.737661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:02.737661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:02.737661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:02.737661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:02.737661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:02.737661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:02.737661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:02.737661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:02.737661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:02.737661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:02.737661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:02.737661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:02.738621 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:02.738621 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:02.738621 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:56:02.738621 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:56:02.738621 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:56:02.738621 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:56:02.738621 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:56:02.738621 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:56:02.738621 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 11:56:02.738621 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:02.743195 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 465/935] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Jul 14 11:56:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:56:02.745532 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11a6fa-3a5b-4c5b-852e-8bbc6023fdba None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:02.745823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11a6fa-3a5b-4c5b-852e-8bbc6023fdba None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:02.746103 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11a6fa-3a5b-4c5b-852e-8bbc6023fdba None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:02.750576 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 466/936] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:02.750764 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912c382-0c70-4dd9-a4a7-ae6529ae88f8 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:02.750848 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11a6fa-3a5b-4c5b-852e-8bbc6023fdba None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:02.791685 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85731aa-3a86-49b8-b03f-f0af38853c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:02.792695 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85731aa-3a86-49b8-b03f-f0af38853c2c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:02.793128 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85731aa-3a86-49b8-b03f-f0af38853c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:02.793552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85731aa-3a86-49b8-b03f-f0af38853c2c None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:02.795069 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85731aa-3a86-49b8-b03f-f0af38853c2c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:02.795546 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85731aa-3a86-49b8-b03f-f0af38853c2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:02.797622 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85731aa-3a86-49b8-b03f-f0af38853c2c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:02.801735 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:02.810242 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 471/937] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Jul 14 11:56:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:02.810242 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e038af2-65d5-4c2c-aa2f-a8153aeebd62 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:02.810242 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e038af2-65d5-4c2c-aa2f-a8153aeebd62 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:02.810242 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e038af2-65d5-4c2c-aa2f-a8153aeebd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:02.829622 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-4e038af2-65d5-4c2c-aa2f-a8153aeebd62 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:02.830757 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-4e038af2-65d5-4c2c-aa2f-a8153aeebd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:02.867659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11a6fa-3a5b-4c5b-852e-8bbc6023fdba None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:02.914589 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 472/938] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:02.914589 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e038af2-65d5-4c2c-aa2f-a8153aeebd62 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:02.918058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca9d8f-4287-453a-84c3-a2057ffd8178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:02.918802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca9d8f-4287-453a-84c3-a2057ffd8178 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:02.919092 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca9d8f-4287-453a-84c3-a2057ffd8178 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:02.919372 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca9d8f-4287-453a-84c3-a2057ffd8178 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:02.920233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca9d8f-4287-453a-84c3-a2057ffd8178 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:02.920548 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca9d8f-4287-453a-84c3-a2057ffd8178 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:02.922531 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca9d8f-4287-453a-84c3-a2057ffd8178 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:02.956704 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 467/939] 10.222.0.79 () {56 vars in 1149 bytes} [Thu Jul 14 11:56:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:02.957469 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca9d8f-4287-453a-84c3-a2057ffd8178 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:02.976455 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:03.047420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e038af2-65d5-4c2c-aa2f-a8153aeebd62 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:03.073020 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca9d8f-4287-453a-84c3-a2057ffd8178 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:03.078896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:03.085597 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca4dba-f1d9-457f-9175-a7586b766bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:03.086262 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca4dba-f1d9-457f-9175-a7586b766bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:03.086579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca4dba-f1d9-457f-9175-a7586b766bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:03.086860 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca4dba-f1d9-457f-9175-a7586b766bd2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:03.088169 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca4dba-f1d9-457f-9175-a7586b766bd2 None admin] RBAC: Adding query filter params (interface=public, service_id=59f5a83654af44aa9860d56f184b0d69, region_id=RegionOne) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:03.088492 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca4dba-f1d9-457f-9175-a7586b766bd2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:03.089879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca4dba-f1d9-457f-9175-a7586b766bd2 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:03.099777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 473/940] 10.222.0.79 () {56 vars in 1251 bytes} [Thu Jul 14 11:56:02 2022] GET /identity/v3/endpoints?service_id=59f5a83654af44aa9860d56f184b0d69&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:03.099777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca4dba-f1d9-457f-9175-a7586b766bd2 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:03.111209 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f048cd8-17bd-45e3-9ced-da117391d50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:03.111895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f048cd8-17bd-45e3-9ced-da117391d50f None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:03.112184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f048cd8-17bd-45e3-9ced-da117391d50f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:03.112466 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f048cd8-17bd-45e3-9ced-da117391d50f None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:03.113201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f048cd8-17bd-45e3-9ced-da117391d50f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:03.114669 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f048cd8-17bd-45e3-9ced-da117391d50f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:03.116078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: WARNING keystone.server.flask.common [None req-8f048cd8-17bd-45e3-9ced-da117391d50f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 11:56:03.135928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.sql.core [None req-8f048cd8-17bd-45e3-9ced-da117391d50f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 11:56:03.135928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 11:56:03.135928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [parameters: {'id': 'ca2361633620424daa1208b17bc73deb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 11:56:03.135928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80164) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 11:56:03.143305 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-8f048cd8-17bd-45e3-9ced-da117391d50f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ca2361633620424daa1208b17bc73deb.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ca2361633620424daa1208b17bc73deb. Jul 14 11:56:03.143305 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:03.143305 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 11:56:03.143305 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 11:56:03.143305 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 11:56:03.143305 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 11:56:03.143305 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 11:56:03.143305 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 11:56:03.143305 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 11:56:03.143305 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application conn.query(q) Jul 14 11:56:03.143305 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 11:56:03.143305 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 11:56:03.143305 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 11:56:03.144135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application result.read() Jul 14 11:56:03.144135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 11:56:03.144135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 11:56:03.144135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 11:56:03.144135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 11:56:03.144135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 11:56:03.144135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 11:56:03.144135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 11:56:03.144135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 11:56:03.144135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 11:56:03.144135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:03.144135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 11:56:03.144135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:03.144135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:03.144135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 11:56:03.144135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 11:56:03.144135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 14 11:56:03.144135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 14 11:56:03.145080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 11:56:03.145080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application next(self.gen) Jul 14 11:56:03.145080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 11:56:03.145080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application yield resource Jul 14 11:56:03.145080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 11:56:03.145080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application next(self.gen) Jul 14 11:56:03.145080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 11:56:03.145080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 11:56:03.145080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 11:56:03.145080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 11:56:03.145080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 11:56:03.145080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise self.value Jul 14 11:56:03.145080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 11:56:03.145080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 11:56:03.145080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 11:56:03.145080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application session.commit() Jul 14 11:56:03.145080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 11:56:03.145948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 11:56:03.145948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 11:56:03.145948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 11:56:03.145948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 11:56:03.145948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.session.flush() Jul 14 11:56:03.145948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 11:56:03.145948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 11:56:03.145948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 11:56:03.145948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 11:56:03.145948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 11:56:03.145948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application compat.raise_( Jul 14 11:56:03.145948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 11:56:03.145948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception Jul 14 11:56:03.145948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 11:56:03.145948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 11:56:03.145948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 11:56:03.145948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 11:56:03.147577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 11:56:03.147577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 11:56:03.147577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 11:56:03.147577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 11:56:03.147577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 11:56:03.147577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 11:56:03.147577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 11:56:03.147577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 11:56:03.147577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 11:56:03.147577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 11:56:03.147577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 11:56:03.147577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 11:56:03.147577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 11:56:03.147577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 11:56:03.147577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 11:56:03.148348 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 11:56:03.148348 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 11:56:03.148348 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception Jul 14 11:56:03.148348 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 11:56:03.148348 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 11:56:03.148348 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 11:56:03.148348 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 11:56:03.148348 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 11:56:03.148348 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 11:56:03.148348 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 11:56:03.148348 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application conn.query(q) Jul 14 11:56:03.148348 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 11:56:03.148348 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 11:56:03.148348 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 11:56:03.148348 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application result.read() Jul 14 11:56:03.148348 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 11:56:03.148348 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 11:56:03.149184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 11:56:03.149184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 11:56:03.149184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 11:56:03.149184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 11:56:03.149184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 11:56:03.149184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 11:56:03.149184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 11:56:03.149184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 11:56:03.149184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [parameters: {'id': 'ca2361633620424daa1208b17bc73deb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 11:56:03.149184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 11:56:03.149184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:03.149184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:56:03.149184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:03.149184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:03.149184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 14 11:56:03.151142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 14 11:56:03.151142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 11:56:03.151142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 11:56:03.151142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 14 11:56:03.151142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:03.151142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:56:03.151142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:03.151142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:03.151142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:03.151142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:03.151142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:03.151142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:03.151142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:03.151142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:03.151142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:03.151142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:03.151142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:03.152226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:03.152226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 14 11:56:03.152226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 14 11:56:03.152226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:03.152226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:03.152226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 14 11:56:03.152226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 14 11:56:03.152226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ca2361633620424daa1208b17bc73deb. Jul 14 11:56:03.152226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:03.152226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 468/941] 10.222.0.79 () {60 vars in 1140 bytes} [Thu Jul 14 11:56:02 2022] POST /identity/v3/projects => generated 262 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:03.152226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f048cd8-17bd-45e3-9ced-da117391d50f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:03.218953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca4dba-f1d9-457f-9175-a7586b766bd2 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:03.228733 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:03.260385 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b3d9f-1ca0-4533-b14b-1788dabd5cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:03.261317 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b3d9f-1ca0-4533-b14b-1788dabd5cac None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:03.261919 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b3d9f-1ca0-4533-b14b-1788dabd5cac None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:03.262373 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b3d9f-1ca0-4533-b14b-1788dabd5cac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:03.267242 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f048cd8-17bd-45e3-9ced-da117391d50f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:03.275519 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b3d9f-1ca0-4533-b14b-1788dabd5cac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:03.277348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b3d9f-1ca0-4533-b14b-1788dabd5cac None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:03.300522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-c02b3d9f-1ca0-4533-b14b-1788dabd5cac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:56:03.300522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:03.300522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:03.300522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:03.300522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:03.300522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:03.300522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:03.300522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:03.300522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:03.300522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:03.300522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:03.300522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:03.300522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:56:03.300522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:56:03.300522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:56:03.301710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:56:03.301710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:03.301710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:03.301710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:03.301710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:03.301710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:03.301710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:03.301710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:03.301710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:03.301710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:03.301710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:03.301710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:03.301710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:03.301710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:03.301710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:03.301710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:03.301710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:03.303241 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:56:03.303241 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:56:03.303241 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:56:03.303241 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:03.303491 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ada70-e18d-428e-9bf8-38243b3c4dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:03.303491 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ada70-e18d-428e-9bf8-38243b3c4dcd None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:03.303491 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ada70-e18d-428e-9bf8-38243b3c4dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:03.303491 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ada70-e18d-428e-9bf8-38243b3c4dcd None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:03.303922 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ada70-e18d-428e-9bf8-38243b3c4dcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:03.305456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ada70-e18d-428e-9bf8-38243b3c4dcd None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:03.305728 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 474/942] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:56:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:03.307577 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b3d9f-1ca0-4533-b14b-1788dabd5cac None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:03.316184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 469/943] 10.222.0.79 () {56 vars in 1087 bytes} [Thu Jul 14 11:56:03 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:56:03.317036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ada70-e18d-428e-9bf8-38243b3c4dcd None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:03.387226 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:03.444665 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b3d9f-1ca0-4533-b14b-1788dabd5cac None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:03.451563 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ada70-e18d-428e-9bf8-38243b3c4dcd None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:03.490963 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6a3ca-73a7-4861-aa10-1c2e5f898b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:03.491917 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6a3ca-73a7-4861-aa10-1c2e5f898b39 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:03.492030 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:03.492109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6a3ca-73a7-4861-aa10-1c2e5f898b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:03.492317 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6a3ca-73a7-4861-aa10-1c2e5f898b39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:03.498111 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fe95f-e5d5-4b4c-9537-4368ff8606f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:03.500405 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fe95f-e5d5-4b4c-9537-4368ff8606f4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:03.500405 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fe95f-e5d5-4b4c-9537-4368ff8606f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:03.500405 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fe95f-e5d5-4b4c-9537-4368ff8606f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:03.500667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6a3ca-73a7-4861-aa10-1c2e5f898b39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:03.500741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fe95f-e5d5-4b4c-9537-4368ff8606f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:03.500741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fe95f-e5d5-4b4c-9537-4368ff8606f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:03.501221 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6a3ca-73a7-4861-aa10-1c2e5f898b39 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:03.501689 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fe95f-e5d5-4b4c-9537-4368ff8606f4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:03.517354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-dfa6a3ca-73a7-4861-aa10-1c2e5f898b39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:56:03.517354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:03.517354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:03.517354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:03.517354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:03.517354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:03.517354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:03.517354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:03.517354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:03.517354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:03.517354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:03.517354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:03.517354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:56:03.517354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:56:03.517354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:56:03.518455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:56:03.518455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:03.518455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:03.518455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:03.518455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:03.518455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:03.518455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:03.518455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:03.518455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:03.518455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:03.518455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:03.518455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:03.518455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:03.518455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:03.518455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:03.518455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:03.518455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:03.519773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:56:03.519773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:56:03.519773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:56:03.519773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:56:03.519773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:56:03.519773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:56:03.519773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:56:03.519773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:03.519773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 475/944] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:56:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:03.523587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 470/945] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:03.525762 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6a3ca-73a7-4861-aa10-1c2e5f898b39 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:03.530239 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fe95f-e5d5-4b4c-9537-4368ff8606f4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:03.643578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fe95f-e5d5-4b4c-9537-4368ff8606f4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:03.644714 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6a3ca-73a7-4861-aa10-1c2e5f898b39 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:03.653720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:03.680474 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e888e6-177e-499a-89c6-bd91dc18ffc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:03.681808 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e888e6-177e-499a-89c6-bd91dc18ffc0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:03.682188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e888e6-177e-499a-89c6-bd91dc18ffc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:03.682463 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e888e6-177e-499a-89c6-bd91dc18ffc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:03.685653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caf70c-f9c1-41cb-88c0-6c8c4eb70583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:03.686320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caf70c-f9c1-41cb-88c0-6c8c4eb70583 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:03.686636 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caf70c-f9c1-41cb-88c0-6c8c4eb70583 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:03.686916 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caf70c-f9c1-41cb-88c0-6c8c4eb70583 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:03.687675 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28caf70c-f9c1-41cb-88c0-6c8c4eb70583 None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:03.687986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28caf70c-f9c1-41cb-88c0-6c8c4eb70583 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:03.689435 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28caf70c-f9c1-41cb-88c0-6c8c4eb70583 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:03.689769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e888e6-177e-499a-89c6-bd91dc18ffc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:03.691248 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e888e6-177e-499a-89c6-bd91dc18ffc0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:03.705997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-85e888e6-177e-499a-89c6-bd91dc18ffc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:56:03.705997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:03.705997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:03.705997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:03.705997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:03.705997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:03.705997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:03.705997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:03.705997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:03.705997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:03.705997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:03.705997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:03.705997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:56:03.705997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:56:03.705997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:56:03.706988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:56:03.706988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:03.706988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:03.706988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:03.706988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:03.706988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:03.706988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:03.706988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:03.706988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:03.706988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:03.706988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:03.706988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:03.706988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:03.706988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:03.706988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:03.706988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:03.706988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:03.707923 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:56:03.707923 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:56:03.707923 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:56:03.707923 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:56:03.707923 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:56:03.707923 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:56:03.707923 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:56:03.707923 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:03.707923 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 471/946] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:56:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:03.708901 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 476/947] 10.222.0.79 () {56 vars in 1112 bytes} [Thu Jul 14 11:56:03 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:03.719714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e888e6-177e-499a-89c6-bd91dc18ffc0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:03.794767 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:03.854438 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e888e6-177e-499a-89c6-bd91dc18ffc0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:03.894731 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75aaa9-c69c-4453-b228-045a8a92de0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:03.895339 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75aaa9-c69c-4453-b228-045a8a92de0f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:03.895631 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75aaa9-c69c-4453-b228-045a8a92de0f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:03.895915 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75aaa9-c69c-4453-b228-045a8a92de0f None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:03.896714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75aaa9-c69c-4453-b228-045a8a92de0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:03.897032 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75aaa9-c69c-4453-b228-045a8a92de0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:03.898486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75aaa9-c69c-4453-b228-045a8a92de0f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:03.912800 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 472/948] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:56:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:03.919211 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caf70c-f9c1-41cb-88c0-6c8c4eb70583 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:04.027087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caf70c-f9c1-41cb-88c0-6c8c4eb70583 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:04.063572 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b310eb8-581f-4cbf-b0b1-954d6211d576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:04.064831 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b310eb8-581f-4cbf-b0b1-954d6211d576 None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:04.065321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b310eb8-581f-4cbf-b0b1-954d6211d576 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:04.065829 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b310eb8-581f-4cbf-b0b1-954d6211d576 None admin] PATH_INFO: `/v3/projects/66f531bc924b41faa64743923afac319/users/f64d942793a5493787c3e5c7815bc134/roles/bfa252f4a7a643c7972c78c6ef2604fe` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:04.068352 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b310eb8-581f-4cbf-b0b1-954d6211d576 None admin] RBAC: Authorizing `identity:create_grant(project_id=66f531bc924b41faa64743923afac319, user_id=f64d942793a5493787c3e5c7815bc134, role_id=bfa252f4a7a643c7972c78c6ef2604fe)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:04.070082 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b310eb8-581f-4cbf-b0b1-954d6211d576 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:04.088147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 477/949] 10.222.0.79 () {58 vars in 1439 bytes} [Thu Jul 14 11:56:03 2022] PUT /identity/v3/projects/66f531bc924b41faa64743923afac319/users/f64d942793a5493787c3e5c7815bc134/roles/bfa252f4a7a643c7972c78c6ef2604fe => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:56:04.515227 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c70e5-7488-4c0d-abc0-d886d040a46a None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:04.515791 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c70e5-7488-4c0d-abc0-d886d040a46a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:04.515791 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c70e5-7488-4c0d-abc0-d886d040a46a None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:04.517260 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 473/950] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:04.522985 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1061f1-8b47-463a-98ee-1388851d1f92 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:04.523492 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1061f1-8b47-463a-98ee-1388851d1f92 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:04.523768 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1061f1-8b47-463a-98ee-1388851d1f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:04.543208 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-cf1061f1-8b47-463a-98ee-1388851d1f92 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:04.544575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-cf1061f1-8b47-463a-98ee-1388851d1f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:04.567142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:04.621336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 478/951] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:04.643495 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c70e5-7488-4c0d-abc0-d886d040a46a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:04.755143 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c70e5-7488-4c0d-abc0-d886d040a46a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:04.769826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:04.792293 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacfb9b-811a-4e84-a67c-f5f96e45c0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:04.793113 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacfb9b-811a-4e84-a67c-f5f96e45c0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:04.793406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacfb9b-811a-4e84-a67c-f5f96e45c0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:04.793689 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacfb9b-811a-4e84-a67c-f5f96e45c0e7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:04.794393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcacfb9b-811a-4e84-a67c-f5f96e45c0e7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:04.795820 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcacfb9b-811a-4e84-a67c-f5f96e45c0e7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:04.809247 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-dcacfb9b-811a-4e84-a67c-f5f96e45c0e7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:56:04.809247 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:04.809247 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:56:04.809247 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:56:04.809247 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:56:04.809247 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:56:04.809247 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:56:04.809247 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:56:04.809247 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:56:04.809247 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:04.809247 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:56:04.809247 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:04.809247 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:04.809247 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:04.809247 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:04.809247 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:04.809247 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:04.810289 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:04.810289 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:04.810289 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:04.810289 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:04.810289 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:04.810289 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:04.810289 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:56:04.810289 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:56:04.810289 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:56:04.810289 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:56:04.810289 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:04.810289 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:04.810289 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:04.810289 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:04.810289 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:04.810289 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:04.812287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:04.812287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:04.812287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:04.812287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:04.812287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:04.812287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:04.812287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:04.812287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:04.812287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:04.812287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:04.812287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:56:04.812287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:56:04.812287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:56:04.812287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:04.812287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 474/952] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:56:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:04.816765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1061f1-8b47-463a-98ee-1388851d1f92 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:04.924721 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1061f1-8b47-463a-98ee-1388851d1f92 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:04.962858 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cb544-4087-4da6-ab6c-47749e1089a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:04.963526 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cb544-4087-4da6-ab6c-47749e1089a9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:04.963811 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cb544-4087-4da6-ab6c-47749e1089a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:04.964089 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cb544-4087-4da6-ab6c-47749e1089a9 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:04.964803 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cb544-4087-4da6-ab6c-47749e1089a9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:04.965113 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cb544-4087-4da6-ab6c-47749e1089a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:04.966542 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cb544-4087-4da6-ab6c-47749e1089a9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:04.972171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 479/953] 10.222.0.79 () {56 vars in 1112 bytes} [Thu Jul 14 11:56:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:04.977609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacfb9b-811a-4e84-a67c-f5f96e45c0e7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:05.086044 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacfb9b-811a-4e84-a67c-f5f96e45c0e7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:05.122309 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec837b-d47b-4aac-baa6-483b2d4dac53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:05.123028 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec837b-d47b-4aac-baa6-483b2d4dac53 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:05.123318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec837b-d47b-4aac-baa6-483b2d4dac53 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:05.123601 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec837b-d47b-4aac-baa6-483b2d4dac53 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:05.124327 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec837b-d47b-4aac-baa6-483b2d4dac53 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:05.124640 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec837b-d47b-4aac-baa6-483b2d4dac53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:05.126021 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec837b-d47b-4aac-baa6-483b2d4dac53 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:05.131334 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 475/954] 10.222.0.79 () {56 vars in 1112 bytes} [Thu Jul 14 11:56:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:05.482295 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba55b45-6d59-4d1c-84c2-2156377a521e None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:05.482733 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba55b45-6d59-4d1c-84c2-2156377a521e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:05.483024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba55b45-6d59-4d1c-84c2-2156377a521e None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:05.484693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 480/955] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:05.492241 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b698f-82e9-4999-a8e8-f5dcdde9c2e2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:05.492241 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b698f-82e9-4999-a8e8-f5dcdde9c2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:05.492241 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b698f-82e9-4999-a8e8-f5dcdde9c2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:05.510382 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-323b698f-82e9-4999-a8e8-f5dcdde9c2e2 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:05.511956 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-323b698f-82e9-4999-a8e8-f5dcdde9c2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:05.549534 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:05.603050 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 476/956] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:05.626137 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba55b45-6d59-4d1c-84c2-2156377a521e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:05.651219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:05.742696 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba55b45-6d59-4d1c-84c2-2156377a521e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:05.779078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f328d50-e1fb-4596-982e-784859e9833a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:05.780240 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f328d50-e1fb-4596-982e-784859e9833a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:05.780619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f328d50-e1fb-4596-982e-784859e9833a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:05.780993 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f328d50-e1fb-4596-982e-784859e9833a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:05.781750 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f328d50-e1fb-4596-982e-784859e9833a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:05.783255 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f328d50-e1fb-4596-982e-784859e9833a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:05.795959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-2f328d50-e1fb-4596-982e-784859e9833a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:56:05.795959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:05.795959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:56:05.795959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:56:05.795959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:56:05.795959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:56:05.795959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:56:05.795959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:56:05.795959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:56:05.795959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:05.795959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:56:05.795959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:05.795959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:05.795959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:05.795959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:05.795959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:05.795959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:05.797070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:05.797070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:05.797070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:05.797070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:05.797070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:05.797070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:05.797070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:56:05.797070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:56:05.797070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:56:05.797070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:56:05.797070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:05.797070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:05.797070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:05.797070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:05.797070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:05.797070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:05.797955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:05.797955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:05.797955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:05.797955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:05.797955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:05.797955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:05.797955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:05.797955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:05.797955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:05.797955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:05.797955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:56:05.797955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:56:05.797955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:56:05.797955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:05.797955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 481/957] 10.222.0.79 () {56 vars in 1126 bytes} [Thu Jul 14 11:56:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:05.803544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b698f-82e9-4999-a8e8-f5dcdde9c2e2 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:05.899071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebf1ab-9517-40e1-adff-39d6fcd60ade None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:05.899755 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebf1ab-9517-40e1-adff-39d6fcd60ade None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:05.900781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebf1ab-9517-40e1-adff-39d6fcd60ade None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:05.902887 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 482/958] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:05.908880 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62277cd8-1653-48ec-a2fb-5fb324c2fe04 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:05.909541 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62277cd8-1653-48ec-a2fb-5fb324c2fe04 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:05.910163 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62277cd8-1653-48ec-a2fb-5fb324c2fe04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:05.923064 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b698f-82e9-4999-a8e8-f5dcdde9c2e2 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:05.933713 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-62277cd8-1653-48ec-a2fb-5fb324c2fe04 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:05.935351 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-62277cd8-1653-48ec-a2fb-5fb324c2fe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:05.968104 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee424aaf-f14c-4eb8-b442-7dc5b0758d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:05.969269 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee424aaf-f14c-4eb8-b442-7dc5b0758d51 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:05.969561 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee424aaf-f14c-4eb8-b442-7dc5b0758d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:05.969842 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee424aaf-f14c-4eb8-b442-7dc5b0758d51 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:05.970580 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee424aaf-f14c-4eb8-b442-7dc5b0758d51 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:05.970906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee424aaf-f14c-4eb8-b442-7dc5b0758d51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:05.972277 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee424aaf-f14c-4eb8-b442-7dc5b0758d51 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:05.978527 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 477/959] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Jul 14 11:56:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:05.984880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee424aaf-f14c-4eb8-b442-7dc5b0758d51 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:06.022596 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 483/960] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:56:06.024224 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:06.043914 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62277cd8-1653-48ec-a2fb-5fb324c2fe04 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:06.062994 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:06.110092 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee424aaf-f14c-4eb8-b442-7dc5b0758d51 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:06.147897 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc756639-e606-4355-9380-1458d443189f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:06.148566 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc756639-e606-4355-9380-1458d443189f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:06.148846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc756639-e606-4355-9380-1458d443189f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:06.149117 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc756639-e606-4355-9380-1458d443189f None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:06.149855 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc756639-e606-4355-9380-1458d443189f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:06.150316 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc756639-e606-4355-9380-1458d443189f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:06.151719 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc756639-e606-4355-9380-1458d443189f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:06.162306 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 478/961] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Jul 14 11:56:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:06.163377 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc756639-e606-4355-9380-1458d443189f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:06.194186 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62277cd8-1653-48ec-a2fb-5fb324c2fe04 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:06.245256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebb2a0-c9e4-44d9-9a47-417373e4449e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:06.246296 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebb2a0-c9e4-44d9-9a47-417373e4449e None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:06.246860 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebb2a0-c9e4-44d9-9a47-417373e4449e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:06.247349 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebb2a0-c9e4-44d9-9a47-417373e4449e None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:06.248271 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eebb2a0-c9e4-44d9-9a47-417373e4449e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:06.250545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eebb2a0-c9e4-44d9-9a47-417373e4449e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:06.252992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: WARNING keystone.server.flask.common [None req-0eebb2a0-c9e4-44d9-9a47-417373e4449e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 11:56:06.269368 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.sql.core [None req-0eebb2a0-c9e4-44d9-9a47-417373e4449e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 11:56:06.269368 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 11:56:06.269368 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [parameters: {'user_id': '08e5246114364c43b01cd89ed4683fb7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 11:56:06.269368 dv-cinder-848900-3-smb devstack@keystone.service[80165]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80165) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 11:56:06.274435 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:06.279391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc756639-e606-4355-9380-1458d443189f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:06.286063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-0eebb2a0-c9e4-44d9-9a47-417373e4449e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 11:56:06.286063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:06.286063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 11:56:06.286063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 11:56:06.286063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 11:56:06.286063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 11:56:06.286063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 11:56:06.286063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 11:56:06.286063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 11:56:06.286063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application conn.query(q) Jul 14 11:56:06.286063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 11:56:06.286063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 11:56:06.286063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 11:56:06.286063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application result.read() Jul 14 11:56:06.286063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 11:56:06.287054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 11:56:06.287054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 11:56:06.287054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 11:56:06.287054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 11:56:06.287054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 11:56:06.287054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 11:56:06.287054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 11:56:06.287054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 11:56:06.287054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:06.287054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 11:56:06.287054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:06.287054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:06.287054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 11:56:06.287054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 11:56:06.287054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 14 11:56:06.287054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 14 11:56:06.287054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 11:56:06.287054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application next(self.gen) Jul 14 11:56:06.287988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 11:56:06.287988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application yield resource Jul 14 11:56:06.287988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 11:56:06.287988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application next(self.gen) Jul 14 11:56:06.287988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 11:56:06.287988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 11:56:06.287988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 11:56:06.287988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 11:56:06.287988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 11:56:06.287988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise self.value Jul 14 11:56:06.287988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 11:56:06.287988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 11:56:06.287988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 11:56:06.287988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application session.commit() Jul 14 11:56:06.287988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 11:56:06.287988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 11:56:06.287988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 11:56:06.289299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 11:56:06.289299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 11:56:06.289299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self.session.flush() Jul 14 11:56:06.289299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 11:56:06.289299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 11:56:06.289299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 11:56:06.289299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 11:56:06.289299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 11:56:06.289299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application compat.raise_( Jul 14 11:56:06.289299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 11:56:06.289299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception Jul 14 11:56:06.289299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 11:56:06.289299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 11:56:06.289299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 11:56:06.289299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 11:56:06.289299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 11:56:06.289299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 11:56:06.290180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 11:56:06.290180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 11:56:06.290180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 14 11:56:06.290180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 14 11:56:06.290180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 11:56:06.290180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 11:56:06.290180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 11:56:06.290180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 11:56:06.290180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 11:56:06.290180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 11:56:06.290180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 11:56:06.290180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 11:56:06.290180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 11:56:06.290180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 11:56:06.290180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 11:56:06.290180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception Jul 14 11:56:06.291660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 11:56:06.291660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 11:56:06.291660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 11:56:06.291660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 11:56:06.291660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 11:56:06.291660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 11:56:06.291660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 11:56:06.291660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application conn.query(q) Jul 14 11:56:06.291660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 11:56:06.291660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 11:56:06.291660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 11:56:06.291660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application result.read() Jul 14 11:56:06.291660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 11:56:06.291660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 11:56:06.291660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 11:56:06.291660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 11:56:06.294459 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 11:56:06.294459 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 11:56:06.294459 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 11:56:06.294459 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 11:56:06.294459 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 11:56:06.294459 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 11:56:06.294459 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [parameters: {'user_id': '08e5246114364c43b01cd89ed4683fb7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 11:56:06.294459 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 11:56:06.294459 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:06.294459 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:56:06.294459 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:06.294459 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:06.294459 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:06.294459 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:06.294459 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:06.296419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:06.296419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:06.296419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:06.296419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:06.296419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:06.296419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:06.296419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:06.296419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 14 11:56:06.296419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 14 11:56:06.296419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:06.296419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:06.296419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:56:06.296419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:56:06.296419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:56:06.296419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:56:06.296419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 14 11:56:06.296419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 14 11:56:06.298413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 14 11:56:06.298413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 14 11:56:06.298413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 11:56:06.298413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 11:56:06.298413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 11:56:06.298413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:06.298413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 484/962] 10.222.0.79 () {60 vars in 1131 bytes} [Thu Jul 14 11:56:06 2022] POST /identity/v3/users => generated 160 bytes in 249 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:56:06.298413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd493134-e363-43eb-a612-f14557c32763 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:06.298413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd493134-e363-43eb-a612-f14557c32763 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:06.298413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd493134-e363-43eb-a612-f14557c32763 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:06.299942 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 485/963] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:06.300627 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd493134-e363-43eb-a612-f14557c32763 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:06.325490 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f27414-e57e-4912-8985-52af7384ea3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:06.326528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f27414-e57e-4912-8985-52af7384ea3e None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:06.327000 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f27414-e57e-4912-8985-52af7384ea3e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:06.327591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f27414-e57e-4912-8985-52af7384ea3e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:06.328674 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f27414-e57e-4912-8985-52af7384ea3e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:06.330389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f27414-e57e-4912-8985-52af7384ea3e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:06.356358 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 479/964] 10.222.0.79 () {60 vars in 1144 bytes} [Thu Jul 14 11:56:06 2022] POST /identity/v3/endpoints => generated 349 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:56:06.357639 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc9888-a784-4f0d-bd20-8dfb414c238c None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:06.358057 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc9888-a784-4f0d-bd20-8dfb414c238c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:06.358393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc9888-a784-4f0d-bd20-8dfb414c238c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:06.377887 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e0fc9888-a784-4f0d-bd20-8dfb414c238c None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:06.379167 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e0fc9888-a784-4f0d-bd20-8dfb414c238c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:06.416258 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:06.469269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd493134-e363-43eb-a612-f14557c32763 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:06.491834 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 480/965] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:06.516691 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc9888-a784-4f0d-bd20-8dfb414c238c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:06.521690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3c228-c18c-4485-999c-5560615baf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:06.522592 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3c228-c18c-4485-999c-5560615baf35 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:06.522883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3c228-c18c-4485-999c-5560615baf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:06.523223 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3c228-c18c-4485-999c-5560615baf35 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:06.533690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3c228-c18c-4485-999c-5560615baf35 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:06.535669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3c228-c18c-4485-999c-5560615baf35 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:06.552517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-4fa3c228-c18c-4485-999c-5560615baf35 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 11:56:06.552517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:06.552517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:06.552517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:06.552517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:06.552517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:06.552517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:06.552517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:06.552517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:06.552517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:06.552517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:06.552517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:06.552517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:56:06.552517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:56:06.552517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:56:06.552517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:56:06.553521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:06.553521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:06.553521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:56:06.553521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:56:06.553521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:56:06.553521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:56:06.553521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:06.553521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:06.553521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:06.553521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:06.553521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:06.553521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:06.553521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:06.553521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:06.553521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:06.553521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:06.553521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:06.553521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:06.554462 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:06.554462 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:06.554462 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:56:06.554462 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:56:06.554462 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:56:06.554462 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:56:06.554462 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:56:06.554462 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:56:06.554462 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 11:56:06.554462 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:06.554462 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 486/966] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:56:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:06.560879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3c228-c18c-4485-999c-5560615baf35 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:06.625287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:06.643915 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc9888-a784-4f0d-bd20-8dfb414c238c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:06.682876 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520e1e0-cb87-4565-b859-3c190aa0ca1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:06.684052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520e1e0-cb87-4565-b859-3c190aa0ca1a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:06.684489 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520e1e0-cb87-4565-b859-3c190aa0ca1a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:06.685035 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520e1e0-cb87-4565-b859-3c190aa0ca1a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:06.690282 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3c228-c18c-4485-999c-5560615baf35 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:06.697850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520e1e0-cb87-4565-b859-3c190aa0ca1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:56:06.706881 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-8520e1e0-cb87-4565-b859-3c190aa0ca1a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 11:56:06.706881 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:06.706881 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:06.706881 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:06.706881 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:06.706881 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:06.706881 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:06.706881 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:06.706881 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:06.706881 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:06.706881 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:06.706881 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:06.706881 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:56:06.706881 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:56:06.706881 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:56:06.706881 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:56:06.707864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:56:06.707864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:56:06.707864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:56:06.707864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:56:06.707864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:06.707864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:06.707864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:06.707864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:06.707864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:06.707864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:06.707864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:06.707864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:06.707864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:06.707864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:06.707864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:06.707864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:06.708713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:06.708713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:06.708713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:06.708713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:06.708713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:56:06.708713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:56:06.708713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:56:06.708713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:56:06.708713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:56:06.708713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:56:06.708713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 11:56:06.708713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:06.711410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 481/967] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Jul 14 11:56:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:56:06.718663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520e1e0-cb87-4565-b859-3c190aa0ca1a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:06.723549 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:06.733492 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397a538-6fe0-4f1f-9e6b-78f4424f25cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:06.734239 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397a538-6fe0-4f1f-9e6b-78f4424f25cf None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:06.734545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397a538-6fe0-4f1f-9e6b-78f4424f25cf None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:06.734828 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397a538-6fe0-4f1f-9e6b-78f4424f25cf None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:06.735688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397a538-6fe0-4f1f-9e6b-78f4424f25cf None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:06.736005 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397a538-6fe0-4f1f-9e6b-78f4424f25cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:06.738533 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397a538-6fe0-4f1f-9e6b-78f4424f25cf None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:06.791272 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 487/968] 10.222.0.79 () {56 vars in 1101 bytes} [Thu Jul 14 11:56:06 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:06.849922 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520e1e0-cb87-4565-b859-3c190aa0ca1a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:06.890471 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc237336-d499-453b-873c-ed3948cadc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:06.891196 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc237336-d499-453b-873c-ed3948cadc9a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:06.891483 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc237336-d499-453b-873c-ed3948cadc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:06.891762 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc237336-d499-453b-873c-ed3948cadc9a None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:06.892529 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc237336-d499-453b-873c-ed3948cadc9a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:06.892843 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc237336-d499-453b-873c-ed3948cadc9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:06.894253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc237336-d499-453b-873c-ed3948cadc9a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:06.904631 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 482/969] 10.222.0.79 () {56 vars in 1115 bytes} [Thu Jul 14 11:56:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:06.910845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397a538-6fe0-4f1f-9e6b-78f4424f25cf None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:07.024301 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397a538-6fe0-4f1f-9e6b-78f4424f25cf None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:07.062081 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b5527-0279-4b1f-9d41-12cfff2a346d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:07.063164 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b5527-0279-4b1f-9d41-12cfff2a346d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:07.063593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b5527-0279-4b1f-9d41-12cfff2a346d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:07.064048 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b5527-0279-4b1f-9d41-12cfff2a346d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:07.075628 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b5527-0279-4b1f-9d41-12cfff2a346d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:07.077533 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b5527-0279-4b1f-9d41-12cfff2a346d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:07.096079 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-e55b5527-0279-4b1f-9d41-12cfff2a346d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:56:07.096079 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:07.096079 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:07.096079 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:07.096079 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:07.096079 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:07.096079 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:07.096079 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:07.096079 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:07.096079 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:07.096079 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:07.096079 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:07.096079 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:56:07.096079 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:56:07.096079 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:56:07.097100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:56:07.097100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:07.097100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:07.097100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:07.097100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:07.097100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:07.097100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:07.097100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:07.097100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:07.097100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:07.097100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:07.097100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:07.097100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:07.097100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:07.097100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:07.097100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:07.097100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:07.097980 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:56:07.097980 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:56:07.097980 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:56:07.097980 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:07.098602 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 488/970] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:56:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:07.104831 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc237336-d499-453b-873c-ed3948cadc9a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:07.114940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:07.211167 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc237336-d499-453b-873c-ed3948cadc9a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:07.249731 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5bd95-3b40-4ec8-a2cd-a66d7491793c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:07.250398 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5bd95-3b40-4ec8-a2cd-a66d7491793c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:07.250728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5bd95-3b40-4ec8-a2cd-a66d7491793c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:07.251006 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5bd95-3b40-4ec8-a2cd-a66d7491793c None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:07.251726 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5bd95-3b40-4ec8-a2cd-a66d7491793c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:07.252035 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5bd95-3b40-4ec8-a2cd-a66d7491793c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:07.253398 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5bd95-3b40-4ec8-a2cd-a66d7491793c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:07.265524 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 483/971] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:07.270867 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b5527-0279-4b1f-9d41-12cfff2a346d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:07.279499 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee40663-adb4-40d8-a6bc-188d1ff369f8 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:07.279888 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee40663-adb4-40d8-a6bc-188d1ff369f8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:07.280172 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee40663-adb4-40d8-a6bc-188d1ff369f8 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:07.281544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 484/972] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:56:07.286531 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60979e3d-c2c9-4156-9b50-2229796806fd None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:07.286820 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60979e3d-c2c9-4156-9b50-2229796806fd None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:07.287090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60979e3d-c2c9-4156-9b50-2229796806fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:07.304183 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-60979e3d-c2c9-4156-9b50-2229796806fd None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:07.305465 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-60979e3d-c2c9-4156-9b50-2229796806fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:07.316548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:07.376063 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:07.385331 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 485/973] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:56:07.395348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b5527-0279-4b1f-9d41-12cfff2a346d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:07.409128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60979e3d-c2c9-4156-9b50-2229796806fd None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:07.443798 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8001ffa-4f58-477d-983a-0c86484d1a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:07.444610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8001ffa-4f58-477d-983a-0c86484d1a2d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:07.445018 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8001ffa-4f58-477d-983a-0c86484d1a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:07.445289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8001ffa-4f58-477d-983a-0c86484d1a2d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:07.453477 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8001ffa-4f58-477d-983a-0c86484d1a2d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:07.455095 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8001ffa-4f58-477d-983a-0c86484d1a2d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:07.471269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-d8001ffa-4f58-477d-983a-0c86484d1a2d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 11:56:07.471269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:07.471269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:07.471269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:07.471269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:07.471269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:07.471269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:07.471269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:07.471269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:07.471269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:07.471269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:07.471269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:07.471269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:56:07.471269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:56:07.471269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:56:07.471269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:56:07.472468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:07.472468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:07.472468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:56:07.472468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:56:07.472468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:56:07.472468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:56:07.472468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:07.472468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:07.472468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:07.472468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:07.472468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:07.472468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:07.472468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:07.472468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:07.472468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:07.472468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:07.472468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:07.472468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:07.473722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:07.473722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:07.473722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:56:07.473722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:56:07.473722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:56:07.473722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:56:07.473722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:56:07.473722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:56:07.473722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 11:56:07.473722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:07.473722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 489/974] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Jul 14 11:56:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:07.478049 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8001ffa-4f58-477d-983a-0c86484d1a2d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:07.521718 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60979e3d-c2c9-4156-9b50-2229796806fd None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:07.559726 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb585917-3460-4e9c-b955-08490ac19561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:07.560413 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb585917-3460-4e9c-b955-08490ac19561 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:07.560700 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb585917-3460-4e9c-b955-08490ac19561 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:07.560985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb585917-3460-4e9c-b955-08490ac19561 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:07.561722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb585917-3460-4e9c-b955-08490ac19561 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:07.563145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb585917-3460-4e9c-b955-08490ac19561 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:07.580330 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 486/975] 10.222.0.79 () {60 vars in 1141 bytes} [Thu Jul 14 11:56:07 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:56:07.591709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8001ffa-4f58-477d-983a-0c86484d1a2d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:07.594841 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:07.640739 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcac66-398f-4ec3-9a91-53a4add365db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:07.641447 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcac66-398f-4ec3-9a91-53a4add365db None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:07.641736 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcac66-398f-4ec3-9a91-53a4add365db None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:07.642017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcac66-398f-4ec3-9a91-53a4add365db None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:07.642931 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdcac66-398f-4ec3-9a91-53a4add365db None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:07.643266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdcac66-398f-4ec3-9a91-53a4add365db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:07.644762 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdcac66-398f-4ec3-9a91-53a4add365db None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:07.666159 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 490/976] 10.222.0.79 () {56 vars in 1149 bytes} [Thu Jul 14 11:56:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:07.672022 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb585917-3460-4e9c-b955-08490ac19561 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:07.745072 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:07.795546 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb585917-3460-4e9c-b955-08490ac19561 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:07.830811 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66f8b4-03f0-4840-826c-69aa507791fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:07.831386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66f8b4-03f0-4840-826c-69aa507791fe None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:07.831675 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66f8b4-03f0-4840-826c-69aa507791fe None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:07.831953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66f8b4-03f0-4840-826c-69aa507791fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:07.902440 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66f8b4-03f0-4840-826c-69aa507791fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:07.903940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66f8b4-03f0-4840-826c-69aa507791fe None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:07.959460 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:08.010576 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 487/977] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:56:07 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:56:08.012404 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcac66-398f-4ec3-9a91-53a4add365db None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:08.122627 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcac66-398f-4ec3-9a91-53a4add365db None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:08.157206 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28878e0-3962-4efc-aec1-3a3bc70a126a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:08.157988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28878e0-3962-4efc-aec1-3a3bc70a126a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:08.158272 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28878e0-3962-4efc-aec1-3a3bc70a126a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:08.158570 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28878e0-3962-4efc-aec1-3a3bc70a126a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:08.169883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28878e0-3962-4efc-aec1-3a3bc70a126a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:08.171375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28878e0-3962-4efc-aec1-3a3bc70a126a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:08.190338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-d28878e0-3962-4efc-aec1-3a3bc70a126a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:56:08.190338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:08.190338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:08.190338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:08.190338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:08.190338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:08.190338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:08.190338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:08.190338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:08.190338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:08.190338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:08.190338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:08.190338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:56:08.190338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:56:08.190338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:56:08.191306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:56:08.191306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:08.191306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:08.191306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:08.191306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:08.191306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:08.191306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:08.191306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:08.191306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:08.191306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:08.191306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:08.191306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:08.191306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:08.191306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:08.191306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:08.191306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:08.191306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:08.197460 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:56:08.197460 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:56:08.197460 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:56:08.197460 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:08.197460 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 491/978] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:56:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:08.199324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66f8b4-03f0-4840-826c-69aa507791fe None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:08.304379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66f8b4-03f0-4840-826c-69aa507791fe None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:08.339929 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03830fc3-1870-412a-ba0d-1cfd027d8cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:08.340601 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03830fc3-1870-412a-ba0d-1cfd027d8cfa None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:08.340885 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03830fc3-1870-412a-ba0d-1cfd027d8cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:08.341159 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03830fc3-1870-412a-ba0d-1cfd027d8cfa None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:08.341888 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03830fc3-1870-412a-ba0d-1cfd027d8cfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:08.342196 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03830fc3-1870-412a-ba0d-1cfd027d8cfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:08.343591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03830fc3-1870-412a-ba0d-1cfd027d8cfa None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:08.360234 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 488/979] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:08.361862 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28878e0-3962-4efc-aec1-3a3bc70a126a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:08.373517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:08.466116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28878e0-3962-4efc-aec1-3a3bc70a126a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:08.488337 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf29eb-ce60-4de8-b982-4b7c592366c9 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:08.488673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf29eb-ce60-4de8-b982-4b7c592366c9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:08.488904 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf29eb-ce60-4de8-b982-4b7c592366c9 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:08.490293 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 489/980] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:56:08.496117 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b224266-06e7-425b-9c44-f2fd178a1b5a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:08.496409 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b224266-06e7-425b-9c44-f2fd178a1b5a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:08.496699 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b224266-06e7-425b-9c44-f2fd178a1b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:08.501419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f893a-7a6b-41b8-adef-44e79444c696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:08.502394 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f893a-7a6b-41b8-adef-44e79444c696 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:08.502874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f893a-7a6b-41b8-adef-44e79444c696 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:08.503155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f893a-7a6b-41b8-adef-44e79444c696 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:08.510762 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f893a-7a6b-41b8-adef-44e79444c696 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:08.512277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f893a-7a6b-41b8-adef-44e79444c696 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:08.514170 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-2b224266-06e7-425b-9c44-f2fd178a1b5a None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:08.515720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2b224266-06e7-425b-9c44-f2fd178a1b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:08.527581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:08.528653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-be2f893a-7a6b-41b8-adef-44e79444c696 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:56:08.528653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:08.528653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:08.528653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:08.528653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:08.528653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:08.528653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:08.528653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:08.528653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:08.528653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:08.528653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:08.528653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:08.528653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:56:08.528653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:56:08.528653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:56:08.529720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:56:08.529720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:08.529720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:08.529720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:08.529720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:08.529720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:08.529720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:08.529720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:08.529720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:08.529720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:08.529720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:08.529720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:08.529720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:08.529720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:08.529720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:08.529720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:08.529720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:08.530772 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:56:08.530772 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:56:08.530772 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:56:08.530772 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:56:08.530772 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:56:08.530772 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:56:08.530772 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:56:08.530772 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:08.531960 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 492/981] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:56:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:08.537374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f893a-7a6b-41b8-adef-44e79444c696 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:08.593329 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 490/982] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:08.609283 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:08.617761 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b224266-06e7-425b-9c44-f2fd178a1b5a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:08.648310 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f893a-7a6b-41b8-adef-44e79444c696 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:08.686660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5ca28-0735-4c5c-8da6-5d0172c569bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:08.687329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5ca28-0735-4c5c-8da6-5d0172c569bc None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:08.687617 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5ca28-0735-4c5c-8da6-5d0172c569bc None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:08.687903 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5ca28-0735-4c5c-8da6-5d0172c569bc None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:08.688719 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5ca28-0735-4c5c-8da6-5d0172c569bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:08.689042 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5ca28-0735-4c5c-8da6-5d0172c569bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:08.690520 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5ca28-0735-4c5c-8da6-5d0172c569bc None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:08.704690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 493/983] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:56:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:08.711210 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5ca28-0735-4c5c-8da6-5d0172c569bc None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:08.735401 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b224266-06e7-425b-9c44-f2fd178a1b5a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:08.780449 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc29f85-ab54-4338-8f95-1cd11f8e1f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:08.781253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc29f85-ab54-4338-8f95-1cd11f8e1f65 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:08.781533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc29f85-ab54-4338-8f95-1cd11f8e1f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:08.781806 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc29f85-ab54-4338-8f95-1cd11f8e1f65 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:08.782463 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc29f85-ab54-4338-8f95-1cd11f8e1f65 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:08.783835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc29f85-ab54-4338-8f95-1cd11f8e1f65 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:08.796053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-6bc29f85-ab54-4338-8f95-1cd11f8e1f65 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:56:08.796053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:08.796053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:56:08.796053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:56:08.796053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:56:08.796053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:56:08.796053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:56:08.796053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:56:08.796053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:56:08.796053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:08.796053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:56:08.796053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:08.796053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:08.796053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:08.796053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:08.796053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:08.796053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:08.797658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:08.797658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:08.797658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:08.797658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:08.797658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:08.797658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:08.797658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:56:08.797658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:56:08.797658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:56:08.797658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:56:08.797658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:08.797658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:08.797658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:08.797658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:08.797658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:08.797658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:08.798916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:08.798916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:08.798916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:08.798916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:08.798916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:08.798916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:08.798916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:08.798916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:08.798916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:08.798916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:08.798916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:56:08.798916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:56:08.798916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:56:08.798916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:08.798916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 491/984] 10.222.0.79 () {56 vars in 1126 bytes} [Thu Jul 14 11:56:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:08.803558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc29f85-ab54-4338-8f95-1cd11f8e1f65 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:08.817343 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:08.827195 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5ca28-0735-4c5c-8da6-5d0172c569bc None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:08.856324 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:08.865442 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6014c-b326-4b96-a26a-f558b7f10e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:08.866187 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6014c-b326-4b96-a26a-f558b7f10e20 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:08.866478 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6014c-b326-4b96-a26a-f558b7f10e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:08.866787 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6014c-b326-4b96-a26a-f558b7f10e20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:08.867620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6014c-b326-4b96-a26a-f558b7f10e20 None admin] RBAC: Adding query filter params (role.id=bfa252f4a7a643c7972c78c6ef2604fe, scope.project.id=66f531bc924b41faa64743923afac319, user.id=f64d942793a5493787c3e5c7815bc134) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:08.867944 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6014c-b326-4b96-a26a-f558b7f10e20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:08.869424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6014c-b326-4b96-a26a-f558b7f10e20 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:08.882532 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 494/985] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:56:08 2022] GET /identity/v3/role_assignments?user.id=f64d942793a5493787c3e5c7815bc134&scope.project.id=66f531bc924b41faa64743923afac319&role.id=bfa252f4a7a643c7972c78c6ef2604fe => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:08.925147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc29f85-ab54-4338-8f95-1cd11f8e1f65 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:08.964552 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1af058-b802-4034-bc84-29d34e7c3eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:08.965243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1af058-b802-4034-bc84-29d34e7c3eda None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:08.965533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1af058-b802-4034-bc84-29d34e7c3eda None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:08.965816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1af058-b802-4034-bc84-29d34e7c3eda None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:08.966575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1af058-b802-4034-bc84-29d34e7c3eda None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:08.966893 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1af058-b802-4034-bc84-29d34e7c3eda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:08.968277 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1af058-b802-4034-bc84-29d34e7c3eda None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:08.973829 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 492/986] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Jul 14 11:56:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:08.980125 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6014c-b326-4b96-a26a-f558b7f10e20 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:09.093932 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6014c-b326-4b96-a26a-f558b7f10e20 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:09.130116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf9c35-3b1b-469e-8b56-6f0549f91d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:09.131088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf9c35-3b1b-469e-8b56-6f0549f91d8a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:09.131516 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf9c35-3b1b-469e-8b56-6f0549f91d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:09.131933 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf9c35-3b1b-469e-8b56-6f0549f91d8a None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:09.132787 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf9c35-3b1b-469e-8b56-6f0549f91d8a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:09.133252 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf9c35-3b1b-469e-8b56-6f0549f91d8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:09.135338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf9c35-3b1b-469e-8b56-6f0549f91d8a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:09.140859 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 495/987] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Jul 14 11:56:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:09.146684 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1af058-b802-4034-bc84-29d34e7c3eda None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:09.228353 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:09.255608 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1af058-b802-4034-bc84-29d34e7c3eda None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:09.291849 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c118892-e975-4d52-95ed-bd612ea0f3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:09.292522 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c118892-e975-4d52-95ed-bd612ea0f3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:09.292813 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c118892-e975-4d52-95ed-bd612ea0f3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:09.293093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c118892-e975-4d52-95ed-bd612ea0f3c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:09.293900 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c118892-e975-4d52-95ed-bd612ea0f3c3 None admin] RBAC: Adding query filter params (interface=admin, service_id=59f5a83654af44aa9860d56f184b0d69, region_id=RegionOne) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:09.294225 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c118892-e975-4d52-95ed-bd612ea0f3c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:09.295632 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c118892-e975-4d52-95ed-bd612ea0f3c3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:09.301386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 493/988] 10.222.0.79 () {56 vars in 1249 bytes} [Thu Jul 14 11:56:09 2022] GET /identity/v3/endpoints?service_id=59f5a83654af44aa9860d56f184b0d69&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:09.307443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf9c35-3b1b-469e-8b56-6f0549f91d8a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:09.365860 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:09.412470 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf9c35-3b1b-469e-8b56-6f0549f91d8a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:09.448295 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9511a-1d79-4625-9f67-ac4d2eae1997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:09.448970 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9511a-1d79-4625-9f67-ac4d2eae1997 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:09.449257 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9511a-1d79-4625-9f67-ac4d2eae1997 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:09.449535 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9511a-1d79-4625-9f67-ac4d2eae1997 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:09.450219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9511a-1d79-4625-9f67-ac4d2eae1997 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:09.451648 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9511a-1d79-4625-9f67-ac4d2eae1997 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:09.466780 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 496/989] 10.222.0.79 () {56 vars in 1087 bytes} [Thu Jul 14 11:56:09 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:56:09.676996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49812102-731e-4a2b-9feb-a25f3ae989bc None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:09.677352 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49812102-731e-4a2b-9feb-a25f3ae989bc None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:09.677555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49812102-731e-4a2b-9feb-a25f3ae989bc None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:09.679184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 494/990] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:09.684394 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429c5d1-d37e-4ae7-90a6-15c2f64a7277 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:09.684764 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429c5d1-d37e-4ae7-90a6-15c2f64a7277 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:09.685140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429c5d1-d37e-4ae7-90a6-15c2f64a7277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:09.702757 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-0429c5d1-d37e-4ae7-90a6-15c2f64a7277 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:09.704297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-0429c5d1-d37e-4ae7-90a6-15c2f64a7277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:09.779970 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 497/991] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:09.803464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49812102-731e-4a2b-9feb-a25f3ae989bc None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:09.908483 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49812102-731e-4a2b-9feb-a25f3ae989bc None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:09.945041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf32d9-7e5b-4b6f-824b-0a5f0f4b218d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:09.945935 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf32d9-7e5b-4b6f-824b-0a5f0f4b218d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:09.946114 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf32d9-7e5b-4b6f-824b-0a5f0f4b218d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:09.946411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf32d9-7e5b-4b6f-824b-0a5f0f4b218d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:09.947698 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf32d9-7e5b-4b6f-824b-0a5f0f4b218d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:09.949070 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf32d9-7e5b-4b6f-824b-0a5f0f4b218d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:09.961193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-eccf32d9-7e5b-4b6f-824b-0a5f0f4b218d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:56:09.961193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:09.961193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:56:09.961193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:56:09.961193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:56:09.961193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:56:09.961193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:56:09.961193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:56:09.961193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:56:09.961193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:09.961193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:56:09.961193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:09.961193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:09.961193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:09.961193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:09.961193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:09.961193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:09.962237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:09.962237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:09.962237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:09.962237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:09.962237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:09.962237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:09.962237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:56:09.962237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:56:09.962237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:56:09.962237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:56:09.962237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:09.962237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:09.962237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:09.962237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:09.962237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:09.962237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:09.963697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:09.963697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:09.963697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:09.963697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:09.963697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:09.963697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:09.963697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:09.963697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:09.963697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:09.963697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:09.963697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:56:09.963697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:56:09.963697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:56:09.963697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:09.966844 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 495/992] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:56:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:09.968413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429c5d1-d37e-4ae7-90a6-15c2f64a7277 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:10.020381 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:10.075338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429c5d1-d37e-4ae7-90a6-15c2f64a7277 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:10.111267 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd8c84-df34-4e74-8888-9908df39a0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:10.111895 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd8c84-df34-4e74-8888-9908df39a0bc None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:10.111895 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd8c84-df34-4e74-8888-9908df39a0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:10.111895 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd8c84-df34-4e74-8888-9908df39a0bc None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:10.112599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd8c84-df34-4e74-8888-9908df39a0bc None admin] RBAC: Adding query filter params (name=compute) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:10.112914 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd8c84-df34-4e74-8888-9908df39a0bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:10.114287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd8c84-df34-4e74-8888-9908df39a0bc None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:10.124445 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 498/993] 10.222.0.79 () {56 vars in 1112 bytes} [Thu Jul 14 11:56:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:10.126032 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf32d9-7e5b-4b6f-824b-0a5f0f4b218d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:10.129216 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:10.231427 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf32d9-7e5b-4b6f-824b-0a5f0f4b218d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:10.265467 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7767393-9a6e-4e80-87b1-bc6af74af089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:10.266136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7767393-9a6e-4e80-87b1-bc6af74af089 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:10.266423 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7767393-9a6e-4e80-87b1-bc6af74af089 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:10.266729 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7767393-9a6e-4e80-87b1-bc6af74af089 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:10.267437 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7767393-9a6e-4e80-87b1-bc6af74af089 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:10.267751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7767393-9a6e-4e80-87b1-bc6af74af089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:10.269110 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7767393-9a6e-4e80-87b1-bc6af74af089 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:10.279210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 496/994] 10.222.0.79 () {56 vars in 1112 bytes} [Thu Jul 14 11:56:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:10.280749 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd8c84-df34-4e74-8888-9908df39a0bc None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:10.385015 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd8c84-df34-4e74-8888-9908df39a0bc None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:10.399034 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:10.422116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd4396-4675-4f10-8789-932a56882d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:10.422868 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd4396-4675-4f10-8789-932a56882d99 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:10.423151 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd4396-4675-4f10-8789-932a56882d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:10.423494 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd4396-4675-4f10-8789-932a56882d99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:10.424296 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd4396-4675-4f10-8789-932a56882d99 None admin] RBAC: Adding query filter params (interface=public, service_id=3216cd7c98a2466ca94140b555c14061, region_id=RegionOne) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:10.424612 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd4396-4675-4f10-8789-932a56882d99 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:10.425973 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd4396-4675-4f10-8789-932a56882d99 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:10.432193 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 499/995] 10.222.0.79 () {56 vars in 1251 bytes} [Thu Jul 14 11:56:10 2022] GET /identity/v3/endpoints?service_id=3216cd7c98a2466ca94140b555c14061&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:10.437588 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7767393-9a6e-4e80-87b1-bc6af74af089 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:10.504049 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:10.542692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7767393-9a6e-4e80-87b1-bc6af74af089 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:10.576768 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1250def-e652-4103-bb70-1e1880d9e9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:10.577460 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1250def-e652-4103-bb70-1e1880d9e9fa None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:10.577742 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1250def-e652-4103-bb70-1e1880d9e9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:10.578017 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1250def-e652-4103-bb70-1e1880d9e9fa None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:10.578751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1250def-e652-4103-bb70-1e1880d9e9fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:10.580186 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1250def-e652-4103-bb70-1e1880d9e9fa None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:10.588179 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 497/996] 10.222.0.79 () {56 vars in 1087 bytes} [Thu Jul 14 11:56:10 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:56:10.979282 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561c691-960c-48b4-9c0d-aafd68912b35 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:10.979688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561c691-960c-48b4-9c0d-aafd68912b35 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:10.979883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561c691-960c-48b4-9c0d-aafd68912b35 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:10.981376 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 500/997] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:10.986484 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9867024-9b21-479e-9c38-14bbd78d5bc9 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:10.986973 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9867024-9b21-479e-9c38-14bbd78d5bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:10.987168 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9867024-9b21-479e-9c38-14bbd78d5bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:11.003955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a9867024-9b21-479e-9c38-14bbd78d5bc9 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:11.005160 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a9867024-9b21-479e-9c38-14bbd78d5bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:11.082764 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 498/998] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:10 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:11.117901 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561c691-960c-48b4-9c0d-aafd68912b35 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:11.237308 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561c691-960c-48b4-9c0d-aafd68912b35 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:11.273966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ccd651-c87a-4ac5-8bde-2834be95bb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:11.274815 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccd651-c87a-4ac5-8bde-2834be95bb9a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:11.275105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccd651-c87a-4ac5-8bde-2834be95bb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:11.275387 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccd651-c87a-4ac5-8bde-2834be95bb9a None admin] PATH_INFO: `/v3/services/image` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:11.276199 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ccd651-c87a-4ac5-8bde-2834be95bb9a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:11.277430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ccd651-c87a-4ac5-8bde-2834be95bb9a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:11.289653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-63ccd651-c87a-4ac5-8bde-2834be95bb9a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:56:11.289653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:11.289653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:56:11.289653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:56:11.289653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:56:11.289653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:56:11.289653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:56:11.289653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:56:11.289653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:56:11.289653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:11.289653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:56:11.289653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:11.289653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:11.289653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:11.289653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:11.289653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:11.289653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:11.296374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:11.296374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:11.296374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:11.296374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:11.296374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:11.296374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:11.296374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:56:11.296374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:56:11.296374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:56:11.296374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:56:11.296374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:11.296374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:11.296374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:11.296374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:11.296374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:11.296374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:11.297227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:11.297227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:11.297227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:11.297227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:11.297227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:11.297227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:11.297227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:11.297227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:11.297227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:11.297227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:11.297227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:56:11.297227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:56:11.297227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:56:11.297227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:11.297227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 501/999] 10.222.0.79 () {56 vars in 1105 bytes} [Thu Jul 14 11:56:11 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:56:11.298059 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9867024-9b21-479e-9c38-14bbd78d5bc9 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:11.361368 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:11.407745 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9867024-9b21-479e-9c38-14bbd78d5bc9 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:11.443342 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbb3d3-6068-488d-ba8d-ff3e49832c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:11.444023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbb3d3-6068-488d-ba8d-ff3e49832c52 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:11.444308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbb3d3-6068-488d-ba8d-ff3e49832c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:11.444587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbb3d3-6068-488d-ba8d-ff3e49832c52 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:11.445292 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbb3d3-6068-488d-ba8d-ff3e49832c52 None admin] RBAC: Adding query filter params (name=image) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:11.445605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbb3d3-6068-488d-ba8d-ff3e49832c52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:11.447574 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbb3d3-6068-488d-ba8d-ff3e49832c52 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:11.457052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 499/1000] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:56:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:11.458176 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ccd651-c87a-4ac5-8bde-2834be95bb9a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:11.504731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:11.535801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f67f6-83ab-404e-95d8-7349a12bca6f None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:11.536093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f67f6-83ab-404e-95d8-7349a12bca6f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:11.536383 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f67f6-83ab-404e-95d8-7349a12bca6f None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:11.537914 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 500/1001] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:11.543608 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae23072-cf7f-4dbb-85a2-69058dbceb84 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:11.543899 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae23072-cf7f-4dbb-85a2-69058dbceb84 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:11.544180 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae23072-cf7f-4dbb-85a2-69058dbceb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:11.561697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-cae23072-cf7f-4dbb-85a2-69058dbceb84 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:11.563056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-cae23072-cf7f-4dbb-85a2-69058dbceb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:11.570946 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ccd651-c87a-4ac5-8bde-2834be95bb9a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:11.608221 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32628420-f7b3-4321-a33e-d809d2220ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:11.608895 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32628420-f7b3-4321-a33e-d809d2220ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:11.609182 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32628420-f7b3-4321-a33e-d809d2220ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:11.609464 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32628420-f7b3-4321-a33e-d809d2220ae3 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:11.610167 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32628420-f7b3-4321-a33e-d809d2220ae3 None admin] RBAC: Adding query filter params (type=image) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:11.610504 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32628420-f7b3-4321-a33e-d809d2220ae3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:11.611896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32628420-f7b3-4321-a33e-d809d2220ae3 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:11.617310 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 502/1002] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:56:11 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:11.649097 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 501/1003] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:56:11.673075 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32628420-f7b3-4321-a33e-d809d2220ae3 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:11.797314 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32628420-f7b3-4321-a33e-d809d2220ae3 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:11.805841 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:11.835050 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a06481-1055-4473-9634-e8f1c88679e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:11.835916 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a06481-1055-4473-9634-e8f1c88679e3 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:11.836207 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a06481-1055-4473-9634-e8f1c88679e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:11.836489 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a06481-1055-4473-9634-e8f1c88679e3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:11.837148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a06481-1055-4473-9634-e8f1c88679e3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:11.839155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a06481-1055-4473-9634-e8f1c88679e3 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:11.851193 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-48a06481-1055-4473-9634-e8f1c88679e3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:56:11.851193 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:11.851193 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:56:11.851193 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:56:11.851193 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:56:11.851193 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:56:11.851193 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:56:11.851193 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:56:11.851193 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:56:11.851193 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:11.851193 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:56:11.851193 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:11.851193 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:11.851193 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:11.851193 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:11.851193 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:11.851193 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:11.852300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:11.852300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:11.852300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:11.852300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:11.852300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:11.852300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:11.852300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:56:11.852300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:56:11.852300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:56:11.852300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:56:11.852300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:11.852300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:11.852300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:11.852300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:11.852300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:11.852300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:11.853184 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:11.853184 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:11.853184 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:11.853184 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:11.853184 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:11.853184 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:11.853184 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:11.853184 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:11.853184 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:11.853184 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:11.853184 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:56:11.853184 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:56:11.853184 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:56:11.853184 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:11.853184 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 503/1004] 10.222.0.79 () {56 vars in 1126 bytes} [Thu Jul 14 11:56:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:11.860592 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae23072-cf7f-4dbb-85a2-69058dbceb84 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:11.918427 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:11.966201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae23072-cf7f-4dbb-85a2-69058dbceb84 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:12.001272 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f4f2d-e9ee-4b6b-bf45-15a453417bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:12.002039 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f4f2d-e9ee-4b6b-bf45-15a453417bbe None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:12.002233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f4f2d-e9ee-4b6b-bf45-15a453417bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:12.002526 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f4f2d-e9ee-4b6b-bf45-15a453417bbe None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:12.003238 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f4f2d-e9ee-4b6b-bf45-15a453417bbe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:12.003553 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f4f2d-e9ee-4b6b-bf45-15a453417bbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:12.004932 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f4f2d-e9ee-4b6b-bf45-15a453417bbe None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:12.010771 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 502/1005] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Jul 14 11:56:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:12.016133 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a06481-1055-4473-9634-e8f1c88679e3 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:12.122373 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a06481-1055-4473-9634-e8f1c88679e3 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:12.157232 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7721a7-4188-4266-a932-b3e484207566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:12.157912 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7721a7-4188-4266-a932-b3e484207566 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:12.158234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7721a7-4188-4266-a932-b3e484207566 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:12.158551 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7721a7-4188-4266-a932-b3e484207566 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:12.159254 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7721a7-4188-4266-a932-b3e484207566 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:12.159564 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7721a7-4188-4266-a932-b3e484207566 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:12.161009 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7721a7-4188-4266-a932-b3e484207566 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:12.171068 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 504/1006] 10.222.0.79 () {56 vars in 1122 bytes} [Thu Jul 14 11:56:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:12.172367 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f4f2d-e9ee-4b6b-bf45-15a453417bbe None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:12.288015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f4f2d-e9ee-4b6b-bf45-15a453417bbe None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:12.319348 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:12.341630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdc1a9-b535-4b18-b1b1-69712e7e932a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:12.342301 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdc1a9-b535-4b18-b1b1-69712e7e932a None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:12.342617 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdc1a9-b535-4b18-b1b1-69712e7e932a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:12.342897 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdc1a9-b535-4b18-b1b1-69712e7e932a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:12.343645 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cdc1a9-b535-4b18-b1b1-69712e7e932a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:12.345013 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cdc1a9-b535-4b18-b1b1-69712e7e932a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:12.361941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 503/1007] 10.222.0.79 () {60 vars in 1144 bytes} [Thu Jul 14 11:56:12 2022] POST /identity/v3/endpoints => generated 325 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:56:12.668364 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0518f-ee45-4bd3-a501-035d67a263c9 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:12.668778 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0518f-ee45-4bd3-a501-035d67a263c9 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:12.668971 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0518f-ee45-4bd3-a501-035d67a263c9 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:12.670600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 505/1008] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:12.675900 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf733747-d261-40ad-8345-be83d7cde0a6 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:12.676444 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf733747-d261-40ad-8345-be83d7cde0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:12.676729 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf733747-d261-40ad-8345-be83d7cde0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:12.693552 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-bf733747-d261-40ad-8345-be83d7cde0a6 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:12.694784 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-bf733747-d261-40ad-8345-be83d7cde0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:12.794607 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 504/1009] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:12 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:12.811971 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0518f-ee45-4bd3-a501-035d67a263c9 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:12.850412 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:12.924132 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0518f-ee45-4bd3-a501-035d67a263c9 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:12.959482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c65f3-2fc7-4c22-95df-10c216a21bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:12.960314 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c65f3-2fc7-4c22-95df-10c216a21bbf None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:12.960553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c65f3-2fc7-4c22-95df-10c216a21bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:12.960823 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c65f3-2fc7-4c22-95df-10c216a21bbf None admin] PATH_INFO: `/v3/services/compute` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:12.961470 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c65f3-2fc7-4c22-95df-10c216a21bbf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:12.962978 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c65f3-2fc7-4c22-95df-10c216a21bbf None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:12.974424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-9b8c65f3-2fc7-4c22-95df-10c216a21bbf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:56:12.974424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:12.974424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:56:12.974424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:56:12.974424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:56:12.974424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:56:12.974424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:56:12.974424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:56:12.974424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:56:12.974424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:12.974424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:56:12.974424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:12.974424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:12.974424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:12.974424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:12.974424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:12.974424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:12.976502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:12.976502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:12.976502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:12.976502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:12.976502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:12.976502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:12.976502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:56:12.976502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:56:12.976502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:56:12.976502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:56:12.976502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:12.976502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:12.976502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:12.976502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:12.976502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:12.976502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:12.978251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:12.978251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:12.978251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:12.978251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:12.978251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:12.978251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:12.978251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:12.978251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:12.978251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:12.978251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:12.978251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:56:12.978251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:56:12.978251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:56:12.978251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:12.978251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 506/1010] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:56:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:12.986164 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf733747-d261-40ad-8345-be83d7cde0a6 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:13.105313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf733747-d261-40ad-8345-be83d7cde0a6 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:13.108619 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:13.148522 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c77caa-09af-45f5-a47f-71fd48d52056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:13.149197 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c77caa-09af-45f5-a47f-71fd48d52056 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:13.149485 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c77caa-09af-45f5-a47f-71fd48d52056 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:13.149820 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c77caa-09af-45f5-a47f-71fd48d52056 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:13.150560 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c77caa-09af-45f5-a47f-71fd48d52056 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:13.150883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c77caa-09af-45f5-a47f-71fd48d52056 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:13.152247 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c77caa-09af-45f5-a47f-71fd48d52056 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:13.157587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 505/1011] 10.222.0.79 () {56 vars in 1112 bytes} [Thu Jul 14 11:56:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:13.163064 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c65f3-2fc7-4c22-95df-10c216a21bbf None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:13.267781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:13.272535 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c65f3-2fc7-4c22-95df-10c216a21bbf None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:13.308979 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f86307-c221-4ae5-9937-4e046a6a726e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:13.309643 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f86307-c221-4ae5-9937-4e046a6a726e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:13.309931 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f86307-c221-4ae5-9937-4e046a6a726e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:13.310209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f86307-c221-4ae5-9937-4e046a6a726e None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:13.311050 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f86307-c221-4ae5-9937-4e046a6a726e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:13.311256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f86307-c221-4ae5-9937-4e046a6a726e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:13.312630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f86307-c221-4ae5-9937-4e046a6a726e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:13.318023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 507/1012] 10.222.0.79 () {56 vars in 1112 bytes} [Thu Jul 14 11:56:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:13.324178 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c77caa-09af-45f5-a47f-71fd48d52056 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:13.433636 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c77caa-09af-45f5-a47f-71fd48d52056 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:13.469713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a07467-f161-4359-97ad-419b33ba91bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:13.470375 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a07467-f161-4359-97ad-419b33ba91bc None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:13.470694 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a07467-f161-4359-97ad-419b33ba91bc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:13.470978 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a07467-f161-4359-97ad-419b33ba91bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:13.471729 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a07467-f161-4359-97ad-419b33ba91bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:13.473100 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a07467-f161-4359-97ad-419b33ba91bc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:13.498536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 506/1013] 10.222.0.79 () {60 vars in 1144 bytes} [Thu Jul 14 11:56:13 2022] POST /identity/v3/endpoints => generated 334 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:56:13.685899 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb15f41-bae3-49e1-b572-0ff110651628 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:13.686190 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb15f41-bae3-49e1-b572-0ff110651628 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:13.686470 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb15f41-bae3-49e1-b572-0ff110651628 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:13.688145 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 508/1014] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:13.693479 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f2e18-7a98-4e2b-b594-ecad0e6158c9 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:13.693777 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f2e18-7a98-4e2b-b594-ecad0e6158c9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:13.694061 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f2e18-7a98-4e2b-b594-ecad0e6158c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:13.711673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-321f2e18-7a98-4e2b-b594-ecad0e6158c9 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:13.713450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-321f2e18-7a98-4e2b-b594-ecad0e6158c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:13.735182 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:13.797552 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 507/1015] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:13 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:13.819949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb15f41-bae3-49e1-b572-0ff110651628 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:13.927255 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb15f41-bae3-49e1-b572-0ff110651628 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:13.962041 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17634388-eb99-42c8-9da4-e07c6d66c1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:13.963125 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17634388-eb99-42c8-9da4-e07c6d66c1d1 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:13.963403 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17634388-eb99-42c8-9da4-e07c6d66c1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:13.963670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17634388-eb99-42c8-9da4-e07c6d66c1d1 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:13.964384 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17634388-eb99-42c8-9da4-e07c6d66c1d1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:13.965758 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17634388-eb99-42c8-9da4-e07c6d66c1d1 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:13.981968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 509/1016] 10.222.0.79 () {60 vars in 1141 bytes} [Thu Jul 14 11:56:13 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:56:14.449114 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d74000-3daf-400c-8e50-d24a8b214c56 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:14.449634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d74000-3daf-400c-8e50-d24a8b214c56 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:14.449716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d74000-3daf-400c-8e50-d24a8b214c56 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:14.451256 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 508/1017] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:14.456294 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821ed3d-646f-4863-94f6-56d599cfd1fc None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:14.456724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821ed3d-646f-4863-94f6-56d599cfd1fc None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:14.456910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821ed3d-646f-4863-94f6-56d599cfd1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:14.474167 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-8821ed3d-646f-4863-94f6-56d599cfd1fc None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:14.475391 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-8821ed3d-646f-4863-94f6-56d599cfd1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:14.492343 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:14.553475 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 510/1018] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:14.576347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d74000-3daf-400c-8e50-d24a8b214c56 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:14.684103 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d74000-3daf-400c-8e50-d24a8b214c56 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:14.722900 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddca1ac-38dd-4f35-8aa8-554db5bb655b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:14.723616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddca1ac-38dd-4f35-8aa8-554db5bb655b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:14.723906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddca1ac-38dd-4f35-8aa8-554db5bb655b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:14.724176 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddca1ac-38dd-4f35-8aa8-554db5bb655b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:14.725362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddca1ac-38dd-4f35-8aa8-554db5bb655b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:14.726870 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddca1ac-38dd-4f35-8aa8-554db5bb655b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:14.734553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821ed3d-646f-4863-94f6-56d599cfd1fc None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:14.734977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 509/1019] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:56:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:14.840351 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821ed3d-646f-4863-94f6-56d599cfd1fc None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:14.875007 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00a2fe-c7e1-41fc-b7ca-04152a6b8330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:14.875719 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00a2fe-c7e1-41fc-b7ca-04152a6b8330 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:14.876003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00a2fe-c7e1-41fc-b7ca-04152a6b8330 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:14.876280 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00a2fe-c7e1-41fc-b7ca-04152a6b8330 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:14.877055 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00a2fe-c7e1-41fc-b7ca-04152a6b8330 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:14.878522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00a2fe-c7e1-41fc-b7ca-04152a6b8330 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:14.902850 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:14.918360 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 511/1020] 10.222.0.79 () {60 vars in 1141 bytes} [Thu Jul 14 11:56:14 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:56:15.689011 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b3a28-071d-4696-a13b-389282d066ad None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:15.689593 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b3a28-071d-4696-a13b-389282d066ad None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:15.689593 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b3a28-071d-4696-a13b-389282d066ad None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:15.691153 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 510/1021] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:15.696423 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed9dca-4bab-4749-acf0-af6113952537 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:15.696917 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed9dca-4bab-4749-acf0-af6113952537 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:15.697087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed9dca-4bab-4749-acf0-af6113952537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:15.714712 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-68ed9dca-4bab-4749-acf0-af6113952537 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:15.715919 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-68ed9dca-4bab-4749-acf0-af6113952537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:15.791366 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 512/1022] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:15.815479 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b3a28-071d-4696-a13b-389282d066ad None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:15.835862 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:15.921362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b3a28-071d-4696-a13b-389282d066ad None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:15.962732 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc9e02-9b93-465c-b652-cb3b83d5dee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:15.963444 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc9e02-9b93-465c-b652-cb3b83d5dee1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:15.963731 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc9e02-9b93-465c-b652-cb3b83d5dee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:15.964013 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc9e02-9b93-465c-b652-cb3b83d5dee1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:15.974412 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc9e02-9b93-465c-b652-cb3b83d5dee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:56:15.982614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-26fc9e02-9b93-465c-b652-cb3b83d5dee1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 11:56:15.982614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:15.982614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:15.982614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:15.982614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:15.982614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:15.982614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:15.982614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:15.982614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:15.982614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:15.982614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:15.982614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:15.982614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:56:15.982614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:56:15.982614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:56:15.982614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:56:15.983528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:56:15.983528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:56:15.983528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:56:15.983528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:56:15.983528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:15.983528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:15.983528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:15.983528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:15.983528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:15.983528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:15.983528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:15.983528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:15.983528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:15.983528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:15.983528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:15.983528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:15.984367 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:15.984367 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:15.984367 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:15.984367 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:15.984367 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:56:15.984367 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:56:15.984367 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:56:15.984367 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:56:15.984367 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:56:15.984367 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:56:15.984367 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 11:56:15.984367 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:15.986837 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 511/1023] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Jul 14 11:56:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:15.989982 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed9dca-4bab-4749-acf0-af6113952537 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:16.044132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a7538-3913-43bc-bb3e-e72a9acc5d28 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:16.044422 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a7538-3913-43bc-bb3e-e72a9acc5d28 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:16.044700 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a7538-3913-43bc-bb3e-e72a9acc5d28 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:16.046092 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 512/1024] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:56:16.051345 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d0ca1-7e75-45ca-95d2-2c7624ccea55 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:16.051639 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d0ca1-7e75-45ca-95d2-2c7624ccea55 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:16.051929 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d0ca1-7e75-45ca-95d2-2c7624ccea55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:16.073620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-672d0ca1-7e75-45ca-95d2-2c7624ccea55 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:16.074931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-672d0ca1-7e75-45ca-95d2-2c7624ccea55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:16.116345 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed9dca-4bab-4749-acf0-af6113952537 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:16.147589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 513/1025] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:56:16.151355 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:16.157445 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7389f3c-ea84-4d2d-9024-be14c8f3bdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:16.158120 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7389f3c-ea84-4d2d-9024-be14c8f3bdf0 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:16.158403 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7389f3c-ea84-4d2d-9024-be14c8f3bdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:16.158703 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7389f3c-ea84-4d2d-9024-be14c8f3bdf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:16.159464 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7389f3c-ea84-4d2d-9024-be14c8f3bdf0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:16.159760 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7389f3c-ea84-4d2d-9024-be14c8f3bdf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:16.161128 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7389f3c-ea84-4d2d-9024-be14c8f3bdf0 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:16.174711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d0ca1-7e75-45ca-95d2-2c7624ccea55 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:16.174904 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 513/1026] 10.222.0.79 () {56 vars in 1115 bytes} [Thu Jul 14 11:56:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:16.176679 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7389f3c-ea84-4d2d-9024-be14c8f3bdf0 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:16.181714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:16.289983 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7389f3c-ea84-4d2d-9024-be14c8f3bdf0 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:16.290385 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d0ca1-7e75-45ca-95d2-2c7624ccea55 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:16.326239 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397b02f-331f-41c3-900f-35d3343fce1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:16.327067 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397b02f-331f-41c3-900f-35d3343fce1e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:16.327348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397b02f-331f-41c3-900f-35d3343fce1e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:16.327619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397b02f-331f-41c3-900f-35d3343fce1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:16.331145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacbc58-41e9-434b-a5ef-2f9044747152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:16.332454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacbc58-41e9-434b-a5ef-2f9044747152 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:16.332961 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacbc58-41e9-434b-a5ef-2f9044747152 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:16.333442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacbc58-41e9-434b-a5ef-2f9044747152 None admin] PATH_INFO: `/v3/services/image` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:16.334308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacbc58-41e9-434b-a5ef-2f9044747152 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:16.335924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacbc58-41e9-434b-a5ef-2f9044747152 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:16.340670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397b02f-331f-41c3-900f-35d3343fce1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:16.342153 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397b02f-331f-41c3-900f-35d3343fce1e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:16.348769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-4cacbc58-41e9-434b-a5ef-2f9044747152 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:56:16.348769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:16.348769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:56:16.348769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:56:16.348769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:56:16.348769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:56:16.348769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:56:16.348769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:56:16.348769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:56:16.348769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:16.348769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:56:16.348769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:16.348769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:16.348769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:16.348769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:16.348769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:16.348769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:16.349986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:16.349986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:16.349986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:16.349986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:16.349986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:16.349986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:16.349986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:56:16.349986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:56:16.349986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:56:16.349986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:56:16.349986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:16.349986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:16.349986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:16.349986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:16.349986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:16.349986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:16.350849 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:16.350849 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:16.350849 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:16.350849 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:16.350849 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:16.350849 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:16.350849 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:16.350849 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:16.350849 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:16.350849 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:16.350849 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:56:16.350849 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:56:16.350849 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:56:16.350849 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:16.350849 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 514/1027] 10.222.0.79 () {56 vars in 1105 bytes} [Thu Jul 14 11:56:16 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:56:16.356921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacbc58-41e9-434b-a5ef-2f9044747152 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:16.365432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-1397b02f-331f-41c3-900f-35d3343fce1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:56:16.365432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:16.365432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:16.365432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:16.365432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:16.365432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:16.365432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:16.365432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:16.365432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:16.365432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:16.365432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:16.365432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:16.365432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:56:16.365432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:56:16.365432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:56:16.366335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:56:16.366335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:16.366335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:16.366335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:16.366335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:16.366335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:16.366335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:16.366335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:16.366335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:16.366335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:16.366335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:16.366335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:16.366335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:16.366335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:16.366335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:16.366335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:16.366335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:16.367430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:56:16.367430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:56:16.367430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:56:16.367430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:16.367430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 514/1028] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:56:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:56:16.373495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397b02f-331f-41c3-900f-35d3343fce1e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:16.423020 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:16.436045 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:16.471855 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacbc58-41e9-434b-a5ef-2f9044747152 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:16.483637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397b02f-331f-41c3-900f-35d3343fce1e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:16.515720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6dc68-beb6-4596-a693-a72d9f96e551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:16.516393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6dc68-beb6-4596-a693-a72d9f96e551 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:16.516884 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6dc68-beb6-4596-a693-a72d9f96e551 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:16.516997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6dc68-beb6-4596-a693-a72d9f96e551 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:16.517633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6dc68-beb6-4596-a693-a72d9f96e551 None admin] RBAC: Adding query filter params (name=image) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:16.517935 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6dc68-beb6-4596-a693-a72d9f96e551 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:16.519337 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6dc68-beb6-4596-a693-a72d9f96e551 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:16.521740 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e35ab-bb6f-4830-93f1-f56f69bfd539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:16.522406 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e35ab-bb6f-4830-93f1-f56f69bfd539 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:16.522721 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e35ab-bb6f-4830-93f1-f56f69bfd539 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:16.522999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e35ab-bb6f-4830-93f1-f56f69bfd539 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:16.523711 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e35ab-bb6f-4830-93f1-f56f69bfd539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:16.524022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e35ab-bb6f-4830-93f1-f56f69bfd539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:16.526004 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e35ab-bb6f-4830-93f1-f56f69bfd539 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:16.530203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 515/1029] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:56:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:16.531123 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6dc68-beb6-4596-a693-a72d9f96e551 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:16.543847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 515/1030] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:16.545998 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e35ab-bb6f-4830-93f1-f56f69bfd539 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:16.639035 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6dc68-beb6-4596-a693-a72d9f96e551 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:16.653704 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e35ab-bb6f-4830-93f1-f56f69bfd539 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:16.657151 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:16.677696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9068f46-b041-4d74-8374-d41aff90ced3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:16.678385 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9068f46-b041-4d74-8374-d41aff90ced3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:16.678706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9068f46-b041-4d74-8374-d41aff90ced3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:16.678989 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9068f46-b041-4d74-8374-d41aff90ced3 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:16.679707 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9068f46-b041-4d74-8374-d41aff90ced3 None admin] RBAC: Adding query filter params (type=image) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:16.680496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9068f46-b041-4d74-8374-d41aff90ced3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:16.681889 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9068f46-b041-4d74-8374-d41aff90ced3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:16.684333 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:16.692068 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 516/1031] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:56:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:16.694054 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9068f46-b041-4d74-8374-d41aff90ced3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:16.695649 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffdb11-22fc-427e-880d-f62d2af6f21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:16.696492 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffdb11-22fc-427e-880d-f62d2af6f21e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:16.697016 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffdb11-22fc-427e-880d-f62d2af6f21e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:16.697016 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffdb11-22fc-427e-880d-f62d2af6f21e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:16.704592 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dffdb11-22fc-427e-880d-f62d2af6f21e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:16.706057 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dffdb11-22fc-427e-880d-f62d2af6f21e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:16.721289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-5dffdb11-22fc-427e-880d-f62d2af6f21e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:56:16.721289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:16.721289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:16.721289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:16.721289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:16.721289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:16.721289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:16.721289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:16.721289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:16.721289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:16.721289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:16.721289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:16.721289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:56:16.721289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:56:16.721289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:56:16.721289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:56:16.722323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:16.722323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:16.722323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:56:16.722323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:56:16.722323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:56:16.722323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:56:16.722323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:16.722323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:16.722323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:16.722323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:16.722323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:16.722323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:16.722323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:16.722323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:16.722323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:16.722323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:16.722323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:16.722323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:16.723288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:16.723288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:16.723288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:56:16.723288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:56:16.723288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:56:16.723288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:56:16.723288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:56:16.723288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:56:16.723288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:56:16.723288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:16.723288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 516/1032] 10.222.0.79 () {56 vars in 1093 bytes} [Thu Jul 14 11:56:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:56:16.729026 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffdb11-22fc-427e-880d-f62d2af6f21e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:16.812559 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9068f46-b041-4d74-8374-d41aff90ced3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:16.845435 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffdb11-22fc-427e-880d-f62d2af6f21e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:16.849213 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a01c55-f76d-42b9-adff-7cd7fa186c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:16.849884 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a01c55-f76d-42b9-adff-7cd7fa186c22 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:16.850169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a01c55-f76d-42b9-adff-7cd7fa186c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:16.850446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a01c55-f76d-42b9-adff-7cd7fa186c22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:16.851287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a01c55-f76d-42b9-adff-7cd7fa186c22 None admin] RBAC: Adding query filter params (interface=public, service_id=cf88fda4b249470693caa69e25199a41, region_id=RegionOne) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:16.851602 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a01c55-f76d-42b9-adff-7cd7fa186c22 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:16.853013 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a01c55-f76d-42b9-adff-7cd7fa186c22 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:16.863092 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 517/1033] 10.222.0.79 () {56 vars in 1251 bytes} [Thu Jul 14 11:56:16 2022] GET /identity/v3/endpoints?service_id=cf88fda4b249470693caa69e25199a41&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:16.864731 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a01c55-f76d-42b9-adff-7cd7fa186c22 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:16.881697 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ab76f-f46f-4ed1-bf02-37847efd8f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:16.882382 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ab76f-f46f-4ed1-bf02-37847efd8f55 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:16.882699 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ab76f-f46f-4ed1-bf02-37847efd8f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:16.882984 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ab76f-f46f-4ed1-bf02-37847efd8f55 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:16.883828 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ab76f-f46f-4ed1-bf02-37847efd8f55 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:16.884666 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ab76f-f46f-4ed1-bf02-37847efd8f55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:16.886102 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ab76f-f46f-4ed1-bf02-37847efd8f55 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:16.905479 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 517/1034] 10.222.0.79 () {56 vars in 1133 bytes} [Thu Jul 14 11:56:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:16.911075 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ab76f-f46f-4ed1-bf02-37847efd8f55 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:16.932897 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:16.935212 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:16.978516 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a01c55-f76d-42b9-adff-7cd7fa186c22 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:17.014140 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a9ca8-fd9e-4366-8c6e-9b8990e95bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:17.014838 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a9ca8-fd9e-4366-8c6e-9b8990e95bca None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:17.015127 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a9ca8-fd9e-4366-8c6e-9b8990e95bca None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:17.015404 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a9ca8-fd9e-4366-8c6e-9b8990e95bca None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:17.016086 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a9ca8-fd9e-4366-8c6e-9b8990e95bca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:17.017441 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a9ca8-fd9e-4366-8c6e-9b8990e95bca None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:17.019212 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ab76f-f46f-4ed1-bf02-37847efd8f55 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:17.024071 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 518/1035] 10.222.0.79 () {56 vars in 1087 bytes} [Thu Jul 14 11:56:16 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:56:17.025995 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf90ba-629e-49af-8821-9b966f88fb0d None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:17.026281 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf90ba-629e-49af-8821-9b966f88fb0d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:17.026584 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf90ba-629e-49af-8821-9b966f88fb0d None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:17.028090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 519/1036] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:17.033794 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8125d-b86f-4f3d-969b-e48f2c6c1794 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:17.034088 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8125d-b86f-4f3d-969b-e48f2c6c1794 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:17.034377 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8125d-b86f-4f3d-969b-e48f2c6c1794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:17.052693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-8fc8125d-b86f-4f3d-969b-e48f2c6c1794 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:17.053943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8fc8125d-b86f-4f3d-969b-e48f2c6c1794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:17.059861 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533da353-79a5-49ca-8f3e-c0be1ab7b05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:17.060532 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533da353-79a5-49ca-8f3e-c0be1ab7b05c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:17.060814 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533da353-79a5-49ca-8f3e-c0be1ab7b05c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:17.061096 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533da353-79a5-49ca-8f3e-c0be1ab7b05c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:17.138057 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 520/1037] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:17.156074 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533da353-79a5-49ca-8f3e-c0be1ab7b05c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:17.157564 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533da353-79a5-49ca-8f3e-c0be1ab7b05c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:17.163879 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8125d-b86f-4f3d-969b-e48f2c6c1794 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:17.187776 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:17.235941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:17.269861 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 518/1038] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:56:16 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 11:56:17.276333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533da353-79a5-49ca-8f3e-c0be1ab7b05c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:17.284138 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8125d-b86f-4f3d-969b-e48f2c6c1794 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:17.319928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38b32e-05cb-49c1-a604-1be533916399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:17.320780 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38b32e-05cb-49c1-a604-1be533916399 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:17.321063 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38b32e-05cb-49c1-a604-1be533916399 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:17.321336 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38b32e-05cb-49c1-a604-1be533916399 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:17.322525 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38b32e-05cb-49c1-a604-1be533916399 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:17.324516 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38b32e-05cb-49c1-a604-1be533916399 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:17.326532 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 521/1039] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:56:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:17.331190 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38b32e-05cb-49c1-a604-1be533916399 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:17.394546 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533da353-79a5-49ca-8f3e-c0be1ab7b05c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:17.423592 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:17.439591 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd4a2e-0c2a-424e-a2d7-ac7e32c8943b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:17.440777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd4a2e-0c2a-424e-a2d7-ac7e32c8943b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:17.441285 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd4a2e-0c2a-424e-a2d7-ac7e32c8943b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:17.441565 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd4a2e-0c2a-424e-a2d7-ac7e32c8943b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:17.447851 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38b32e-05cb-49c1-a604-1be533916399 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:17.453197 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd4a2e-0c2a-424e-a2d7-ac7e32c8943b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:17.454792 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd4a2e-0c2a-424e-a2d7-ac7e32c8943b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:17.472434 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-f1cd4a2e-0c2a-424e-a2d7-ac7e32c8943b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:56:17.472434 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:17.472434 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:17.472434 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:17.472434 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:17.472434 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:17.472434 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:17.472434 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:17.472434 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:17.472434 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:17.472434 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:17.472434 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:17.472434 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:56:17.472434 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:56:17.472434 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:56:17.473523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:56:17.473523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:17.473523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:17.473523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:17.473523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:17.473523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:17.473523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:17.473523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:17.473523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:17.473523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:17.473523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:17.473523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:17.473523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:17.473523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:17.473523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:17.473523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:17.473523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:17.475435 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:56:17.475435 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:56:17.475435 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:56:17.475435 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:17.475435 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 519/1040] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:56:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:56:17.479451 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd4a2e-0c2a-424e-a2d7-ac7e32c8943b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:17.483962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:17.495623 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753c392-1dff-4eb1-9e0e-7f61923e348b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:17.496307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753c392-1dff-4eb1-9e0e-7f61923e348b None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:17.496679 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753c392-1dff-4eb1-9e0e-7f61923e348b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:17.496933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753c392-1dff-4eb1-9e0e-7f61923e348b None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:17.497605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753c392-1dff-4eb1-9e0e-7f61923e348b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:17.500146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753c392-1dff-4eb1-9e0e-7f61923e348b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:17.524131 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 522/1041] 10.222.0.79 () {60 vars in 1132 bytes} [Thu Jul 14 11:56:17 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:56:17.601756 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd4a2e-0c2a-424e-a2d7-ac7e32c8943b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:17.640215 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206c236-eca1-4700-a955-b97b231f23ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:17.641252 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206c236-eca1-4700-a955-b97b231f23ea None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:17.641737 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206c236-eca1-4700-a955-b97b231f23ea None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:17.642233 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206c236-eca1-4700-a955-b97b231f23ea None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:17.643206 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206c236-eca1-4700-a955-b97b231f23ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:17.643726 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206c236-eca1-4700-a955-b97b231f23ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:17.645394 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206c236-eca1-4700-a955-b97b231f23ea None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:17.658611 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 520/1042] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:17.664633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753c392-1dff-4eb1-9e0e-7f61923e348b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:17.779048 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753c392-1dff-4eb1-9e0e-7f61923e348b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:17.815190 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a5e0a-0ebf-4204-a5d4-24b7ac475bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:17.815989 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a5e0a-0ebf-4204-a5d4-24b7ac475bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:17.816275 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a5e0a-0ebf-4204-a5d4-24b7ac475bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:17.816554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a5e0a-0ebf-4204-a5d4-24b7ac475bb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:17.823541 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a5e0a-0ebf-4204-a5d4-24b7ac475bb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:17.824982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a5e0a-0ebf-4204-a5d4-24b7ac475bb1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:17.839308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-7b0a5e0a-0ebf-4204-a5d4-24b7ac475bb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:56:17.839308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:17.839308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:17.839308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:17.839308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:17.839308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:17.839308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:17.839308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:17.839308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:17.839308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:17.839308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:17.839308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:17.839308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:56:17.839308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:56:17.839308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:56:17.840193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:56:17.840193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:17.840193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:17.840193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:17.840193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:17.840193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:17.840193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:17.840193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:17.840193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:17.840193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:17.840193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:17.840193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:17.840193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:17.840193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:17.840193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:17.840193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:17.840193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:17.841160 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:56:17.841160 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:56:17.841160 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:56:17.841160 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:56:17.841160 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:56:17.841160 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:56:17.841160 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:56:17.841160 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:17.842563 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 523/1043] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:56:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:17.846895 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206c236-eca1-4700-a955-b97b231f23ea None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:17.883552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:17.952198 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206c236-eca1-4700-a955-b97b231f23ea None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:17.986322 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca315a0-1943-435b-a91f-e85f28be6793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:17.987013 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca315a0-1943-435b-a91f-e85f28be6793 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:17.987302 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca315a0-1943-435b-a91f-e85f28be6793 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:17.987579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca315a0-1943-435b-a91f-e85f28be6793 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:17.988371 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca315a0-1943-435b-a91f-e85f28be6793 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:17.988686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca315a0-1943-435b-a91f-e85f28be6793 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:17.990125 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca315a0-1943-435b-a91f-e85f28be6793 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:18.002570 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 521/1044] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:56:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:18.008807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a5e0a-0ebf-4204-a5d4-24b7ac475bb1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:18.063688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:18.137062 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a5e0a-0ebf-4204-a5d4-24b7ac475bb1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:18.174222 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41741bd1-0899-49e5-8fad-b76a18b0e83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:18.174922 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41741bd1-0899-49e5-8fad-b76a18b0e83d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:18.175279 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41741bd1-0899-49e5-8fad-b76a18b0e83d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:18.175484 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41741bd1-0899-49e5-8fad-b76a18b0e83d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:18.176578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41741bd1-0899-49e5-8fad-b76a18b0e83d None admin] RBAC: Adding query filter params (role.id=bfa252f4a7a643c7972c78c6ef2604fe, scope.project.id=66f531bc924b41faa64743923afac319, user.id=e41a4d3a822c403fad048764a0edf209) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:18.176897 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41741bd1-0899-49e5-8fad-b76a18b0e83d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:18.178323 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41741bd1-0899-49e5-8fad-b76a18b0e83d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:18.190595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 524/1045] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:56:18 2022] GET /identity/v3/role_assignments?user.id=e41a4d3a822c403fad048764a0edf209&scope.project.id=66f531bc924b41faa64743923afac319&role.id=bfa252f4a7a643c7972c78c6ef2604fe => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:19.099300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a336fa-6165-49a1-b9dd-e05bee14e49d None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:19.099816 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a336fa-6165-49a1-b9dd-e05bee14e49d None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:19.099816 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a336fa-6165-49a1-b9dd-e05bee14e49d None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:19.101198 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 522/1046] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:19.107880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40f4fe-068d-4cae-bab3-130a5c5d4e89 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:19.108519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40f4fe-068d-4cae-bab3-130a5c5d4e89 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:19.108519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40f4fe-068d-4cae-bab3-130a5c5d4e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:19.127509 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6f40f4fe-068d-4cae-bab3-130a5c5d4e89 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:19.128849 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6f40f4fe-068d-4cae-bab3-130a5c5d4e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:19.205972 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 525/1047] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:19.230753 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a336fa-6165-49a1-b9dd-e05bee14e49d None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:19.333202 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:19.343158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a336fa-6165-49a1-b9dd-e05bee14e49d None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:19.378255 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c114145-2c7d-4bd1-b5a8-fa5a3f1fadff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:19.378993 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c114145-2c7d-4bd1-b5a8-fa5a3f1fadff None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:19.379280 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c114145-2c7d-4bd1-b5a8-fa5a3f1fadff None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:19.379557 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c114145-2c7d-4bd1-b5a8-fa5a3f1fadff None admin] PATH_INFO: `/v3/services/image` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:19.380216 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c114145-2c7d-4bd1-b5a8-fa5a3f1fadff None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:19.381595 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c114145-2c7d-4bd1-b5a8-fa5a3f1fadff None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:19.393800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-4c114145-2c7d-4bd1-b5a8-fa5a3f1fadff None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:56:19.393800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:19.393800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:56:19.393800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:56:19.393800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:56:19.393800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:56:19.393800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:56:19.393800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:56:19.393800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:56:19.393800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:19.393800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:56:19.393800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:19.393800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:19.393800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:19.393800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:19.393800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:19.393800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:19.394847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:19.394847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:19.394847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:19.394847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:19.394847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:19.394847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:19.394847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:56:19.394847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:56:19.394847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:56:19.394847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:56:19.394847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:19.394847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:19.394847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:19.394847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:19.394847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:19.394847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:19.395688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:19.395688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:19.395688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:19.395688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:19.395688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:19.395688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:19.395688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:19.395688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:19.395688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:19.395688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:19.395688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:56:19.395688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:56:19.395688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:56:19.395688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:19.395688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 523/1048] 10.222.0.79 () {56 vars in 1105 bytes} [Thu Jul 14 11:56:19 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:19.402402 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40f4fe-068d-4cae-bab3-130a5c5d4e89 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:19.440810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:19.510465 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40f4fe-068d-4cae-bab3-130a5c5d4e89 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:19.544387 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d77f2f-98c5-407d-85bc-5c4b420f7078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:19.545062 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d77f2f-98c5-407d-85bc-5c4b420f7078 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:19.545347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d77f2f-98c5-407d-85bc-5c4b420f7078 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:19.545627 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d77f2f-98c5-407d-85bc-5c4b420f7078 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:19.546343 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d77f2f-98c5-407d-85bc-5c4b420f7078 None admin] RBAC: Adding query filter params (name=image) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:19.546683 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d77f2f-98c5-407d-85bc-5c4b420f7078 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:19.548050 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d77f2f-98c5-407d-85bc-5c4b420f7078 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:19.558556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 526/1049] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:56:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:19.559605 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c114145-2c7d-4bd1-b5a8-fa5a3f1fadff None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:19.645719 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9aa7f-a1ad-434a-a94e-802b9980ccfe None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:19.645910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9aa7f-a1ad-434a-a94e-802b9980ccfe None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:19.646201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9aa7f-a1ad-434a-a94e-802b9980ccfe None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:19.647910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 527/1050] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:56:19.653483 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db06d8-94b5-41e3-a0d7-fd6d6e6c6c2a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:19.653800 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db06d8-94b5-41e3-a0d7-fd6d6e6c6c2a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:19.654036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db06d8-94b5-41e3-a0d7-fd6d6e6c6c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:19.663955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c114145-2c7d-4bd1-b5a8-fa5a3f1fadff None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:19.671626 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-45db06d8-94b5-41e3-a0d7-fd6d6e6c6c2a None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:19.672825 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-45db06d8-94b5-41e3-a0d7-fd6d6e6c6c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:19.705935 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a40772-780c-4af1-99e5-26fd2ae49cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:19.706889 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a40772-780c-4af1-99e5-26fd2ae49cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:19.707352 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a40772-780c-4af1-99e5-26fd2ae49cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:19.707775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a40772-780c-4af1-99e5-26fd2ae49cc2 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:19.708624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a40772-780c-4af1-99e5-26fd2ae49cc2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:19.709075 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a40772-780c-4af1-99e5-26fd2ae49cc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:19.710634 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a40772-780c-4af1-99e5-26fd2ae49cc2 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:19.717107 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 524/1051] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:56:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:19.722749 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a40772-780c-4af1-99e5-26fd2ae49cc2 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:19.752110 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:19.760549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 528/1052] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:56:19.784407 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db06d8-94b5-41e3-a0d7-fd6d6e6c6c2a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:19.827251 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:19.839884 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a40772-780c-4af1-99e5-26fd2ae49cc2 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:19.874773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eeeb0c-4557-431d-bd27-3b59c8fd6e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:19.875439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eeeb0c-4557-431d-bd27-3b59c8fd6e91 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:19.875724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eeeb0c-4557-431d-bd27-3b59c8fd6e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:19.875996 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eeeb0c-4557-431d-bd27-3b59c8fd6e91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:19.876725 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eeeb0c-4557-431d-bd27-3b59c8fd6e91 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:19.878097 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eeeb0c-4557-431d-bd27-3b59c8fd6e91 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:19.898455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 525/1053] 10.222.0.79 () {60 vars in 1144 bytes} [Thu Jul 14 11:56:19 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:56:19.921979 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db06d8-94b5-41e3-a0d7-fd6d6e6c6c2a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:19.967760 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4039d7b-5d0a-4539-8e22-6fec18255087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:19.968569 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4039d7b-5d0a-4539-8e22-6fec18255087 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:19.968863 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4039d7b-5d0a-4539-8e22-6fec18255087 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:19.969132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4039d7b-5d0a-4539-8e22-6fec18255087 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:19.980963 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4039d7b-5d0a-4539-8e22-6fec18255087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:56:19.988869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-e4039d7b-5d0a-4539-8e22-6fec18255087 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:56:19.988869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:19.988869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:19.988869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:19.988869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:19.988869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:19.988869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:19.988869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:19.988869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:19.988869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:19.988869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:19.988869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:19.988869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:56:19.988869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:56:19.988869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:56:19.988869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:56:19.989969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:56:19.989969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:56:19.989969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:56:19.989969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:56:19.989969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:19.989969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:19.989969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:19.989969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:19.989969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:19.989969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:19.989969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:19.989969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:19.989969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:19.989969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:19.989969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:19.989969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:19.991136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:19.991136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:19.991136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:19.991136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:19.991136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:56:19.991136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:56:19.991136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:56:19.991136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:56:19.991136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:56:19.991136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:56:19.991136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:56:19.991136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:19.991136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 529/1054] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:56:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:56:19.996424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eeeb0c-4557-431d-bd27-3b59c8fd6e91 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:20.095213 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:20.122237 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eeeb0c-4557-431d-bd27-3b59c8fd6e91 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:20.158937 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa719c-bc28-48b2-bfb7-266542ed9002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:20.159526 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa719c-bc28-48b2-bfb7-266542ed9002 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:20.159808 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa719c-bc28-48b2-bfb7-266542ed9002 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:20.160080 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa719c-bc28-48b2-bfb7-266542ed9002 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:20.160821 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa719c-bc28-48b2-bfb7-266542ed9002 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:20.161127 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa719c-bc28-48b2-bfb7-266542ed9002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:20.162524 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa719c-bc28-48b2-bfb7-266542ed9002 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:20.175914 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 526/1055] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:56:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:20.177528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4039d7b-5d0a-4539-8e22-6fec18255087 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:20.243799 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5fed2-07a0-4420-a911-4f6f0a71433e None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:20.244175 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5fed2-07a0-4420-a911-4f6f0a71433e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:20.244368 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5fed2-07a0-4420-a911-4f6f0a71433e None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:20.245763 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 527/1056] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:56:20.251000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de29ecf-4b35-4ca4-8cf5-59fd2613cdc1 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:20.251294 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de29ecf-4b35-4ca4-8cf5-59fd2613cdc1 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:20.251578 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de29ecf-4b35-4ca4-8cf5-59fd2613cdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:20.268736 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-3de29ecf-4b35-4ca4-8cf5-59fd2613cdc1 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:20.269937 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-3de29ecf-4b35-4ca4-8cf5-59fd2613cdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:20.274414 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:20.292003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4039d7b-5d0a-4539-8e22-6fec18255087 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:20.329662 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46c9aa-8810-4498-b417-0928ef3fb64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:20.330579 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46c9aa-8810-4498-b417-0928ef3fb64b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:20.330871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46c9aa-8810-4498-b417-0928ef3fb64b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:20.331148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46c9aa-8810-4498-b417-0928ef3fb64b None admin] PATH_INFO: `/v3/users/fc8f214a137c428f808f99eb8fd1c4f6` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:20.342302 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 528/1057] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:56:20.347260 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46c9aa-8810-4498-b417-0928ef3fb64b None admin] RBAC: Authorizing `identity:get_user(user_id=fc8f214a137c428f808f99eb8fd1c4f6)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:20.348723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46c9aa-8810-4498-b417-0928ef3fb64b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:20.355174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 530/1058] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:56:20 2022] GET /identity/v3/users/fc8f214a137c428f808f99eb8fd1c4f6 => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:20.356321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de29ecf-4b35-4ca4-8cf5-59fd2613cdc1 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:20.366411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46c9aa-8810-4498-b417-0928ef3fb64b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:20.434296 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:20.466285 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de29ecf-4b35-4ca4-8cf5-59fd2613cdc1 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:20.484276 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46c9aa-8810-4498-b417-0928ef3fb64b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:20.504257 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c610b93-a827-4024-9d32-aa8b145e2748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:20.504919 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c610b93-a827-4024-9d32-aa8b145e2748 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:20.505210 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c610b93-a827-4024-9d32-aa8b145e2748 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:20.505492 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c610b93-a827-4024-9d32-aa8b145e2748 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:20.523948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316756e-21e7-4337-ab72-44c4ab40740d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:20.525188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316756e-21e7-4337-ab72-44c4ab40740d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:20.525479 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316756e-21e7-4337-ab72-44c4ab40740d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:20.525761 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316756e-21e7-4337-ab72-44c4ab40740d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:20.536709 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316756e-21e7-4337-ab72-44c4ab40740d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:56:20.545550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-9316756e-21e7-4337-ab72-44c4ab40740d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 11:56:20.545550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:20.545550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:20.545550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:20.545550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:20.545550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:20.545550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:20.545550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:20.545550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:20.545550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:20.545550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:20.545550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:20.545550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:56:20.545550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:56:20.545550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:56:20.545550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:56:20.546748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:56:20.546748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:56:20.546748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:56:20.546748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:56:20.546748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:20.546748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:20.546748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:20.546748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:20.546748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:20.546748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:20.546748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:20.546748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:20.546748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:20.546748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:20.546748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:20.546748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:20.547616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:20.547616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:20.547616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:20.547616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:20.547616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:56:20.547616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:56:20.547616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:56:20.547616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:56:20.547616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:56:20.547616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:56:20.547616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 11:56:20.547616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:20.552557 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 531/1059] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Jul 14 11:56:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:56:20.553292 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316756e-21e7-4337-ab72-44c4ab40740d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:20.558216 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:20.583070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c610b93-a827-4024-9d32-aa8b145e2748 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:20.584535 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c610b93-a827-4024-9d32-aa8b145e2748 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:20.657085 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:20.671518 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316756e-21e7-4337-ab72-44c4ab40740d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:20.694787 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 529/1060] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:56:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:56:20.700724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c610b93-a827-4024-9d32-aa8b145e2748 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:20.719034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c4f28-86bb-431e-bd10-1138cd274f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:20.719718 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c4f28-86bb-431e-bd10-1138cd274f07 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:20.720002 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c4f28-86bb-431e-bd10-1138cd274f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:20.720332 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c4f28-86bb-431e-bd10-1138cd274f07 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:20.721095 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c4f28-86bb-431e-bd10-1138cd274f07 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:20.721410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c4f28-86bb-431e-bd10-1138cd274f07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:20.722874 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c4f28-86bb-431e-bd10-1138cd274f07 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:20.740570 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 532/1061] 10.222.0.79 () {56 vars in 1115 bytes} [Thu Jul 14 11:56:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:20.741765 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c4f28-86bb-431e-bd10-1138cd274f07 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:20.816090 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c610b93-a827-4024-9d32-aa8b145e2748 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:20.816341 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:20.853675 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbcab46-68ba-4069-9901-60bdfbed4205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:20.854556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcab46-68ba-4069-9901-60bdfbed4205 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:20.854763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c4f28-86bb-431e-bd10-1138cd274f07 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:20.854887 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcab46-68ba-4069-9901-60bdfbed4205 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:20.855113 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcab46-68ba-4069-9901-60bdfbed4205 None admin] PATH_INFO: `/v3/projects/1fc40bff90154069b70b61257d88aee6` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:20.856315 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbcab46-68ba-4069-9901-60bdfbed4205 None admin] RBAC: Authorizing `identity:get_project(project_id=1fc40bff90154069b70b61257d88aee6)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:20.857789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbcab46-68ba-4069-9901-60bdfbed4205 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:20.862521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 530/1062] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:56:20 2022] GET /identity/v3/projects/1fc40bff90154069b70b61257d88aee6 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:20.865440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbcab46-68ba-4069-9901-60bdfbed4205 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:20.897434 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b01a9b-f38d-4f24-a72f-6c51a753744e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:20.898239 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b01a9b-f38d-4f24-a72f-6c51a753744e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:20.898563 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b01a9b-f38d-4f24-a72f-6c51a753744e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:20.898844 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b01a9b-f38d-4f24-a72f-6c51a753744e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:20.909747 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:20.911638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b01a9b-f38d-4f24-a72f-6c51a753744e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:20.913393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b01a9b-f38d-4f24-a72f-6c51a753744e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:20.932102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-c5b01a9b-f38d-4f24-a72f-6c51a753744e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:56:20.932102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:20.932102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:20.932102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:20.932102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:20.932102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:20.932102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:20.932102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:20.932102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:20.932102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:20.932102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:20.932102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:20.932102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:56:20.932102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:56:20.932102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:56:20.938174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:56:20.938174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:20.938174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:20.938174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:20.938174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:20.938174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:20.938174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:20.938174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:20.938174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:20.938174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:20.938174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:20.938174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:20.938174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:20.938174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:20.938174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:20.938174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:20.938174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:20.939166 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:56:20.939166 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:56:20.939166 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:56:20.939166 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:20.939166 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 533/1063] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:56:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:20.939166 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b01a9b-f38d-4f24-a72f-6c51a753744e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:20.983126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbcab46-68ba-4069-9901-60bdfbed4205 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:21.018142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc26ac-47ef-4bf8-b591-58ae8b263f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:21.018832 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc26ac-47ef-4bf8-b591-58ae8b263f0d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:21.019117 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc26ac-47ef-4bf8-b591-58ae8b263f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:21.019393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc26ac-47ef-4bf8-b591-58ae8b263f0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:21.020225 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc26ac-47ef-4bf8-b591-58ae8b263f0d None admin] RBAC: Adding query filter params (role.id=eff4f9bbb7064bc1a0f9fc55a05fea51, scope.project.id=1fc40bff90154069b70b61257d88aee6, user.id=fc8f214a137c428f808f99eb8fd1c4f6) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:21.020541 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc26ac-47ef-4bf8-b591-58ae8b263f0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:21.021984 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc26ac-47ef-4bf8-b591-58ae8b263f0d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:21.028984 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 531/1064] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:56:20 2022] GET /identity/v3/role_assignments?user.id=fc8f214a137c428f808f99eb8fd1c4f6&scope.project.id=1fc40bff90154069b70b61257d88aee6&role.id=eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:21.052336 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b01a9b-f38d-4f24-a72f-6c51a753744e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:21.073846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:21.095426 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58076ba-ac11-40f2-a7ab-8fb49b0130fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:21.096114 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58076ba-ac11-40f2-a7ab-8fb49b0130fb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:21.096400 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58076ba-ac11-40f2-a7ab-8fb49b0130fb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:21.096675 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58076ba-ac11-40f2-a7ab-8fb49b0130fb None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:21.097416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58076ba-ac11-40f2-a7ab-8fb49b0130fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:21.097729 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58076ba-ac11-40f2-a7ab-8fb49b0130fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:21.099226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58076ba-ac11-40f2-a7ab-8fb49b0130fb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:21.119290 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 534/1065] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:21.120185 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc26ac-47ef-4bf8-b591-58ae8b263f0d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:21.239322 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc26ac-47ef-4bf8-b591-58ae8b263f0d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:21.241023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:21.276246 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a0c02-79f9-4d49-8185-03218cb8918c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:21.277039 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a0c02-79f9-4d49-8185-03218cb8918c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:21.277325 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a0c02-79f9-4d49-8185-03218cb8918c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:21.277605 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a0c02-79f9-4d49-8185-03218cb8918c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:21.285058 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a0c02-79f9-4d49-8185-03218cb8918c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:21.286543 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a0c02-79f9-4d49-8185-03218cb8918c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:21.301896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-243a0c02-79f9-4d49-8185-03218cb8918c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:56:21.301896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:21.301896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:21.301896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:21.301896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:21.301896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:21.301896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:21.301896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:21.301896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:21.301896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:21.301896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:21.301896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:21.301896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:56:21.301896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:56:21.301896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:56:21.301896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:56:21.303192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:21.303192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:21.303192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:56:21.303192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:56:21.303192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:56:21.303192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:56:21.303192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:21.303192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:21.303192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:21.303192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:21.303192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:21.303192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:21.303192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:21.303192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:21.303192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:21.303192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:21.303192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:21.303192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:21.304144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:21.304144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:21.304144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:56:21.304144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:56:21.304144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:56:21.304144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:56:21.304144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:56:21.304144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:56:21.304144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:56:21.304144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:21.304144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 532/1066] 10.222.0.79 () {56 vars in 1093 bytes} [Thu Jul 14 11:56:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:21.308802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58076ba-ac11-40f2-a7ab-8fb49b0130fb None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:21.414024 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58076ba-ac11-40f2-a7ab-8fb49b0130fb None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:21.454433 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b3ee9-ab1f-4d5f-8acd-e6d47700fe14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:21.455138 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b3ee9-ab1f-4d5f-8acd-e6d47700fe14 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:21.455423 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b3ee9-ab1f-4d5f-8acd-e6d47700fe14 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:21.455698 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b3ee9-ab1f-4d5f-8acd-e6d47700fe14 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:21.456542 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b3ee9-ab1f-4d5f-8acd-e6d47700fe14 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:21.456852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b3ee9-ab1f-4d5f-8acd-e6d47700fe14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:21.458354 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b3ee9-ab1f-4d5f-8acd-e6d47700fe14 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:21.484831 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 535/1067] 10.222.0.79 () {56 vars in 1133 bytes} [Thu Jul 14 11:56:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:21.487506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a0c02-79f9-4d49-8185-03218cb8918c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:21.591204 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a0c02-79f9-4d49-8185-03218cb8918c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:21.628671 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bd0ab-5e27-4744-a9c5-bf8a3a202b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:21.629464 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bd0ab-5e27-4744-a9c5-bf8a3a202b71 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:21.629748 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bd0ab-5e27-4744-a9c5-bf8a3a202b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:21.630074 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bd0ab-5e27-4744-a9c5-bf8a3a202b71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:21.640540 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851bd0ab-5e27-4744-a9c5-bf8a3a202b71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:21.642001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851bd0ab-5e27-4744-a9c5-bf8a3a202b71 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:21.660263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-851bd0ab-5e27-4744-a9c5-bf8a3a202b71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:56:21.660263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:21.660263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:21.660263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:21.660263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:21.660263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:21.660263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:21.660263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:21.660263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:21.660263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:21.660263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:21.660263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:21.660263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:56:21.660263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:56:21.660263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:56:21.661426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:56:21.661426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:21.661426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:21.661426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:21.661426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:21.661426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:21.661426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:21.661426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:21.661426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:21.661426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:21.661426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:21.661426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:21.661426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:21.661426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:21.661426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:21.661426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:21.661426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:21.662314 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:56:21.662314 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:56:21.662314 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:56:21.662314 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:21.666880 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 533/1068] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:56:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:21.668130 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b3ee9-ab1f-4d5f-8acd-e6d47700fe14 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:21.706876 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:21.787063 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b3ee9-ab1f-4d5f-8acd-e6d47700fe14 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:21.823885 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0b922-ae70-486c-97ca-cc8b13b76cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:21.824555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0b922-ae70-486c-97ca-cc8b13b76cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:21.824835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0b922-ae70-486c-97ca-cc8b13b76cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:21.825108 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0b922-ae70-486c-97ca-cc8b13b76cc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:21.825831 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0b922-ae70-486c-97ca-cc8b13b76cc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:21.826135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0b922-ae70-486c-97ca-cc8b13b76cc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:21.827600 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0b922-ae70-486c-97ca-cc8b13b76cc7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:21.844949 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 536/1069] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:21.846307 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bd0ab-5e27-4744-a9c5-bf8a3a202b71 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:21.863229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:21.958520 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bd0ab-5e27-4744-a9c5-bf8a3a202b71 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:21.995533 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458fd40-3dfc-4741-aa6a-46b4aa147f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:21.996358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458fd40-3dfc-4741-aa6a-46b4aa147f2e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:21.996640 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458fd40-3dfc-4741-aa6a-46b4aa147f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:21.996914 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458fd40-3dfc-4741-aa6a-46b4aa147f2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:22.004716 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458fd40-3dfc-4741-aa6a-46b4aa147f2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:22.006209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458fd40-3dfc-4741-aa6a-46b4aa147f2e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:22.010371 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1a341-b346-49fa-a70f-5f0038a15c7c None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:22.010703 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1a341-b346-49fa-a70f-5f0038a15c7c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:22.010970 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1a341-b346-49fa-a70f-5f0038a15c7c None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:22.013470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 537/1070] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:56:22.018366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd096e70-f653-4dba-9ade-4523e7db4173 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:22.018713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd096e70-f653-4dba-9ade-4523e7db4173 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:22.018985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd096e70-f653-4dba-9ade-4523e7db4173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:22.021845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-d458fd40-3dfc-4741-aa6a-46b4aa147f2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:56:22.021845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:22.021845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:22.021845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:22.021845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:22.021845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:22.021845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:22.021845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:22.021845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:22.021845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:22.021845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:22.021845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:22.021845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:56:22.021845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:56:22.021845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:56:22.022793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:56:22.022793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:22.022793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:22.022793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:22.022793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:22.022793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:22.022793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:22.022793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:22.022793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:22.022793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:22.022793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:22.022793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:22.022793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:22.022793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:22.022793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:22.022793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:22.022793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:22.023707 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:56:22.023707 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:56:22.023707 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:56:22.023707 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:56:22.023707 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:56:22.023707 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:56:22.023707 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:56:22.023707 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:22.023707 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 534/1071] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:56:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:22.029118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458fd40-3dfc-4741-aa6a-46b4aa147f2e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:22.039911 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-cd096e70-f653-4dba-9ade-4523e7db4173 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:22.041722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-cd096e70-f653-4dba-9ade-4523e7db4173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:22.117608 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:22.119035 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 538/1072] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:56:22.141638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd096e70-f653-4dba-9ade-4523e7db4173 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:22.150959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458fd40-3dfc-4741-aa6a-46b4aa147f2e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:22.171545 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:22.189450 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c671ff-3521-491e-bb1a-fe02a84defb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:22.190118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c671ff-3521-491e-bb1a-fe02a84defb5 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:22.190399 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c671ff-3521-491e-bb1a-fe02a84defb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:22.190702 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c671ff-3521-491e-bb1a-fe02a84defb5 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:22.191495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c671ff-3521-491e-bb1a-fe02a84defb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:22.191815 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c671ff-3521-491e-bb1a-fe02a84defb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:22.193253 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c671ff-3521-491e-bb1a-fe02a84defb5 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:22.209685 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 535/1073] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:56:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:22.215934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c671ff-3521-491e-bb1a-fe02a84defb5 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:22.282937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd096e70-f653-4dba-9ade-4523e7db4173 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:22.329273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85a30a-4597-438c-a339-c08996a6d543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:22.329923 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85a30a-4597-438c-a339-c08996a6d543 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:22.330217 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85a30a-4597-438c-a339-c08996a6d543 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:22.330521 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85a30a-4597-438c-a339-c08996a6d543 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:22.335248 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c671ff-3521-491e-bb1a-fe02a84defb5 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:22.375644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53f1cb-5236-4f93-bf28-c1d61551f6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:22.376486 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53f1cb-5236-4f93-bf28-c1d61551f6a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:22.376772 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53f1cb-5236-4f93-bf28-c1d61551f6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:22.377049 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53f1cb-5236-4f93-bf28-c1d61551f6a7 None admin] PATH_INFO: `/v3/projects/66f531bc924b41faa64743923afac319/users/e41a4d3a822c403fad048764a0edf209/roles/bfa252f4a7a643c7972c78c6ef2604fe` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:22.379296 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53f1cb-5236-4f93-bf28-c1d61551f6a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=66f531bc924b41faa64743923afac319, user_id=e41a4d3a822c403fad048764a0edf209, role_id=bfa252f4a7a643c7972c78c6ef2604fe)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:22.380744 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53f1cb-5236-4f93-bf28-c1d61551f6a7 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:22.383226 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:22.397658 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 536/1074] 10.222.0.79 () {58 vars in 1439 bytes} [Thu Jul 14 11:56:22 2022] PUT /identity/v3/projects/66f531bc924b41faa64743923afac319/users/e41a4d3a822c403fad048764a0edf209/roles/bfa252f4a7a643c7972c78c6ef2604fe => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:56:22.416623 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85a30a-4597-438c-a339-c08996a6d543 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:22.418202 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85a30a-4597-438c-a339-c08996a6d543 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:22.449844 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:22.543128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 539/1075] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:56:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 11:56:22.549029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53f1cb-5236-4f93-bf28-c1d61551f6a7 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:22.668759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53f1cb-5236-4f93-bf28-c1d61551f6a7 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:22.707634 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a51db-8ca9-4f15-ad65-d6133c337e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:22.708429 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a51db-8ca9-4f15-ad65-d6133c337e13 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:22.708716 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a51db-8ca9-4f15-ad65-d6133c337e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:22.708994 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a51db-8ca9-4f15-ad65-d6133c337e13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:22.721536 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a51db-8ca9-4f15-ad65-d6133c337e13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:22.724028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a51db-8ca9-4f15-ad65-d6133c337e13 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:22.748116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-275a51db-8ca9-4f15-ad65-d6133c337e13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:56:22.748116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:22.748116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:22.748116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:22.748116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:22.748116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:22.748116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:22.748116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:22.748116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:22.748116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:22.748116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:22.748116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:22.748116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:56:22.748116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:56:22.748116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:56:22.749003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:56:22.749003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:22.749003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:22.749003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:22.749003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:22.749003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:22.749003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:22.749003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:22.749003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:22.749003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:22.749003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:22.749003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:22.749003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:22.749003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:22.749003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:22.749003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:22.749003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:22.749998 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:56:22.749998 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:56:22.749998 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:56:22.749998 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:22.749998 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 537/1076] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:56:22.756601 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85a30a-4597-438c-a339-c08996a6d543 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:22.871277 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85a30a-4597-438c-a339-c08996a6d543 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:22.901107 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:22.912394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcc01a-5581-4fd6-bd28-d454f8860fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:22.913078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcc01a-5581-4fd6-bd28-d454f8860fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:22.913359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcc01a-5581-4fd6-bd28-d454f8860fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:22.913638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcc01a-5581-4fd6-bd28-d454f8860fe4 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:22.914441 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fcc01a-5581-4fd6-bd28-d454f8860fe4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:22.914788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fcc01a-5581-4fd6-bd28-d454f8860fe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:22.916194 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fcc01a-5581-4fd6-bd28-d454f8860fe4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:22.933290 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 540/1077] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:23.084959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a283dc2-08cf-4b37-83a1-6c6365d70741 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:23.085369 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a283dc2-08cf-4b37-83a1-6c6365d70741 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:23.085550 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a283dc2-08cf-4b37-83a1-6c6365d70741 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:23.087766 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 538/1078] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:56:23.093233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6f634-0c86-4b29-b637-8485d1584538 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:23.093532 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6f634-0c86-4b29-b637-8485d1584538 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:23.093819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6f634-0c86-4b29-b637-8485d1584538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:23.112637 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-85f6f634-0c86-4b29-b637-8485d1584538 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:23.113857 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-85f6f634-0c86-4b29-b637-8485d1584538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:23.193314 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 541/1079] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:23.217938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a283dc2-08cf-4b37-83a1-6c6365d70741 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:23.272379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:23.329551 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a283dc2-08cf-4b37-83a1-6c6365d70741 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:23.363614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b923354-b6c9-4a85-88ac-1448e54653b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:23.364400 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b923354-b6c9-4a85-88ac-1448e54653b5 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:23.364681 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b923354-b6c9-4a85-88ac-1448e54653b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:23.364954 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b923354-b6c9-4a85-88ac-1448e54653b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:23.375936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b923354-b6c9-4a85-88ac-1448e54653b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:56:23.383512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-8b923354-b6c9-4a85-88ac-1448e54653b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:56:23.383512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:23.383512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:23.383512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:23.383512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:23.383512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:23.383512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:23.383512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:23.383512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:23.383512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:23.383512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:23.383512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:23.383512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:56:23.383512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:56:23.383512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:56:23.383512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:56:23.385969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:56:23.385969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:56:23.385969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:56:23.385969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:56:23.385969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:23.385969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:23.385969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:23.385969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:23.385969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:23.385969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:23.385969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:23.385969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:23.385969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:23.385969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:23.385969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:23.385969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:23.387539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:23.387539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:23.387539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:23.387539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:23.387539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:56:23.387539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:56:23.387539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:56:23.387539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:56:23.387539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:56:23.387539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:56:23.387539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:56:23.387539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:23.387539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 539/1080] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:56:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:23.391490 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6f634-0c86-4b29-b637-8485d1584538 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:23.499591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6f634-0c86-4b29-b637-8485d1584538 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:23.523857 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:23.544925 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbe589-fe2a-49c7-b29b-d90eba3de267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:23.545610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbe589-fe2a-49c7-b29b-d90eba3de267 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:23.545895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbe589-fe2a-49c7-b29b-d90eba3de267 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:23.546170 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbe589-fe2a-49c7-b29b-d90eba3de267 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:23.546962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbe589-fe2a-49c7-b29b-d90eba3de267 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:23.547273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbe589-fe2a-49c7-b29b-d90eba3de267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:23.548638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbe589-fe2a-49c7-b29b-d90eba3de267 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:23.558890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 542/1081] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:56:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:23.564745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b923354-b6c9-4a85-88ac-1448e54653b5 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:23.679398 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b923354-b6c9-4a85-88ac-1448e54653b5 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:23.692835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:23.724517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8889e04-a79e-405d-bb26-13d6529e6aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:23.725383 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8889e04-a79e-405d-bb26-13d6529e6aec None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:23.725670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8889e04-a79e-405d-bb26-13d6529e6aec None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:23.725943 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8889e04-a79e-405d-bb26-13d6529e6aec None admin] PATH_INFO: `/v3/users/fc8f214a137c428f808f99eb8fd1c4f6` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:23.727185 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8889e04-a79e-405d-bb26-13d6529e6aec None admin] RBAC: Authorizing `identity:get_user(user_id=fc8f214a137c428f808f99eb8fd1c4f6)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:23.731101 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8889e04-a79e-405d-bb26-13d6529e6aec None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:23.731101 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 540/1082] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:56:23 2022] GET /identity/v3/users/fc8f214a137c428f808f99eb8fd1c4f6 => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:23.736728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbe589-fe2a-49c7-b29b-d90eba3de267 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:23.839941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbe589-fe2a-49c7-b29b-d90eba3de267 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:23.876296 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526b820-d0f6-4add-8a8c-76ceadb4bdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:23.877164 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526b820-d0f6-4add-8a8c-76ceadb4bdb0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:23.877450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526b820-d0f6-4add-8a8c-76ceadb4bdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:23.877732 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526b820-d0f6-4add-8a8c-76ceadb4bdb0 None admin] PATH_INFO: `/v3/projects/1fc40bff90154069b70b61257d88aee6` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:23.878980 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526b820-d0f6-4add-8a8c-76ceadb4bdb0 None admin] RBAC: Authorizing `identity:get_project(project_id=1fc40bff90154069b70b61257d88aee6)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:23.880435 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526b820-d0f6-4add-8a8c-76ceadb4bdb0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:23.882180 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 543/1083] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:56:23 2022] GET /identity/v3/projects/1fc40bff90154069b70b61257d88aee6 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:23.888131 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8889e04-a79e-405d-bb26-13d6529e6aec None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:23.989451 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8889e04-a79e-405d-bb26-13d6529e6aec None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:24.023797 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da4c89-0332-42e2-9487-b966d323f529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:24.025182 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da4c89-0332-42e2-9487-b966d323f529 None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:24.025455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da4c89-0332-42e2-9487-b966d323f529 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:24.025726 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da4c89-0332-42e2-9487-b966d323f529 None admin] PATH_INFO: `/v3/projects/1fc40bff90154069b70b61257d88aee6/users/fc8f214a137c428f808f99eb8fd1c4f6/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:24.027750 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da4c89-0332-42e2-9487-b966d323f529 None admin] RBAC: Authorizing `identity:create_grant(project_id=1fc40bff90154069b70b61257d88aee6, user_id=fc8f214a137c428f808f99eb8fd1c4f6, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:24.029184 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da4c89-0332-42e2-9487-b966d323f529 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:24.043826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 541/1084] 10.222.0.79 () {58 vars in 1439 bytes} [Thu Jul 14 11:56:23 2022] PUT /identity/v3/projects/1fc40bff90154069b70b61257d88aee6/users/fc8f214a137c428f808f99eb8fd1c4f6/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:56:24.476323 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7cd98-25dd-40c2-821d-7b775ffdd0ff None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:24.476884 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7cd98-25dd-40c2-821d-7b775ffdd0ff None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:24.476987 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7cd98-25dd-40c2-821d-7b775ffdd0ff None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:24.479130 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 544/1085] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:24.484800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cc8bf-48d4-4d82-af2c-a3156d363076 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:24.485308 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cc8bf-48d4-4d82-af2c-a3156d363076 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:24.485417 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cc8bf-48d4-4d82-af2c-a3156d363076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:24.502793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-a48cc8bf-48d4-4d82-af2c-a3156d363076 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:24.503994 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a48cc8bf-48d4-4d82-af2c-a3156d363076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:24.532264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:24.575622 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 542/1086] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:24.599204 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7cd98-25dd-40c2-821d-7b775ffdd0ff None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:24.648579 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:24.707761 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7cd98-25dd-40c2-821d-7b775ffdd0ff None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:24.754645 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a92a3-936e-43f9-b664-b5700abb6562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:24.755471 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a92a3-936e-43f9-b664-b5700abb6562 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:24.755754 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a92a3-936e-43f9-b664-b5700abb6562 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:24.756090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a92a3-936e-43f9-b664-b5700abb6562 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:24.768934 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a92a3-936e-43f9-b664-b5700abb6562 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:56:24.777706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-7a6a92a3-936e-43f9-b664-b5700abb6562 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 11:56:24.777706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:24.777706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:24.777706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:24.777706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:24.777706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:24.777706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:24.777706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:24.777706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:24.777706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:24.777706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:24.777706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:24.777706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:56:24.777706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:56:24.777706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:56:24.777706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:56:24.778801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:56:24.778801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:56:24.778801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:56:24.778801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:56:24.778801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:24.778801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:24.778801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:24.778801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:24.778801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:24.778801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:24.778801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:24.778801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:24.778801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:24.778801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:24.778801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:24.778801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:24.779682 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:24.779682 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:24.779682 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:24.779682 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:24.779682 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:56:24.779682 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:56:24.779682 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:56:24.779682 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:56:24.779682 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:56:24.779682 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:56:24.779682 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 11:56:24.779682 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:24.779682 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 545/1087] 10.222.0.79 () {56 vars in 1120 bytes} [Thu Jul 14 11:56:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:24.784934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cc8bf-48d4-4d82-af2c-a3156d363076 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:24.891328 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cc8bf-48d4-4d82-af2c-a3156d363076 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:24.940230 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f78051-6673-4487-8355-eeefafde1010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:24.941415 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f78051-6673-4487-8355-eeefafde1010 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:24.941926 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f78051-6673-4487-8355-eeefafde1010 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:24.942421 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f78051-6673-4487-8355-eeefafde1010 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:24.943918 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f78051-6673-4487-8355-eeefafde1010 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:24.944494 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f78051-6673-4487-8355-eeefafde1010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:24.947693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f78051-6673-4487-8355-eeefafde1010 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:24.963286 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 543/1088] 10.222.0.79 () {56 vars in 1115 bytes} [Thu Jul 14 11:56:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:24.969157 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a92a3-936e-43f9-b664-b5700abb6562 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:25.076108 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a92a3-936e-43f9-b664-b5700abb6562 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:25.083579 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:25.120234 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1466cf-ba0b-4560-b82e-ff63d3283c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:25.121042 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1466cf-ba0b-4560-b82e-ff63d3283c6f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:25.121328 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1466cf-ba0b-4560-b82e-ff63d3283c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:25.121692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1466cf-ba0b-4560-b82e-ff63d3283c6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:25.132387 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1466cf-ba0b-4560-b82e-ff63d3283c6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:25.133883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1466cf-ba0b-4560-b82e-ff63d3283c6f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:25.152459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-cc1466cf-ba0b-4560-b82e-ff63d3283c6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:56:25.152459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:25.152459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:25.152459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:25.152459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:25.152459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:25.152459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:25.152459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:25.152459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:25.152459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:25.152459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:25.152459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:25.152459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:56:25.152459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:56:25.152459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:56:25.154416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:56:25.154416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:25.154416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:25.154416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:25.154416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:25.154416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:25.154416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:25.154416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:25.154416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:25.154416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:25.154416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:25.154416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:25.154416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:25.154416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:25.154416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:25.154416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:25.154416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:25.155633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:56:25.155633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:56:25.155633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:56:25.155633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:25.160247 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 546/1089] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:56:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:25.160474 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f78051-6673-4487-8355-eeefafde1010 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:25.191434 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:25.271389 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f78051-6673-4487-8355-eeefafde1010 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:25.308477 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579d038-e246-446c-969c-f11188977819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:25.309275 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579d038-e246-446c-969c-f11188977819 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:25.309651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579d038-e246-446c-969c-f11188977819 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:25.310025 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579d038-e246-446c-969c-f11188977819 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:25.310888 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579d038-e246-446c-969c-f11188977819 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:25.311355 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579d038-e246-446c-969c-f11188977819 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:25.312836 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579d038-e246-446c-969c-f11188977819 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:25.325775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 544/1090] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:25.331513 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1466cf-ba0b-4560-b82e-ff63d3283c6f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:25.438053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1466cf-ba0b-4560-b82e-ff63d3283c6f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:25.473560 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29803f-6447-45da-a9a2-61d4a1965fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:25.474353 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29803f-6447-45da-a9a2-61d4a1965fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:25.474667 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29803f-6447-45da-a9a2-61d4a1965fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:25.474943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29803f-6447-45da-a9a2-61d4a1965fe8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:25.483598 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29803f-6447-45da-a9a2-61d4a1965fe8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:25.485038 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29803f-6447-45da-a9a2-61d4a1965fe8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:25.501365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-3d29803f-6447-45da-a9a2-61d4a1965fe8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:56:25.501365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:25.501365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:25.501365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:25.501365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:25.501365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:25.501365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:25.501365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:25.501365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:25.501365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:25.501365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:25.501365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:25.501365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:56:25.501365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:56:25.501365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:56:25.501365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:56:25.502486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:25.502486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:25.502486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:56:25.502486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:56:25.502486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:56:25.502486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:56:25.502486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:25.502486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:25.502486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:25.502486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:25.502486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:25.502486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:25.502486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:25.502486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:25.502486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:25.502486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:25.502486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:25.502486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:25.503454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:25.503454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:25.503454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:56:25.503454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:56:25.503454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:56:25.503454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:56:25.503454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:56:25.503454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:56:25.503454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:56:25.503454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:25.503454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 547/1091] 10.222.0.79 () {56 vars in 1093 bytes} [Thu Jul 14 11:56:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:56:25.508706 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579d038-e246-446c-969c-f11188977819 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:25.601361 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:25.618126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579d038-e246-446c-969c-f11188977819 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:25.655453 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9d0a5-6b8c-4197-937b-942822d93aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:25.656141 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9d0a5-6b8c-4197-937b-942822d93aad None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:25.656426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9d0a5-6b8c-4197-937b-942822d93aad None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:25.656702 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9d0a5-6b8c-4197-937b-942822d93aad None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:25.657553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9d0a5-6b8c-4197-937b-942822d93aad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:25.657868 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9d0a5-6b8c-4197-937b-942822d93aad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:25.659370 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9d0a5-6b8c-4197-937b-942822d93aad None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:25.679485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 545/1092] 10.222.0.79 () {56 vars in 1133 bytes} [Thu Jul 14 11:56:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:25.685699 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29803f-6447-45da-a9a2-61d4a1965fe8 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:25.704802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:25.798819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29803f-6447-45da-a9a2-61d4a1965fe8 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:25.833795 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae05e61-e5b8-4027-8b63-1309963a9586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:25.834453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae05e61-e5b8-4027-8b63-1309963a9586 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:25.834769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae05e61-e5b8-4027-8b63-1309963a9586 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:25.835049 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae05e61-e5b8-4027-8b63-1309963a9586 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:25.907422 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae05e61-e5b8-4027-8b63-1309963a9586 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:25.908778 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae05e61-e5b8-4027-8b63-1309963a9586 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:25.926910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:26.011464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 548/1093] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:56:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:56:26.017214 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9d0a5-6b8c-4197-937b-942822d93aad None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:26.102412 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d721724-f386-4bf3-9a9f-f9217ec0609d None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:26.102739 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d721724-f386-4bf3-9a9f-f9217ec0609d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:26.103021 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d721724-f386-4bf3-9a9f-f9217ec0609d None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:26.104416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 549/1094] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:56:26.111336 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067669f-e47c-4813-ad43-1f5230d45c82 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:26.111628 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067669f-e47c-4813-ad43-1f5230d45c82 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:26.111904 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067669f-e47c-4813-ad43-1f5230d45c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:26.124102 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9d0a5-6b8c-4197-937b-942822d93aad None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:26.129130 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-0067669f-e47c-4813-ad43-1f5230d45c82 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:26.130347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0067669f-e47c-4813-ad43-1f5230d45c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:26.162928 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5e978-1322-4c07-895f-cc0e207d2234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:26.163645 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5e978-1322-4c07-895f-cc0e207d2234 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:26.163928 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5e978-1322-4c07-895f-cc0e207d2234 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:26.164204 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5e978-1322-4c07-895f-cc0e207d2234 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:26.174377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5e978-1322-4c07-895f-cc0e207d2234 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:26.175881 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5e978-1322-4c07-895f-cc0e207d2234 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:26.178730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:26.195179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-c3e5e978-1322-4c07-895f-cc0e207d2234 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:56:26.195179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:26.195179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:26.195179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:26.195179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:26.195179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:26.195179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:26.195179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:26.195179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:26.195179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:26.195179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:26.195179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:26.195179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:56:26.195179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:56:26.195179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:56:26.196234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:56:26.196234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:26.196234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:26.196234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:26.196234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:26.196234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:26.196234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:26.196234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:26.196234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:26.196234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:26.196234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:26.196234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:26.196234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:26.196234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:26.196234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:26.196234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:26.196234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:26.197732 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:56:26.197732 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:56:26.197732 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:56:26.197732 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:26.197732 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 546/1095] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:56:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:26.202853 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5e978-1322-4c07-895f-cc0e207d2234 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:26.203755 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 550/1096] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:56:26.225675 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067669f-e47c-4813-ad43-1f5230d45c82 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:26.278892 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:26.309553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5e978-1322-4c07-895f-cc0e207d2234 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:26.331091 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067669f-e47c-4813-ad43-1f5230d45c82 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:26.345436 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423e24a-4770-4dd8-9012-16401e701b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:26.346103 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423e24a-4770-4dd8-9012-16401e701b6f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:26.346388 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423e24a-4770-4dd8-9012-16401e701b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:26.346737 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423e24a-4770-4dd8-9012-16401e701b6f None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:26.347412 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423e24a-4770-4dd8-9012-16401e701b6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:26.347723 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423e24a-4770-4dd8-9012-16401e701b6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:26.349098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423e24a-4770-4dd8-9012-16401e701b6f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:26.371812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 547/1097] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:26.372186 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2008c26-30cc-4c8e-9847-0c3fcdcad4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:26.373072 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2008c26-30cc-4c8e-9847-0c3fcdcad4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:26.373363 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2008c26-30cc-4c8e-9847-0c3fcdcad4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:26.373644 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2008c26-30cc-4c8e-9847-0c3fcdcad4e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:26.377754 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423e24a-4770-4dd8-9012-16401e701b6f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:26.386528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2008c26-30cc-4c8e-9847-0c3fcdcad4e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:56:26.394206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f2008c26-30cc-4c8e-9847-0c3fcdcad4e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:56:26.394206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:26.394206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:26.394206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:26.394206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:26.394206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:26.394206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:26.394206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:26.394206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:26.394206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:26.394206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:26.394206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:26.394206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:56:26.394206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:56:26.394206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:56:26.394206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:56:26.395319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:56:26.395319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:56:26.395319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:56:26.395319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:56:26.395319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:26.395319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:26.395319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:26.395319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:26.395319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:26.395319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:26.395319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:26.395319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:26.395319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:26.395319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:26.395319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:26.395319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:26.396152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:26.396152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:26.396152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:26.396152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:26.396152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:56:26.396152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:56:26.396152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:56:26.396152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:56:26.396152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:56:26.396152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:56:26.396152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:56:26.396152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:26.396152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 551/1098] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:56:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:56:26.402233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2008c26-30cc-4c8e-9847-0c3fcdcad4e5 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:26.441726 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:26.487171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423e24a-4770-4dd8-9012-16401e701b6f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:26.507485 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2008c26-30cc-4c8e-9847-0c3fcdcad4e5 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:26.516981 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:26.521459 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bd7a9-2f34-4eb7-89ae-35a28f859a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:26.522252 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bd7a9-2f34-4eb7-89ae-35a28f859a3c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:26.522556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bd7a9-2f34-4eb7-89ae-35a28f859a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:26.522832 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bd7a9-2f34-4eb7-89ae-35a28f859a3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:26.529425 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6bd7a9-2f34-4eb7-89ae-35a28f859a3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:26.530889 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6bd7a9-2f34-4eb7-89ae-35a28f859a3c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:26.542476 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca362ce0-aead-4f2e-8f53-c3b3731175a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:26.543167 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca362ce0-aead-4f2e-8f53-c3b3731175a1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:26.543452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca362ce0-aead-4f2e-8f53-c3b3731175a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:26.543728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca362ce0-aead-4f2e-8f53-c3b3731175a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:26.544465 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca362ce0-aead-4f2e-8f53-c3b3731175a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:26.544776 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca362ce0-aead-4f2e-8f53-c3b3731175a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:26.545506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-0b6bd7a9-2f34-4eb7-89ae-35a28f859a3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:56:26.545506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:26.545506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:26.545506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:26.545506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:26.545506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:26.545506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:26.545506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:26.545506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:26.545506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:26.545506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:26.545506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:26.545506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:56:26.545506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:56:26.545506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:56:26.546405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:56:26.546405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:26.546405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:26.546405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:26.546405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:26.546405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:26.546405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:26.546405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:26.546405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:26.546405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:26.546405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:26.546405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:26.546405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:26.546405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:26.546405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:26.546405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:26.546405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:26.547322 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:56:26.547322 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:56:26.547322 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:56:26.547322 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:56:26.547322 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:56:26.547322 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:56:26.547322 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:56:26.547322 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:26.547749 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca362ce0-aead-4f2e-8f53-c3b3731175a1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:26.547819 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 548/1099] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:56:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:56:26.552610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bd7a9-2f34-4eb7-89ae-35a28f859a3c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:26.554865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 552/1100] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:56:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:26.560952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca362ce0-aead-4f2e-8f53-c3b3731175a1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:26.650574 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bd7a9-2f34-4eb7-89ae-35a28f859a3c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:26.659043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca362ce0-aead-4f2e-8f53-c3b3731175a1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:26.667227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:26.688285 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ecb27-b9e5-409a-ad52-87573a4a9659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:26.688949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ecb27-b9e5-409a-ad52-87573a4a9659 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:26.689234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ecb27-b9e5-409a-ad52-87573a4a9659 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:26.689514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ecb27-b9e5-409a-ad52-87573a4a9659 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:26.690297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ecb27-b9e5-409a-ad52-87573a4a9659 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:26.690639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ecb27-b9e5-409a-ad52-87573a4a9659 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:26.692242 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ecb27-b9e5-409a-ad52-87573a4a9659 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:26.695085 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff678f-f179-4c33-8d75-02d457cb03e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:26.695984 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff678f-f179-4c33-8d75-02d457cb03e1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:26.696313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff678f-f179-4c33-8d75-02d457cb03e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:26.699055 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff678f-f179-4c33-8d75-02d457cb03e1 None admin] PATH_INFO: `/v3/users/fc8f214a137c428f808f99eb8fd1c4f6` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:26.699708 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff678f-f179-4c33-8d75-02d457cb03e1 None admin] RBAC: Authorizing `identity:get_user(user_id=fc8f214a137c428f808f99eb8fd1c4f6)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:26.701841 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff678f-f179-4c33-8d75-02d457cb03e1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:26.703715 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 553/1101] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:56:26 2022] GET /identity/v3/users/fc8f214a137c428f808f99eb8fd1c4f6 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:26.703871 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 549/1102] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:56:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:26.709252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff678f-f179-4c33-8d75-02d457cb03e1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:26.717005 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ecb27-b9e5-409a-ad52-87573a4a9659 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:26.765006 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:26.833254 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ecb27-b9e5-409a-ad52-87573a4a9659 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:26.834413 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff678f-f179-4c33-8d75-02d457cb03e1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:26.873777 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d7580-05cf-4275-b260-fcc815c4fcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:26.874436 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d7580-05cf-4275-b260-fcc815c4fcaa None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:26.874754 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d7580-05cf-4275-b260-fcc815c4fcaa None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:26.875034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d7580-05cf-4275-b260-fcc815c4fcaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:26.877940 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da414425-8d0b-40d7-977e-9c728b20cd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:26.877940 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da414425-8d0b-40d7-977e-9c728b20cd94 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:26.877940 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da414425-8d0b-40d7-977e-9c728b20cd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:26.877940 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da414425-8d0b-40d7-977e-9c728b20cd94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:26.879671 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da414425-8d0b-40d7-977e-9c728b20cd94 None admin] RBAC: Adding query filter params (role.id=bfa252f4a7a643c7972c78c6ef2604fe, scope.project.id=66f531bc924b41faa64743923afac319, user.id=e41a4d3a822c403fad048764a0edf209) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:26.880006 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da414425-8d0b-40d7-977e-9c728b20cd94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:26.881570 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da414425-8d0b-40d7-977e-9c728b20cd94 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:26.889902 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 550/1103] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:56:26 2022] GET /identity/v3/role_assignments?user.id=e41a4d3a822c403fad048764a0edf209&scope.project.id=66f531bc924b41faa64743923afac319&role.id=bfa252f4a7a643c7972c78c6ef2604fe => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:56:26.953983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d7580-05cf-4275-b260-fcc815c4fcaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:26.955711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d7580-05cf-4275-b260-fcc815c4fcaa None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:27.003381 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:27.070710 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 554/1104] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:56:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 11:56:27.076690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da414425-8d0b-40d7-977e-9c728b20cd94 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:27.121649 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:27.184098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da414425-8d0b-40d7-977e-9c728b20cd94 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:27.220681 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2c185-6983-4184-8f7f-ddabc2e20b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:27.221458 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2c185-6983-4184-8f7f-ddabc2e20b85 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:27.221740 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2c185-6983-4184-8f7f-ddabc2e20b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:27.222016 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2c185-6983-4184-8f7f-ddabc2e20b85 None admin] PATH_INFO: `/v3/projects/1fc40bff90154069b70b61257d88aee6` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:27.223562 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2c185-6983-4184-8f7f-ddabc2e20b85 None admin] RBAC: Authorizing `identity:get_project(project_id=1fc40bff90154069b70b61257d88aee6)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:27.229324 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2c185-6983-4184-8f7f-ddabc2e20b85 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:27.229324 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 551/1105] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:56:27 2022] GET /identity/v3/projects/1fc40bff90154069b70b61257d88aee6 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:27.232523 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d7580-05cf-4275-b260-fcc815c4fcaa None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:27.338224 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d7580-05cf-4275-b260-fcc815c4fcaa None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:27.377409 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df6fad-5fdf-45fa-bd37-243effeb6fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:27.378073 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df6fad-5fdf-45fa-bd37-243effeb6fec None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:27.378365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df6fad-5fdf-45fa-bd37-243effeb6fec None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:27.378672 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df6fad-5fdf-45fa-bd37-243effeb6fec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:27.379511 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df6fad-5fdf-45fa-bd37-243effeb6fec None admin] RBAC: Adding query filter params (role.id=eff4f9bbb7064bc1a0f9fc55a05fea51, scope.project.id=1fc40bff90154069b70b61257d88aee6, user.id=fc8f214a137c428f808f99eb8fd1c4f6) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:27.379826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df6fad-5fdf-45fa-bd37-243effeb6fec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:27.381252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df6fad-5fdf-45fa-bd37-243effeb6fec None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:27.387520 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 555/1106] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:56:27 2022] GET /identity/v3/role_assignments?user.id=fc8f214a137c428f808f99eb8fd1c4f6&scope.project.id=1fc40bff90154069b70b61257d88aee6&role.id=eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:29.439747 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f58649-85cf-4c1a-b645-e7e020dbdcf1 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:29.440272 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f58649-85cf-4c1a-b645-e7e020dbdcf1 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:29.440393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f58649-85cf-4c1a-b645-e7e020dbdcf1 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:29.441683 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 552/1107] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:29.447697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a84252-cbb9-4d4c-94ed-84e7bdf194c5 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:29.453842 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a84252-cbb9-4d4c-94ed-84e7bdf194c5 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:29.453842 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a84252-cbb9-4d4c-94ed-84e7bdf194c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:29.454860 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:29.467064 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-57a84252-cbb9-4d4c-94ed-84e7bdf194c5 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:29.468249 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-57a84252-cbb9-4d4c-94ed-84e7bdf194c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:29.534032 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 556/1108] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:29.559759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f58649-85cf-4c1a-b645-e7e020dbdcf1 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:29.656000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f58649-85cf-4c1a-b645-e7e020dbdcf1 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:29.664722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:29.690300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaaa102-64bd-4673-bd69-6ef63d33e95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:29.691049 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaaa102-64bd-4673-bd69-6ef63d33e95a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:29.691333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaaa102-64bd-4673-bd69-6ef63d33e95a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:29.691608 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaaa102-64bd-4673-bd69-6ef63d33e95a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:29.692771 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaaa102-64bd-4673-bd69-6ef63d33e95a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:29.694206 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaaa102-64bd-4673-bd69-6ef63d33e95a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:29.695862 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 553/1109] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:56:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:29.701680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a84252-cbb9-4d4c-94ed-84e7bdf194c5 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:29.798127 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a84252-cbb9-4d4c-94ed-84e7bdf194c5 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:29.826805 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:29.832131 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcd1be-1f49-4b90-9333-cdc18efc2fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:29.832797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcd1be-1f49-4b90-9333-cdc18efc2fa1 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:29.833081 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcd1be-1f49-4b90-9333-cdc18efc2fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:29.833371 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcd1be-1f49-4b90-9333-cdc18efc2fa1 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:29.834068 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dcd1be-1f49-4b90-9333-cdc18efc2fa1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:29.835508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dcd1be-1f49-4b90-9333-cdc18efc2fa1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:29.858540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 557/1110] 10.222.0.79 () {60 vars in 1132 bytes} [Thu Jul 14 11:56:29 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:56:31.908499 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23118e-db9b-430a-abb2-259aa054eac0 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:31.909046 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23118e-db9b-430a-abb2-259aa054eac0 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:31.909046 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23118e-db9b-430a-abb2-259aa054eac0 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:31.910481 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 554/1111] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:31.916349 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01230aeb-1a25-4282-a73c-ae3f2df7e9dd None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:31.916780 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01230aeb-1a25-4282-a73c-ae3f2df7e9dd None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:31.916878 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01230aeb-1a25-4282-a73c-ae3f2df7e9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:31.933933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-01230aeb-1a25-4282-a73c-ae3f2df7e9dd None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:31.935131 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-01230aeb-1a25-4282-a73c-ae3f2df7e9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:31.999246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 558/1112] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:32.022084 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23118e-db9b-430a-abb2-259aa054eac0 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:32.120393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23118e-db9b-430a-abb2-259aa054eac0 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:32.153346 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ae0c4-62b6-42e9-9d44-abfddb5d9f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:32.154182 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ae0c4-62b6-42e9-9d44-abfddb5d9f03 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:32.154470 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ae0c4-62b6-42e9-9d44-abfddb5d9f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:32.154776 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ae0c4-62b6-42e9-9d44-abfddb5d9f03 None admin] PATH_INFO: `/v3/roles/986e347cbb9e43e7a49dfef9be8ec9dd` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:32.156226 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ae0c4-62b6-42e9-9d44-abfddb5d9f03 None admin] RBAC: Authorizing `identity:get_role(role_id=986e347cbb9e43e7a49dfef9be8ec9dd)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:32.157591 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ae0c4-62b6-42e9-9d44-abfddb5d9f03 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:32.159002 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 555/1113] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:56:32 2022] GET /identity/v3/roles/986e347cbb9e43e7a49dfef9be8ec9dd => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:32.164852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01230aeb-1a25-4282-a73c-ae3f2df7e9dd None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:32.261687 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01230aeb-1a25-4282-a73c-ae3f2df7e9dd None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:32.278629 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:32.296071 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed7baa-94e7-4f33-be11-72d68cd97661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:32.296934 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed7baa-94e7-4f33-be11-72d68cd97661 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:32.297218 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed7baa-94e7-4f33-be11-72d68cd97661 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:32.297491 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed7baa-94e7-4f33-be11-72d68cd97661 None admin] PATH_INFO: `/v3/users/cb5f7af7afdc42968e851d22de19c713` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:32.310388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed7baa-94e7-4f33-be11-72d68cd97661 None admin] RBAC: Authorizing `identity:get_user(user_id=cb5f7af7afdc42968e851d22de19c713)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:32.311859 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed7baa-94e7-4f33-be11-72d68cd97661 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:32.313547 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 559/1114] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:56:32 2022] GET /identity/v3/users/cb5f7af7afdc42968e851d22de19c713 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:32.319284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ae0c4-62b6-42e9-9d44-abfddb5d9f03 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:32.364957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:32.419075 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ae0c4-62b6-42e9-9d44-abfddb5d9f03 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:32.452830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d803b-2b0a-4803-9d1c-4b1baf9a6eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:32.453478 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d803b-2b0a-4803-9d1c-4b1baf9a6eca None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:32.453765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d803b-2b0a-4803-9d1c-4b1baf9a6eca None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:32.454046 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d803b-2b0a-4803-9d1c-4b1baf9a6eca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:32.519519 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d803b-2b0a-4803-9d1c-4b1baf9a6eca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:32.520915 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d803b-2b0a-4803-9d1c-4b1baf9a6eca None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:32.565107 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:32.619283 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 556/1115] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:56:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:56:32.625169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed7baa-94e7-4f33-be11-72d68cd97661 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:32.723938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed7baa-94e7-4f33-be11-72d68cd97661 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:32.757339 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989965d0-aeac-4086-927e-6e1d8e1c534a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:32.758196 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989965d0-aeac-4086-927e-6e1d8e1c534a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:32.758994 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989965d0-aeac-4086-927e-6e1d8e1c534a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:32.759293 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989965d0-aeac-4086-927e-6e1d8e1c534a None admin] PATH_INFO: `/v3/projects/1fc40bff90154069b70b61257d88aee6` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:32.760584 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989965d0-aeac-4086-927e-6e1d8e1c534a None admin] RBAC: Authorizing `identity:get_project(project_id=1fc40bff90154069b70b61257d88aee6)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:32.762009 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989965d0-aeac-4086-927e-6e1d8e1c534a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:32.763738 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 560/1116] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:56:32 2022] GET /identity/v3/projects/1fc40bff90154069b70b61257d88aee6 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:32.769812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d803b-2b0a-4803-9d1c-4b1baf9a6eca None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:32.864635 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d803b-2b0a-4803-9d1c-4b1baf9a6eca None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:32.897166 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9502a-b0de-432c-a870-1df96157da19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:32.897813 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9502a-b0de-432c-a870-1df96157da19 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:32.898099 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9502a-b0de-432c-a870-1df96157da19 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:32.898375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9502a-b0de-432c-a870-1df96157da19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:32.899854 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9502a-b0de-432c-a870-1df96157da19 None admin] RBAC: Adding query filter params (role.id=986e347cbb9e43e7a49dfef9be8ec9dd, scope.project.id=1fc40bff90154069b70b61257d88aee6, user.id=cb5f7af7afdc42968e851d22de19c713) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:32.900170 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9502a-b0de-432c-a870-1df96157da19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:32.901600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9502a-b0de-432c-a870-1df96157da19 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:32.907171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 557/1117] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:56:32 2022] GET /identity/v3/role_assignments?user.id=cb5f7af7afdc42968e851d22de19c713&scope.project.id=1fc40bff90154069b70b61257d88aee6&role.id=986e347cbb9e43e7a49dfef9be8ec9dd => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:34.905213 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b212c69-ca8c-4386-b944-e5e45099aab7 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:34.905756 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b212c69-ca8c-4386-b944-e5e45099aab7 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:34.905756 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b212c69-ca8c-4386-b944-e5e45099aab7 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:34.907172 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 561/1118] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:34.912423 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ec56b-e7c9-45b2-9055-ba7353726914 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:34.912867 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ec56b-e7c9-45b2-9055-ba7353726914 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:34.912970 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ec56b-e7c9-45b2-9055-ba7353726914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:34.929713 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-714ec56b-e7c9-45b2-9055-ba7353726914 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:34.930924 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-714ec56b-e7c9-45b2-9055-ba7353726914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:34.932827 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:34.995176 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 558/1119] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:35.018207 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b212c69-ca8c-4386-b944-e5e45099aab7 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:35.064613 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:35.119302 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b212c69-ca8c-4386-b944-e5e45099aab7 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:35.152235 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa6089-3776-40c9-a6ce-98ec0163e1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:35.153089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa6089-3776-40c9-a6ce-98ec0163e1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:35.153383 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa6089-3776-40c9-a6ce-98ec0163e1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:35.153664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa6089-3776-40c9-a6ce-98ec0163e1a6 None admin] PATH_INFO: `/v3/roles/986e347cbb9e43e7a49dfef9be8ec9dd` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:35.155152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa6089-3776-40c9-a6ce-98ec0163e1a6 None admin] RBAC: Authorizing `identity:get_role(role_id=986e347cbb9e43e7a49dfef9be8ec9dd)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:35.156508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa6089-3776-40c9-a6ce-98ec0163e1a6 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:35.157866 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 562/1120] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:56:35 2022] GET /identity/v3/roles/986e347cbb9e43e7a49dfef9be8ec9dd => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:35.164236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ec56b-e7c9-45b2-9055-ba7353726914 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:35.265243 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ec56b-e7c9-45b2-9055-ba7353726914 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:35.298444 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb2e9e-c055-4ac2-ae8d-6f1757f383c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:35.299385 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb2e9e-c055-4ac2-ae8d-6f1757f383c0 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:35.299668 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb2e9e-c055-4ac2-ae8d-6f1757f383c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:35.299953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb2e9e-c055-4ac2-ae8d-6f1757f383c0 None admin] PATH_INFO: `/v3/users/cb5f7af7afdc42968e851d22de19c713` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:35.301414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb2e9e-c055-4ac2-ae8d-6f1757f383c0 None admin] RBAC: Authorizing `identity:get_user(user_id=cb5f7af7afdc42968e851d22de19c713)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:35.302886 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb2e9e-c055-4ac2-ae8d-6f1757f383c0 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:35.304530 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 559/1121] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:56:35 2022] GET /identity/v3/users/cb5f7af7afdc42968e851d22de19c713 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:35.311029 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa6089-3776-40c9-a6ce-98ec0163e1a6 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:35.407628 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa6089-3776-40c9-a6ce-98ec0163e1a6 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:35.420370 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:35.442296 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e09751-c6ee-4785-9632-e38b1986dbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:35.443184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e09751-c6ee-4785-9632-e38b1986dbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:35.443472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e09751-c6ee-4785-9632-e38b1986dbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:35.443753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e09751-c6ee-4785-9632-e38b1986dbd8 None admin] PATH_INFO: `/v3/projects/1fc40bff90154069b70b61257d88aee6` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:35.444927 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e09751-c6ee-4785-9632-e38b1986dbd8 None admin] RBAC: Authorizing `identity:get_project(project_id=1fc40bff90154069b70b61257d88aee6)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:35.446984 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e09751-c6ee-4785-9632-e38b1986dbd8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:35.448719 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 563/1122] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:56:35 2022] GET /identity/v3/projects/1fc40bff90154069b70b61257d88aee6 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:35.454740 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb2e9e-c055-4ac2-ae8d-6f1757f383c0 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:35.464356 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:35.557617 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb2e9e-c055-4ac2-ae8d-6f1757f383c0 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:35.590679 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc38e6b-5f78-4126-b1a4-077efc1fc454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:35.591555 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc38e6b-5f78-4126-b1a4-077efc1fc454 None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:35.591840 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc38e6b-5f78-4126-b1a4-077efc1fc454 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:35.592117 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc38e6b-5f78-4126-b1a4-077efc1fc454 None admin] PATH_INFO: `/v3/projects/1fc40bff90154069b70b61257d88aee6/users/cb5f7af7afdc42968e851d22de19c713/roles/986e347cbb9e43e7a49dfef9be8ec9dd` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:35.594278 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc38e6b-5f78-4126-b1a4-077efc1fc454 None admin] RBAC: Authorizing `identity:create_grant(project_id=1fc40bff90154069b70b61257d88aee6, user_id=cb5f7af7afdc42968e851d22de19c713, role_id=986e347cbb9e43e7a49dfef9be8ec9dd)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:35.595755 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc38e6b-5f78-4126-b1a4-077efc1fc454 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:35.608781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 560/1123] 10.222.0.79 () {58 vars in 1439 bytes} [Thu Jul 14 11:56:35 2022] PUT /identity/v3/projects/1fc40bff90154069b70b61257d88aee6/users/cb5f7af7afdc42968e851d22de19c713/roles/986e347cbb9e43e7a49dfef9be8ec9dd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:56:37.594970 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97861e6c-a27e-494c-9c10-52f4f8e265db None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:37.595503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97861e6c-a27e-494c-9c10-52f4f8e265db None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:37.595591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97861e6c-a27e-494c-9c10-52f4f8e265db None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:37.596900 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 564/1124] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:37.601996 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a2360-b760-494d-aaed-5a0c5fc89a60 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:37.602385 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a2360-b760-494d-aaed-5a0c5fc89a60 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:37.602664 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a2360-b760-494d-aaed-5a0c5fc89a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:37.619742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-a60a2360-b760-494d-aaed-5a0c5fc89a60 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:37.620918 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a60a2360-b760-494d-aaed-5a0c5fc89a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:37.676970 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:37.685935 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 561/1125] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:37.709543 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97861e6c-a27e-494c-9c10-52f4f8e265db None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:37.809055 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97861e6c-a27e-494c-9c10-52f4f8e265db None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:37.840553 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c013d0-2dd8-4eb9-8a8f-e23767d10f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:37.841394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c013d0-2dd8-4eb9-8a8f-e23767d10f09 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:37.841701 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c013d0-2dd8-4eb9-8a8f-e23767d10f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:37.841972 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c013d0-2dd8-4eb9-8a8f-e23767d10f09 None admin] PATH_INFO: `/v3/roles/986e347cbb9e43e7a49dfef9be8ec9dd` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:37.843433 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c013d0-2dd8-4eb9-8a8f-e23767d10f09 None admin] RBAC: Authorizing `identity:get_role(role_id=986e347cbb9e43e7a49dfef9be8ec9dd)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:37.844797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c013d0-2dd8-4eb9-8a8f-e23767d10f09 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:37.846220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 565/1126] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:56:37 2022] GET /identity/v3/roles/986e347cbb9e43e7a49dfef9be8ec9dd => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:37.851909 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a2360-b760-494d-aaed-5a0c5fc89a60 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:37.946570 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a2360-b760-494d-aaed-5a0c5fc89a60 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:37.978560 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae5a8b-7d49-4428-835f-f3b6d035fd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:37.979414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae5a8b-7d49-4428-835f-f3b6d035fd24 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:37.979698 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae5a8b-7d49-4428-835f-f3b6d035fd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:37.979970 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae5a8b-7d49-4428-835f-f3b6d035fd24 None admin] PATH_INFO: `/v3/users/cb5f7af7afdc42968e851d22de19c713` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:37.981147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae5a8b-7d49-4428-835f-f3b6d035fd24 None admin] RBAC: Authorizing `identity:get_user(user_id=cb5f7af7afdc42968e851d22de19c713)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:37.982617 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae5a8b-7d49-4428-835f-f3b6d035fd24 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:37.984236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 562/1127] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:56:37 2022] GET /identity/v3/users/cb5f7af7afdc42968e851d22de19c713 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:37.989903 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c013d0-2dd8-4eb9-8a8f-e23767d10f09 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:38.037490 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:38.087417 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c013d0-2dd8-4eb9-8a8f-e23767d10f09 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:38.120248 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21081246-8e95-40ac-9303-2bc4eacf9a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:38.120825 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21081246-8e95-40ac-9303-2bc4eacf9a68 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:38.121106 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21081246-8e95-40ac-9303-2bc4eacf9a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:38.121379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21081246-8e95-40ac-9303-2bc4eacf9a68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:38.185232 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21081246-8e95-40ac-9303-2bc4eacf9a68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:38.186683 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21081246-8e95-40ac-9303-2bc4eacf9a68 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:38.231779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:38.281110 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 566/1128] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:56:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:56:38.286997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae5a8b-7d49-4428-835f-f3b6d035fd24 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:38.346426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:38.383292 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae5a8b-7d49-4428-835f-f3b6d035fd24 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:38.416798 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674ae93-58af-4925-b508-bbfc16bc37d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:38.417649 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674ae93-58af-4925-b508-bbfc16bc37d0 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:38.417930 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674ae93-58af-4925-b508-bbfc16bc37d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:38.418203 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674ae93-58af-4925-b508-bbfc16bc37d0 None admin] PATH_INFO: `/v3/projects/1fc40bff90154069b70b61257d88aee6` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:38.419397 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674ae93-58af-4925-b508-bbfc16bc37d0 None admin] RBAC: Authorizing `identity:get_project(project_id=1fc40bff90154069b70b61257d88aee6)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:38.420836 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674ae93-58af-4925-b508-bbfc16bc37d0 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:38.422555 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 563/1129] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:56:38 2022] GET /identity/v3/projects/1fc40bff90154069b70b61257d88aee6 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:38.428845 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21081246-8e95-40ac-9303-2bc4eacf9a68 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:38.521785 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21081246-8e95-40ac-9303-2bc4eacf9a68 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:38.555716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666057b-6fe7-403e-a123-ec8eefdfeb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:38.556373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666057b-6fe7-403e-a123-ec8eefdfeb05 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:38.556642 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666057b-6fe7-403e-a123-ec8eefdfeb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:38.556914 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666057b-6fe7-403e-a123-ec8eefdfeb05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:38.557725 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666057b-6fe7-403e-a123-ec8eefdfeb05 None admin] RBAC: Adding query filter params (role.id=986e347cbb9e43e7a49dfef9be8ec9dd, scope.project.id=1fc40bff90154069b70b61257d88aee6, user.id=cb5f7af7afdc42968e851d22de19c713) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:38.558035 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666057b-6fe7-403e-a123-ec8eefdfeb05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:38.559459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666057b-6fe7-403e-a123-ec8eefdfeb05 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:38.565111 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 567/1130] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:56:38 2022] GET /identity/v3/role_assignments?user.id=cb5f7af7afdc42968e851d22de19c713&scope.project.id=1fc40bff90154069b70b61257d88aee6&role.id=986e347cbb9e43e7a49dfef9be8ec9dd => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:40.603600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0231e02-d01b-4e6e-985c-f9c6a5677558 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:40.604137 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0231e02-d01b-4e6e-985c-f9c6a5677558 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:40.604137 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0231e02-d01b-4e6e-985c-f9c6a5677558 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:40.605522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 564/1131] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:40.610657 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd699d2-d3b0-438a-b8fb-70a8ded60bda None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:40.611081 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd699d2-d3b0-438a-b8fb-70a8ded60bda None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:40.611216 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd699d2-d3b0-438a-b8fb-70a8ded60bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:40.627876 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-1fd699d2-d3b0-438a-b8fb-70a8ded60bda None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:40.629038 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1fd699d2-d3b0-438a-b8fb-70a8ded60bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:40.636734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:40.693815 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 568/1132] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:40.717511 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0231e02-d01b-4e6e-985c-f9c6a5677558 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:40.819579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0231e02-d01b-4e6e-985c-f9c6a5677558 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:40.847271 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:40.852844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751fc7b-3d45-4da7-8bc0-5338ac2edb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:40.853669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751fc7b-3d45-4da7-8bc0-5338ac2edb5d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:40.853910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751fc7b-3d45-4da7-8bc0-5338ac2edb5d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:40.854186 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751fc7b-3d45-4da7-8bc0-5338ac2edb5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:40.855387 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751fc7b-3d45-4da7-8bc0-5338ac2edb5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:40.856817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751fc7b-3d45-4da7-8bc0-5338ac2edb5d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:40.858432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 565/1133] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:56:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:40.864485 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd699d2-d3b0-438a-b8fb-70a8ded60bda None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:40.965280 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd699d2-d3b0-438a-b8fb-70a8ded60bda None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:40.998629 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4457a-a75a-49ac-87ce-6fea86493a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:40.999277 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4457a-a75a-49ac-87ce-6fea86493a90 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:40.999561 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4457a-a75a-49ac-87ce-6fea86493a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:40.999842 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4457a-a75a-49ac-87ce-6fea86493a90 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:41.000553 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4457a-a75a-49ac-87ce-6fea86493a90 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:41.001972 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4457a-a75a-49ac-87ce-6fea86493a90 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:41.014453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:41.027076 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 569/1134] 10.222.0.79 () {60 vars in 1141 bytes} [Thu Jul 14 11:56:40 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:56:43.053058 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9122c-f34e-4947-a2a4-e1fb711c3ecb None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:43.053581 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9122c-f34e-4947-a2a4-e1fb711c3ecb None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:43.053581 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9122c-f34e-4947-a2a4-e1fb711c3ecb None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:43.054969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 566/1135] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:43.060755 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092c296-b404-4816-a382-58dd73f4ffbe None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:43.061163 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092c296-b404-4816-a382-58dd73f4ffbe None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:43.061306 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092c296-b404-4816-a382-58dd73f4ffbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:43.077560 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-b092c296-b404-4816-a382-58dd73f4ffbe None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:43.078771 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b092c296-b404-4816-a382-58dd73f4ffbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:43.142598 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 570/1136] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:43.167271 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9122c-f34e-4947-a2a4-e1fb711c3ecb None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:43.266686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9122c-f34e-4947-a2a4-e1fb711c3ecb None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:43.298927 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bd6ea-06d1-497f-9281-966beebca148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:43.299701 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bd6ea-06d1-497f-9281-966beebca148 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:43.299985 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bd6ea-06d1-497f-9281-966beebca148 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:43.300261 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bd6ea-06d1-497f-9281-966beebca148 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:43.301692 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bd6ea-06d1-497f-9281-966beebca148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:43.303259 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bd6ea-06d1-497f-9281-966beebca148 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:43.304773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 567/1137] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:56:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:43.311005 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092c296-b404-4816-a382-58dd73f4ffbe None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:43.405781 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092c296-b404-4816-a382-58dd73f4ffbe None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:43.431296 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:43.442624 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b73ab1-0670-4ae9-a962-2c0f359bf178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:43.443298 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b73ab1-0670-4ae9-a962-2c0f359bf178 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:43.443579 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b73ab1-0670-4ae9-a962-2c0f359bf178 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:43.443874 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b73ab1-0670-4ae9-a962-2c0f359bf178 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:43.444586 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b73ab1-0670-4ae9-a962-2c0f359bf178 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:43.446054 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b73ab1-0670-4ae9-a962-2c0f359bf178 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:43.465814 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 571/1138] 10.222.0.79 () {60 vars in 1132 bytes} [Thu Jul 14 11:56:43 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:56:45.507505 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d4bd3-6aeb-43aa-9243-db1348f01a1d None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:45.508140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d4bd3-6aeb-43aa-9243-db1348f01a1d None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:45.508140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d4bd3-6aeb-43aa-9243-db1348f01a1d None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:45.509986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 568/1139] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:45.515182 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c63b86-70fb-4d0a-a004-5ef945b52cfb None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:45.515606 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c63b86-70fb-4d0a-a004-5ef945b52cfb None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:45.515726 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c63b86-70fb-4d0a-a004-5ef945b52cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:45.532833 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a8c63b86-70fb-4d0a-a004-5ef945b52cfb None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:45.534005 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a8c63b86-70fb-4d0a-a004-5ef945b52cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:45.597990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 572/1140] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:56:45.621111 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d4bd3-6aeb-43aa-9243-db1348f01a1d None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:45.687263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:45.720403 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d4bd3-6aeb-43aa-9243-db1348f01a1d None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:45.753646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a8f99-4fe7-4c20-851f-8ca5e4741718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:45.754433 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a8f99-4fe7-4c20-851f-8ca5e4741718 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:45.754754 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a8f99-4fe7-4c20-851f-8ca5e4741718 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:45.755036 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a8f99-4fe7-4c20-851f-8ca5e4741718 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:45.765509 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a8f99-4fe7-4c20-851f-8ca5e4741718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:56:45.772981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-9b2a8f99-4fe7-4c20-851f-8ca5e4741718 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:56:45.772981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:45.772981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:45.772981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:45.772981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:45.772981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:45.772981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:45.772981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:45.772981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:45.772981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:45.772981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:45.772981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:45.772981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:56:45.772981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:56:45.772981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:56:45.772981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:56:45.774155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:56:45.774155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:56:45.774155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:56:45.774155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:56:45.774155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:45.774155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:45.774155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:45.774155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:45.774155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:45.774155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:45.774155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:45.774155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:45.774155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:45.774155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:45.774155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:45.774155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:45.775140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:45.775140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:45.775140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:45.775140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:45.775140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:56:45.775140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:56:45.775140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:56:45.775140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:56:45.775140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:56:45.775140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:56:45.775140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:56:45.775140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:45.775140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 569/1141] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:56:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:45.780106 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c63b86-70fb-4d0a-a004-5ef945b52cfb None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:45.874180 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c63b86-70fb-4d0a-a004-5ef945b52cfb None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:45.885567 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:45.909323 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702e712-2699-4ca4-9524-3d9c892b761e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:45.909997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702e712-2699-4ca4-9524-3d9c892b761e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:45.910283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702e712-2699-4ca4-9524-3d9c892b761e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:45.910592 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702e712-2699-4ca4-9524-3d9c892b761e None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:45.911377 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5702e712-2699-4ca4-9524-3d9c892b761e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:45.911687 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5702e712-2699-4ca4-9524-3d9c892b761e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:45.913053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5702e712-2699-4ca4-9524-3d9c892b761e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:45.921098 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 573/1142] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:56:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:45.927247 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a8f99-4fe7-4c20-851f-8ca5e4741718 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:46.025785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a8f99-4fe7-4c20-851f-8ca5e4741718 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:46.051334 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:46.060063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec0792-ff7e-47e8-bb98-bfa0e1d5cecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:46.060919 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec0792-ff7e-47e8-bb98-bfa0e1d5cecf None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:46.061204 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec0792-ff7e-47e8-bb98-bfa0e1d5cecf None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:46.061481 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec0792-ff7e-47e8-bb98-bfa0e1d5cecf None admin] PATH_INFO: `/v3/users/97f832eb32084c33becd433684ede2e2` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:46.075704 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec0792-ff7e-47e8-bb98-bfa0e1d5cecf None admin] RBAC: Authorizing `identity:get_user(user_id=97f832eb32084c33becd433684ede2e2)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:46.077170 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec0792-ff7e-47e8-bb98-bfa0e1d5cecf None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:46.078920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 570/1143] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:56:45 2022] GET /identity/v3/users/97f832eb32084c33becd433684ede2e2 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:46.084695 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702e712-2699-4ca4-9524-3d9c892b761e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:46.183052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702e712-2699-4ca4-9524-3d9c892b761e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:46.215714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb153db4-5e1d-47d1-872b-cdabda2c403c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:46.216351 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb153db4-5e1d-47d1-872b-cdabda2c403c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:46.216633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb153db4-5e1d-47d1-872b-cdabda2c403c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:46.216907 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb153db4-5e1d-47d1-872b-cdabda2c403c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:46.255937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:46.282626 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb153db4-5e1d-47d1-872b-cdabda2c403c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:46.283988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb153db4-5e1d-47d1-872b-cdabda2c403c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:46.376491 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 574/1144] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:56:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:56:46.382363 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec0792-ff7e-47e8-bb98-bfa0e1d5cecf None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:46.484429 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec0792-ff7e-47e8-bb98-bfa0e1d5cecf None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:46.516928 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e76eb-3d0d-4e55-8ae0-24c68a7f952d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:46.517775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e76eb-3d0d-4e55-8ae0-24c68a7f952d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:46.518053 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e76eb-3d0d-4e55-8ae0-24c68a7f952d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:46.518321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e76eb-3d0d-4e55-8ae0-24c68a7f952d None admin] PATH_INFO: `/v3/projects/11cf3c0ac2c64c3c8772117e3ab97517` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:46.519498 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e76eb-3d0d-4e55-8ae0-24c68a7f952d None admin] RBAC: Authorizing `identity:get_project(project_id=11cf3c0ac2c64c3c8772117e3ab97517)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:46.520924 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e76eb-3d0d-4e55-8ae0-24c68a7f952d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:46.522606 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 571/1145] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:56:46 2022] GET /identity/v3/projects/11cf3c0ac2c64c3c8772117e3ab97517 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:46.529088 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb153db4-5e1d-47d1-872b-cdabda2c403c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:46.595343 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:46.625024 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb153db4-5e1d-47d1-872b-cdabda2c403c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:46.657667 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa29cc-de1b-4ac8-884f-9083377caab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:46.658314 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa29cc-de1b-4ac8-884f-9083377caab8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:46.658629 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa29cc-de1b-4ac8-884f-9083377caab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:46.658910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa29cc-de1b-4ac8-884f-9083377caab8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:46.659735 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa29cc-de1b-4ac8-884f-9083377caab8 None admin] RBAC: Adding query filter params (role.id=eff4f9bbb7064bc1a0f9fc55a05fea51, scope.project.id=11cf3c0ac2c64c3c8772117e3ab97517, user.id=97f832eb32084c33becd433684ede2e2) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:46.660052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa29cc-de1b-4ac8-884f-9083377caab8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:46.661477 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa29cc-de1b-4ac8-884f-9083377caab8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:46.667424 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 575/1146] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:56:46 2022] GET /identity/v3/role_assignments?user.id=97f832eb32084c33becd433684ede2e2&scope.project.id=11cf3c0ac2c64c3c8772117e3ab97517&role.id=eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:48.643814 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7115b-cb98-4ceb-a21c-4d0d74075ab7 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:48.644353 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7115b-cb98-4ceb-a21c-4d0d74075ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:48.644353 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7115b-cb98-4ceb-a21c-4d0d74075ab7 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:48.645738 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 572/1147] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:48.651396 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdaa1d-074e-4030-9538-e4f551e3b039 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:48.651961 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdaa1d-074e-4030-9538-e4f551e3b039 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:48.651961 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdaa1d-074e-4030-9538-e4f551e3b039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:48.670066 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-31bdaa1d-074e-4030-9538-e4f551e3b039 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:48.671272 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-31bdaa1d-074e-4030-9538-e4f551e3b039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:48.737981 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 576/1148] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:48.760698 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7115b-cb98-4ceb-a21c-4d0d74075ab7 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:48.815844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:48.860998 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7115b-cb98-4ceb-a21c-4d0d74075ab7 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:48.892915 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31c1a4-695a-4a75-b027-22e450cb7d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:48.893688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31c1a4-695a-4a75-b027-22e450cb7d89 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:48.894023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31c1a4-695a-4a75-b027-22e450cb7d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:48.894244 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31c1a4-695a-4a75-b027-22e450cb7d89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:48.904429 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31c1a4-695a-4a75-b027-22e450cb7d89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:56:48.911894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-8f31c1a4-695a-4a75-b027-22e450cb7d89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:56:48.911894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:48.911894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:48.911894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:48.911894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:48.911894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:48.911894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:48.911894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:48.911894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:48.911894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:48.911894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:48.911894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:48.911894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:56:48.911894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:56:48.911894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:56:48.911894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:56:48.912950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:56:48.912950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:56:48.912950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:56:48.912950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:56:48.912950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:48.912950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:48.912950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:48.912950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:48.912950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:48.912950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:48.912950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:48.912950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:48.912950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:48.912950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:48.912950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:48.912950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:48.913925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:48.913925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:48.913925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:48.913925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:48.913925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:56:48.913925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:56:48.913925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:56:48.913925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:56:48.913925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:56:48.913925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:56:48.913925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:56:48.913925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:48.913925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 573/1149] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:56:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:48.919952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdaa1d-074e-4030-9538-e4f551e3b039 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:48.983564 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:49.016892 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdaa1d-074e-4030-9538-e4f551e3b039 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:49.050438 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6c0e8-4e28-4243-b657-ee442830e3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:49.051395 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6c0e8-4e28-4243-b657-ee442830e3da None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:49.051682 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6c0e8-4e28-4243-b657-ee442830e3da None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:49.051963 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6c0e8-4e28-4243-b657-ee442830e3da None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:49.052703 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6c0e8-4e28-4243-b657-ee442830e3da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:49.053016 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6c0e8-4e28-4243-b657-ee442830e3da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:49.054375 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6c0e8-4e28-4243-b657-ee442830e3da None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:49.062231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 577/1150] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:56:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:49.068102 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31c1a4-695a-4a75-b027-22e450cb7d89 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:49.166383 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31c1a4-695a-4a75-b027-22e450cb7d89 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:49.179602 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:49.199736 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275808b-5cc0-4e9d-bc9f-06fed721cb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:49.200597 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275808b-5cc0-4e9d-bc9f-06fed721cb7b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:49.200883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275808b-5cc0-4e9d-bc9f-06fed721cb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:49.201159 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275808b-5cc0-4e9d-bc9f-06fed721cb7b None admin] PATH_INFO: `/v3/users/97f832eb32084c33becd433684ede2e2` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:49.202336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275808b-5cc0-4e9d-bc9f-06fed721cb7b None admin] RBAC: Authorizing `identity:get_user(user_id=97f832eb32084c33becd433684ede2e2)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:49.203806 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275808b-5cc0-4e9d-bc9f-06fed721cb7b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:49.205427 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 574/1151] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:56:49 2022] GET /identity/v3/users/97f832eb32084c33becd433684ede2e2 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:49.211862 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6c0e8-4e28-4243-b657-ee442830e3da None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:49.310705 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6c0e8-4e28-4243-b657-ee442830e3da None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:49.335619 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:49.344484 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528b815-80a2-4105-a8ba-080aaef06169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:49.345343 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528b815-80a2-4105-a8ba-080aaef06169 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:49.345627 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528b815-80a2-4105-a8ba-080aaef06169 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:49.345904 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528b815-80a2-4105-a8ba-080aaef06169 None admin] PATH_INFO: `/v3/projects/11cf3c0ac2c64c3c8772117e3ab97517` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:49.347092 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528b815-80a2-4105-a8ba-080aaef06169 None admin] RBAC: Authorizing `identity:get_project(project_id=11cf3c0ac2c64c3c8772117e3ab97517)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:49.348521 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528b815-80a2-4105-a8ba-080aaef06169 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:49.350225 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 578/1152] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:56:49 2022] GET /identity/v3/projects/11cf3c0ac2c64c3c8772117e3ab97517 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:49.356328 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275808b-5cc0-4e9d-bc9f-06fed721cb7b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:49.453643 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275808b-5cc0-4e9d-bc9f-06fed721cb7b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:49.484870 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999deb6-d6b4-461b-8e0e-7669f9b8b1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:49.485744 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999deb6-d6b4-461b-8e0e-7669f9b8b1d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:49.486023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999deb6-d6b4-461b-8e0e-7669f9b8b1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:49.486294 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999deb6-d6b4-461b-8e0e-7669f9b8b1d4 None admin] PATH_INFO: `/v3/projects/11cf3c0ac2c64c3c8772117e3ab97517/users/97f832eb32084c33becd433684ede2e2/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:49.488264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999deb6-d6b4-461b-8e0e-7669f9b8b1d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=11cf3c0ac2c64c3c8772117e3ab97517, user_id=97f832eb32084c33becd433684ede2e2, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:49.489694 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999deb6-d6b4-461b-8e0e-7669f9b8b1d4 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:49.502977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 575/1153] 10.222.0.79 () {58 vars in 1439 bytes} [Thu Jul 14 11:56:49 2022] PUT /identity/v3/projects/11cf3c0ac2c64c3c8772117e3ab97517/users/97f832eb32084c33becd433684ede2e2/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:56:51.494509 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cb385-9f93-46bc-bb8d-bb5649a49578 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:51.495106 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cb385-9f93-46bc-bb8d-bb5649a49578 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:51.495106 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cb385-9f93-46bc-bb8d-bb5649a49578 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:51.496460 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 579/1154] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:51.501477 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf574197-fcdf-4e86-b08b-2918fdaa572c None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:51.501862 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf574197-fcdf-4e86-b08b-2918fdaa572c None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:51.502045 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf574197-fcdf-4e86-b08b-2918fdaa572c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:51.518257 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-bf574197-fcdf-4e86-b08b-2918fdaa572c None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:51.519507 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-bf574197-fcdf-4e86-b08b-2918fdaa572c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:51.553110 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:51.584478 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 576/1155] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:51.608682 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cb385-9f93-46bc-bb8d-bb5649a49578 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:51.706843 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cb385-9f93-46bc-bb8d-bb5649a49578 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:51.740211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6de64-6e97-4e67-811b-84f6c46715f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:51.741478 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6de64-6e97-4e67-811b-84f6c46715f2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:51.741478 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6de64-6e97-4e67-811b-84f6c46715f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:51.741678 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6de64-6e97-4e67-811b-84f6c46715f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:51.751677 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6de64-6e97-4e67-811b-84f6c46715f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:56:51.759169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-bfe6de64-6e97-4e67-811b-84f6c46715f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:56:51.759169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:51.759169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:51.759169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:51.759169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:51.759169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:51.759169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:51.759169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:51.759169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:51.759169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:51.759169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:51.759169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:51.759169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:56:51.759169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:56:51.759169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:56:51.759169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:56:51.760206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:56:51.760206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:56:51.760206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:56:51.760206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:56:51.760206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:51.760206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:51.760206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:51.760206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:51.760206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:51.760206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:51.760206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:51.760206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:51.760206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:51.760206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:51.760206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:51.760206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:51.761228 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:51.761228 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:51.761228 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:51.761228 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:51.761228 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:56:51.761228 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:56:51.761228 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:56:51.761228 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:56:51.761228 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:56:51.761228 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:56:51.761228 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:56:51.761228 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:56:51.761228 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 580/1156] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:56:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:51.766232 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf574197-fcdf-4e86-b08b-2918fdaa572c None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:51.861480 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf574197-fcdf-4e86-b08b-2918fdaa572c None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:51.892796 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac219d9-d481-4719-a823-02e6fe9d30e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:51.893442 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac219d9-d481-4719-a823-02e6fe9d30e0 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:51.893721 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac219d9-d481-4719-a823-02e6fe9d30e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:51.893993 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac219d9-d481-4719-a823-02e6fe9d30e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:51.894749 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac219d9-d481-4719-a823-02e6fe9d30e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:51.895057 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac219d9-d481-4719-a823-02e6fe9d30e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:51.896424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac219d9-d481-4719-a823-02e6fe9d30e0 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:51.905147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 577/1157] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:56:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:51.910969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6de64-6e97-4e67-811b-84f6c46715f2 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:51.966000 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:52.009446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6de64-6e97-4e67-811b-84f6c46715f2 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:52.042590 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3bf1f6-e38e-435e-b177-ed2788d6dced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:52.043449 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bf1f6-e38e-435e-b177-ed2788d6dced None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:52.043740 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bf1f6-e38e-435e-b177-ed2788d6dced None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:52.044022 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bf1f6-e38e-435e-b177-ed2788d6dced None admin] PATH_INFO: `/v3/users/97f832eb32084c33becd433684ede2e2` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:52.045207 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3bf1f6-e38e-435e-b177-ed2788d6dced None admin] RBAC: Authorizing `identity:get_user(user_id=97f832eb32084c33becd433684ede2e2)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:52.046662 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3bf1f6-e38e-435e-b177-ed2788d6dced None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:52.048288 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 581/1158] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:56:51 2022] GET /identity/v3/users/97f832eb32084c33becd433684ede2e2 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:52.054243 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac219d9-d481-4719-a823-02e6fe9d30e0 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:52.087994 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:52.150934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac219d9-d481-4719-a823-02e6fe9d30e0 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:52.182433 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bc15e-2e3c-469f-80d6-1d3f1547ebdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:52.183101 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bc15e-2e3c-469f-80d6-1d3f1547ebdf None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:52.183386 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bc15e-2e3c-469f-80d6-1d3f1547ebdf None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:52.183666 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bc15e-2e3c-469f-80d6-1d3f1547ebdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:52.248089 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1bc15e-2e3c-469f-80d6-1d3f1547ebdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:52.249548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1bc15e-2e3c-469f-80d6-1d3f1547ebdf None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:52.281304 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:52.344606 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 578/1159] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:56:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:56:52.350470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3bf1f6-e38e-435e-b177-ed2788d6dced None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:52.449743 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3bf1f6-e38e-435e-b177-ed2788d6dced None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:52.471827 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:52.482913 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bead0-2fcd-4a93-9e96-69db9fd98511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:52.483774 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bead0-2fcd-4a93-9e96-69db9fd98511 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:52.484061 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bead0-2fcd-4a93-9e96-69db9fd98511 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:52.484342 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bead0-2fcd-4a93-9e96-69db9fd98511 None admin] PATH_INFO: `/v3/projects/11cf3c0ac2c64c3c8772117e3ab97517` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:52.485524 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bead0-2fcd-4a93-9e96-69db9fd98511 None admin] RBAC: Authorizing `identity:get_project(project_id=11cf3c0ac2c64c3c8772117e3ab97517)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:52.486995 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bead0-2fcd-4a93-9e96-69db9fd98511 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:52.488692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 582/1160] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:56:52 2022] GET /identity/v3/projects/11cf3c0ac2c64c3c8772117e3ab97517 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:52.495310 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bc15e-2e3c-469f-80d6-1d3f1547ebdf None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:52.591511 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bc15e-2e3c-469f-80d6-1d3f1547ebdf None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:52.624416 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad280b99-08c9-475c-b525-2de6c7aa1ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:52.625064 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad280b99-08c9-475c-b525-2de6c7aa1ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:52.625348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad280b99-08c9-475c-b525-2de6c7aa1ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:52.625626 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad280b99-08c9-475c-b525-2de6c7aa1ba6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:52.626442 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad280b99-08c9-475c-b525-2de6c7aa1ba6 None admin] RBAC: Adding query filter params (role.id=eff4f9bbb7064bc1a0f9fc55a05fea51, scope.project.id=11cf3c0ac2c64c3c8772117e3ab97517, user.id=97f832eb32084c33becd433684ede2e2) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:52.626780 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad280b99-08c9-475c-b525-2de6c7aa1ba6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:52.628214 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad280b99-08c9-475c-b525-2de6c7aa1ba6 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:52.629951 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:52.634962 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 579/1161] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:56:52 2022] GET /identity/v3/role_assignments?user.id=97f832eb32084c33becd433684ede2e2&scope.project.id=11cf3c0ac2c64c3c8772117e3ab97517&role.id=eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:54.653075 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe681f-8559-45fe-adea-80a4b25c2b26 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:54.653632 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe681f-8559-45fe-adea-80a4b25c2b26 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:54.653632 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe681f-8559-45fe-adea-80a4b25c2b26 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:54.655036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 583/1162] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:54.660196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534ac27-5169-45e9-b6a8-845ca8770ed1 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:54.660582 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534ac27-5169-45e9-b6a8-845ca8770ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:54.660793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534ac27-5169-45e9-b6a8-845ca8770ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:54.677865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-a534ac27-5169-45e9-b6a8-845ca8770ed1 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:54.679074 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a534ac27-5169-45e9-b6a8-845ca8770ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:54.743333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 580/1163] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:54.766034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe681f-8559-45fe-adea-80a4b25c2b26 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:54.863252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe681f-8559-45fe-adea-80a4b25c2b26 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:54.896726 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f573c42-0660-472e-a228-6a557c6f8608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:54.897368 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f573c42-0660-472e-a228-6a557c6f8608 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:54.897655 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f573c42-0660-472e-a228-6a557c6f8608 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:54.897931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f573c42-0660-472e-a228-6a557c6f8608 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:54.954430 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:54.963853 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f573c42-0660-472e-a228-6a557c6f8608 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:54.965303 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f573c42-0660-472e-a228-6a557c6f8608 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:55.061997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 584/1164] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:56:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:56:55.068157 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534ac27-5169-45e9-b6a8-845ca8770ed1 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:55.166994 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534ac27-5169-45e9-b6a8-845ca8770ed1 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:55.192758 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:55.201498 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d018105-814a-4e62-841c-1acfc0003cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:55.202291 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d018105-814a-4e62-841c-1acfc0003cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:55.202605 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d018105-814a-4e62-841c-1acfc0003cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:55.202885 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d018105-814a-4e62-841c-1acfc0003cb4 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:55.209495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d018105-814a-4e62-841c-1acfc0003cb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:55.210942 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d018105-814a-4e62-841c-1acfc0003cb4 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:55.225513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-1d018105-814a-4e62-841c-1acfc0003cb4 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 14 11:56:55.225513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:55.225513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 11:56:55.225513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 11:56:55.225513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:56:55.225513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:56:55.225513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:56:55.225513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:56:55.225513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 14 11:56:55.225513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:55.225513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:56:55.225513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:55.225513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:56:55.225513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:56:55.225513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:56:55.225513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:56:55.225513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:56:55.226825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:56:55.226825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:56:55.226825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:56:55.226825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:56:55.226825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:56:55.226825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:56:55.226825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:56:55.226825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:56:55.226825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:56:55.226825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:56:55.226825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:56:55.226825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:56:55.226825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:56:55.226825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:56:55.226825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:56:55.226825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:56:55.227680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:56:55.227680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:56:55.227680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:56:55.227680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:56:55.227680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:56:55.227680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:56:55.227680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:56:55.227680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:56:55.227680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:56:55.227680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:56:55.227680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 11:56:55.227680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:56:55.227680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 14 11:56:55.227680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:56:55.227680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 581/1165] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Jul 14 11:56:55 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:56:55.233101 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f573c42-0660-472e-a228-6a557c6f8608 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:55.321132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:55.330231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f573c42-0660-472e-a228-6a557c6f8608 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:55.364338 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05cb2a2-a40b-4861-bafa-6ac342c8958c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:55.365013 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cb2a2-a40b-4861-bafa-6ac342c8958c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:55.365280 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cb2a2-a40b-4861-bafa-6ac342c8958c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:55.365552 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cb2a2-a40b-4861-bafa-6ac342c8958c None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:55.366273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05cb2a2-a40b-4861-bafa-6ac342c8958c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:56:55.366599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05cb2a2-a40b-4861-bafa-6ac342c8958c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:55.368162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05cb2a2-a40b-4861-bafa-6ac342c8958c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:55.375768 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 585/1166] 10.222.0.79 () {56 vars in 1115 bytes} [Thu Jul 14 11:56:55 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:56:57.368368 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25464-6001-41b4-849c-41fa6d61214e None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:57.368969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25464-6001-41b4-849c-41fa6d61214e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:57.368969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25464-6001-41b4-849c-41fa6d61214e None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:57.370364 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 582/1167] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:57.375756 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426b22b-ef03-4d57-a244-c053bd98b800 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:57.376216 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426b22b-ef03-4d57-a244-c053bd98b800 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:57.376307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426b22b-ef03-4d57-a244-c053bd98b800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:57.392538 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6426b22b-ef03-4d57-a244-c053bd98b800 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:57.393719 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6426b22b-ef03-4d57-a244-c053bd98b800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:57.468560 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 586/1168] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:57.495457 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f25464-6001-41b4-849c-41fa6d61214e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:56:57.601347 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f25464-6001-41b4-849c-41fa6d61214e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:56:57.640885 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d862b96-cef2-494a-95ed-b8be308ebf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:56:57.642128 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d862b96-cef2-494a-95ed-b8be308ebf92 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:57.642128 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d862b96-cef2-494a-95ed-b8be308ebf92 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:57.645310 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d862b96-cef2-494a-95ed-b8be308ebf92 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:57.646082 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d862b96-cef2-494a-95ed-b8be308ebf92 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:56:57.647503 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d862b96-cef2-494a-95ed-b8be308ebf92 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:56:57.671324 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 583/1169] 10.222.0.79 () {60 vars in 1138 bytes} [Thu Jul 14 11:56:57 2022] POST /identity/v3/domains => generated 267 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:56:59.814871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a085e-c14f-42ac-afe3-20b44cef2800 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:59.815408 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a085e-c14f-42ac-afe3-20b44cef2800 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:59.815408 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a085e-c14f-42ac-afe3-20b44cef2800 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:59.816797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 587/1170] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:56:59.822511 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df590c3c-c527-474b-bd26-e343e5fa5d6f None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:56:59.822937 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df590c3c-c527-474b-bd26-e343e5fa5d6f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:56:59.823080 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df590c3c-c527-474b-bd26-e343e5fa5d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:56:59.839854 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-df590c3c-c527-474b-bd26-e343e5fa5d6f None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:56:59.841034 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-df590c3c-c527-474b-bd26-e343e5fa5d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:56:59.881858 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:59.907167 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 584/1171] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:56:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:56:59.931383 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a085e-c14f-42ac-afe3-20b44cef2800 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:00.013854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:00.029052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a085e-c14f-42ac-afe3-20b44cef2800 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:00.061528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065e5a0-b342-4ce8-acc8-1be7ec3626cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:00.062375 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065e5a0-b342-4ce8-acc8-1be7ec3626cc None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:00.062681 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065e5a0-b342-4ce8-acc8-1be7ec3626cc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:00.062955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065e5a0-b342-4ce8-acc8-1be7ec3626cc None admin] PATH_INFO: `/v3/domains/60a71a3381c14ea2934aad4123eb2e41` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:00.073674 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065e5a0-b342-4ce8-acc8-1be7ec3626cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=60a71a3381c14ea2934aad4123eb2e41)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:57:00.075136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065e5a0-b342-4ce8-acc8-1be7ec3626cc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:57:00.076753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 588/1172] 10.222.0.79 () {56 vars in 1183 bytes} [Thu Jul 14 11:56:59 2022] GET /identity/v3/domains/60a71a3381c14ea2934aad4123eb2e41 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:57:00.082947 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df590c3c-c527-474b-bd26-e343e5fa5d6f None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:00.176957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df590c3c-c527-474b-bd26-e343e5fa5d6f None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:00.209766 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1650cb-ed0e-4696-a6c5-d1f39f4d4320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:00.210417 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1650cb-ed0e-4696-a6c5-d1f39f4d4320 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:00.210729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1650cb-ed0e-4696-a6c5-d1f39f4d4320 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:00.211052 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1650cb-ed0e-4696-a6c5-d1f39f4d4320 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:00.211800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1650cb-ed0e-4696-a6c5-d1f39f4d4320 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:57:00.213256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1650cb-ed0e-4696-a6c5-d1f39f4d4320 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:57:00.237666 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 585/1173] 10.222.0.79 () {60 vars in 1141 bytes} [Thu Jul 14 11:57:00 2022] POST /identity/v3/projects => generated 361 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:57:02.365957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c554a-611e-4d3f-ade5-8f5da08da521 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:02.366639 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c554a-611e-4d3f-ade5-8f5da08da521 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:02.366639 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c554a-611e-4d3f-ade5-8f5da08da521 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:02.367956 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 589/1174] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:57:02.373936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bea0d7-097a-4f90-ac66-ac1a70827668 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:02.374475 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bea0d7-097a-4f90-ac66-ac1a70827668 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:02.374475 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bea0d7-097a-4f90-ac66-ac1a70827668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:02.391530 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-61bea0d7-097a-4f90-ac66-ac1a70827668 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:57:02.393104 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-61bea0d7-097a-4f90-ac66-ac1a70827668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:57:02.418448 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:02.467103 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 586/1175] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:57:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:57:02.494149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c554a-611e-4d3f-ade5-8f5da08da521 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:02.595722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c554a-611e-4d3f-ade5-8f5da08da521 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:02.629467 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf0821-4caa-4494-933b-df15edd44711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:02.630290 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf0821-4caa-4494-933b-df15edd44711 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:02.630692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf0821-4caa-4494-933b-df15edd44711 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:02.630973 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf0821-4caa-4494-933b-df15edd44711 None admin] PATH_INFO: `/v3/domains/60a71a3381c14ea2934aad4123eb2e41` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:02.632168 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf0821-4caa-4494-933b-df15edd44711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=60a71a3381c14ea2934aad4123eb2e41)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:57:02.634099 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf0821-4caa-4494-933b-df15edd44711 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:57:02.635973 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 590/1176] 10.222.0.79 () {56 vars in 1183 bytes} [Thu Jul 14 11:57:02 2022] GET /identity/v3/domains/60a71a3381c14ea2934aad4123eb2e41 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:57:02.642199 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bea0d7-097a-4f90-ac66-ac1a70827668 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:02.750653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bea0d7-097a-4f90-ac66-ac1a70827668 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:02.785369 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f38b9-2834-41fd-b804-355442a0640f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:02.786355 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f38b9-2834-41fd-b804-355442a0640f None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:02.786741 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f38b9-2834-41fd-b804-355442a0640f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:02.787020 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f38b9-2834-41fd-b804-355442a0640f None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:02.787861 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f38b9-2834-41fd-b804-355442a0640f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:57:02.789906 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f38b9-2834-41fd-b804-355442a0640f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:57:02.809787 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 587/1177] 10.222.0.79 () {60 vars in 1132 bytes} [Thu Jul 14 11:57:02 2022] POST /identity/v3/users => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:57:04.877509 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac71c13-6790-4a4e-8328-2bf663c48d02 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:04.878056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac71c13-6790-4a4e-8328-2bf663c48d02 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:04.878056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac71c13-6790-4a4e-8328-2bf663c48d02 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:04.879447 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 591/1178] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:57:04.885021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e73d65-beb5-40ae-be01-98d019561523 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:04.885467 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e73d65-beb5-40ae-be01-98d019561523 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:04.885588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e73d65-beb5-40ae-be01-98d019561523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:04.902364 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-a7e73d65-beb5-40ae-be01-98d019561523 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:57:04.903573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a7e73d65-beb5-40ae-be01-98d019561523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:57:04.913783 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:04.968113 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 588/1179] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:57:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:57:04.991299 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac71c13-6790-4a4e-8328-2bf663c48d02 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:05.006672 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:05.092044 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac71c13-6790-4a4e-8328-2bf663c48d02 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:05.123969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd47ded-2c73-4e09-a4cc-373d08d239db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:05.124757 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd47ded-2c73-4e09-a4cc-373d08d239db None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:05.125043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd47ded-2c73-4e09-a4cc-373d08d239db None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:05.125319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd47ded-2c73-4e09-a4cc-373d08d239db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:05.135543 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd47ded-2c73-4e09-a4cc-373d08d239db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:57:05.143056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-5dd47ded-2c73-4e09-a4cc-373d08d239db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:57:05.143056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:57:05.143056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:57:05.143056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:57:05.143056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:57:05.143056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:57:05.143056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:57:05.143056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:57:05.143056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:57:05.143056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:57:05.143056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:57:05.143056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:57:05.143056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:57:05.143056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:57:05.143056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:57:05.143056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:57:05.144201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:57:05.144201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:57:05.144201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:57:05.144201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:57:05.144201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:57:05.144201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:57:05.144201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:57:05.144201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:57:05.144201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:57:05.144201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:57:05.144201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:57:05.144201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:57:05.144201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:57:05.144201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:57:05.144201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:57:05.144201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:57:05.145226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:57:05.145226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:57:05.145226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:57:05.145226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:57:05.145226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:57:05.145226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:57:05.145226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:57:05.145226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:57:05.145226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:57:05.145226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:57:05.145226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:57:05.145226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:57:05.145226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 592/1180] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:57:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:57:05.150830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e73d65-beb5-40ae-be01-98d019561523 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:05.248005 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e73d65-beb5-40ae-be01-98d019561523 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:05.280511 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a71480-bd77-46a6-b3fd-8118a6d75e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:05.281167 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a71480-bd77-46a6-b3fd-8118a6d75e33 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:05.281452 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a71480-bd77-46a6-b3fd-8118a6d75e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:05.281732 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a71480-bd77-46a6-b3fd-8118a6d75e33 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:05.282530 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a71480-bd77-46a6-b3fd-8118a6d75e33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:57:05.282823 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a71480-bd77-46a6-b3fd-8118a6d75e33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:57:05.284186 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a71480-bd77-46a6-b3fd-8118a6d75e33 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:57:05.292029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 589/1181] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:57:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:57:05.297804 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd47ded-2c73-4e09-a4cc-373d08d239db None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:05.373901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:05.398756 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd47ded-2c73-4e09-a4cc-373d08d239db None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:05.432055 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c23643-4733-463b-9d96-1a32c6d05527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:05.432920 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c23643-4733-463b-9d96-1a32c6d05527 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:05.433198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c23643-4733-463b-9d96-1a32c6d05527 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:05.433467 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c23643-4733-463b-9d96-1a32c6d05527 None admin] PATH_INFO: `/v3/users/b2291fc85b644b1aa1834a4c49c6ea19` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:05.446691 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c23643-4733-463b-9d96-1a32c6d05527 None admin] RBAC: Authorizing `identity:get_user(user_id=b2291fc85b644b1aa1834a4c49c6ea19)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:57:05.448119 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c23643-4733-463b-9d96-1a32c6d05527 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:57:05.449974 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 593/1182] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:57:05 2022] GET /identity/v3/users/b2291fc85b644b1aa1834a4c49c6ea19 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:57:05.455693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a71480-bd77-46a6-b3fd-8118a6d75e33 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:05.466745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:05.555528 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a71480-bd77-46a6-b3fd-8118a6d75e33 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:05.587186 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25acaa3-6d9d-4b8e-bfc7-5021aeb3d638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:05.587826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25acaa3-6d9d-4b8e-bfc7-5021aeb3d638 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:05.588111 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25acaa3-6d9d-4b8e-bfc7-5021aeb3d638 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:05.588389 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25acaa3-6d9d-4b8e-bfc7-5021aeb3d638 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:05.652535 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25acaa3-6d9d-4b8e-bfc7-5021aeb3d638 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:57:05.654255 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25acaa3-6d9d-4b8e-bfc7-5021aeb3d638 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:57:05.663608 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:05.750699 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 590/1183] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:57:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:57:05.756473 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c23643-4733-463b-9d96-1a32c6d05527 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:05.852506 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c23643-4733-463b-9d96-1a32c6d05527 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:05.880320 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:05.885529 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11052fb6-3fb6-45df-9643-29911c2deb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:05.886377 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11052fb6-3fb6-45df-9643-29911c2deb6f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:05.886687 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11052fb6-3fb6-45df-9643-29911c2deb6f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:05.886964 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11052fb6-3fb6-45df-9643-29911c2deb6f None admin] PATH_INFO: `/v3/projects/a2431769c5bf4edf8e362aec54a6dc4c` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:05.888114 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11052fb6-3fb6-45df-9643-29911c2deb6f None admin] RBAC: Authorizing `identity:get_project(project_id=a2431769c5bf4edf8e362aec54a6dc4c)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:57:05.889529 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11052fb6-3fb6-45df-9643-29911c2deb6f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:57:05.891773 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 594/1184] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:57:05 2022] GET /identity/v3/projects/a2431769c5bf4edf8e362aec54a6dc4c => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:57:05.897822 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25acaa3-6d9d-4b8e-bfc7-5021aeb3d638 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:05.994588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25acaa3-6d9d-4b8e-bfc7-5021aeb3d638 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:06.003335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:06.027836 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639bac9-3e74-4b03-a744-19f96085c15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:06.028478 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639bac9-3e74-4b03-a744-19f96085c15b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:06.028758 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639bac9-3e74-4b03-a744-19f96085c15b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:06.029028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639bac9-3e74-4b03-a744-19f96085c15b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:06.029838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639bac9-3e74-4b03-a744-19f96085c15b None admin] RBAC: Adding query filter params (role.id=eff4f9bbb7064bc1a0f9fc55a05fea51, scope.project.id=a2431769c5bf4edf8e362aec54a6dc4c, user.id=b2291fc85b644b1aa1834a4c49c6ea19) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:57:06.030146 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639bac9-3e74-4b03-a744-19f96085c15b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:57:06.031600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639bac9-3e74-4b03-a744-19f96085c15b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:57:06.036851 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 591/1185] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:57:05 2022] GET /identity/v3/role_assignments?user.id=b2291fc85b644b1aa1834a4c49c6ea19&scope.project.id=a2431769c5bf4edf8e362aec54a6dc4c&role.id=eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:57:08.004473 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ab45b-3b07-496e-89c3-5d915bed024c None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:08.005003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ab45b-3b07-496e-89c3-5d915bed024c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:08.005003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ab45b-3b07-496e-89c3-5d915bed024c None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:08.006316 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 595/1186] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:57:08.012239 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541bb86-4853-4114-8e12-79fb2892a0e6 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:08.012683 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541bb86-4853-4114-8e12-79fb2892a0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:08.012804 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541bb86-4853-4114-8e12-79fb2892a0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:08.029638 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-7541bb86-4853-4114-8e12-79fb2892a0e6 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:57:08.030872 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-7541bb86-4853-4114-8e12-79fb2892a0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:57:08.093603 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 592/1187] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:57:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:57:08.115924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ab45b-3b07-496e-89c3-5d915bed024c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:08.213531 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ab45b-3b07-496e-89c3-5d915bed024c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:08.246413 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cfc7f-dcaa-4b75-a2da-e2d690aeddc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:08.247225 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cfc7f-dcaa-4b75-a2da-e2d690aeddc3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:08.247508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cfc7f-dcaa-4b75-a2da-e2d690aeddc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:08.247780 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cfc7f-dcaa-4b75-a2da-e2d690aeddc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:08.258470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390cfc7f-dcaa-4b75-a2da-e2d690aeddc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:57:08.265886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-390cfc7f-dcaa-4b75-a2da-e2d690aeddc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:57:08.265886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:57:08.265886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:57:08.265886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:57:08.265886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:57:08.265886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:57:08.265886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:57:08.265886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:57:08.265886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:57:08.265886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:57:08.265886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:57:08.265886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:57:08.265886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:57:08.265886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:57:08.265886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:57:08.265886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:57:08.266983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:57:08.266983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:57:08.266983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:57:08.266983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:57:08.266983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:57:08.266983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:57:08.266983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:57:08.266983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:57:08.266983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:57:08.266983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:57:08.266983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:57:08.266983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:57:08.266983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:57:08.266983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:57:08.266983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:57:08.266983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:57:08.267871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:57:08.267871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:57:08.267871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:57:08.267871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:57:08.267871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:57:08.267871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:57:08.267871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:57:08.267871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:57:08.267871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:57:08.267871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:57:08.267871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:57:08.267871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:57:08.267871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 596/1188] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:57:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:57:08.273211 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541bb86-4853-4114-8e12-79fb2892a0e6 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:08.366177 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541bb86-4853-4114-8e12-79fb2892a0e6 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:08.368222 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:08.402222 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f15e0-2d94-4d28-8246-22a2016c9f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:08.402910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f15e0-2d94-4d28-8246-22a2016c9f1e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:08.403191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f15e0-2d94-4d28-8246-22a2016c9f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:08.403468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f15e0-2d94-4d28-8246-22a2016c9f1e None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:08.404209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f15e0-2d94-4d28-8246-22a2016c9f1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:57:08.404513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f15e0-2d94-4d28-8246-22a2016c9f1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:57:08.405885 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f15e0-2d94-4d28-8246-22a2016c9f1e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:57:08.414043 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 593/1189] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:57:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:57:08.419771 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cfc7f-dcaa-4b75-a2da-e2d690aeddc3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:08.478191 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:08.518578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cfc7f-dcaa-4b75-a2da-e2d690aeddc3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:08.550502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2864fce-8037-41f0-99ab-39920d20a022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:08.551645 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2864fce-8037-41f0-99ab-39920d20a022 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:08.551929 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2864fce-8037-41f0-99ab-39920d20a022 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:08.552205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2864fce-8037-41f0-99ab-39920d20a022 None admin] PATH_INFO: `/v3/users/b2291fc85b644b1aa1834a4c49c6ea19` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:08.553377 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2864fce-8037-41f0-99ab-39920d20a022 None admin] RBAC: Authorizing `identity:get_user(user_id=b2291fc85b644b1aa1834a4c49c6ea19)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:57:08.555735 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2864fce-8037-41f0-99ab-39920d20a022 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:57:08.557349 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 597/1190] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:57:08 2022] GET /identity/v3/users/b2291fc85b644b1aa1834a4c49c6ea19 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:57:08.563242 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f15e0-2d94-4d28-8246-22a2016c9f1e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:08.659001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f15e0-2d94-4d28-8246-22a2016c9f1e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:08.691840 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e17db-60f0-449f-834a-792fd9b7013e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:08.692679 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e17db-60f0-449f-834a-792fd9b7013e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:08.692965 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e17db-60f0-449f-834a-792fd9b7013e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:08.693244 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e17db-60f0-449f-834a-792fd9b7013e None admin] PATH_INFO: `/v3/projects/a2431769c5bf4edf8e362aec54a6dc4c` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:08.694484 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e17db-60f0-449f-834a-792fd9b7013e None admin] RBAC: Authorizing `identity:get_project(project_id=a2431769c5bf4edf8e362aec54a6dc4c)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:57:08.695925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e17db-60f0-449f-834a-792fd9b7013e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:57:08.697607 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 594/1191] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:57:08 2022] GET /identity/v3/projects/a2431769c5bf4edf8e362aec54a6dc4c => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:57:08.703428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2864fce-8037-41f0-99ab-39920d20a022 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:08.801651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2864fce-8037-41f0-99ab-39920d20a022 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:08.826896 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:08.834872 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e7499-27f0-4232-8edd-3b7ec8722df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:08.835782 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e7499-27f0-4232-8edd-3b7ec8722df4 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:08.836067 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e7499-27f0-4232-8edd-3b7ec8722df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:08.836344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e7499-27f0-4232-8edd-3b7ec8722df4 None admin] PATH_INFO: `/v3/projects/a2431769c5bf4edf8e362aec54a6dc4c/users/b2291fc85b644b1aa1834a4c49c6ea19/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:08.838278 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e7499-27f0-4232-8edd-3b7ec8722df4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2431769c5bf4edf8e362aec54a6dc4c, user_id=b2291fc85b644b1aa1834a4c49c6ea19, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:57:08.839735 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e7499-27f0-4232-8edd-3b7ec8722df4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:57:08.852228 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 598/1192] 10.222.0.79 () {58 vars in 1439 bytes} [Thu Jul 14 11:57:08 2022] PUT /identity/v3/projects/a2431769c5bf4edf8e362aec54a6dc4c/users/b2291fc85b644b1aa1834a4c49c6ea19/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:57:10.845927 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edcf3a-e65f-4833-b1ca-ad4242ba88f8 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:10.846445 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edcf3a-e65f-4833-b1ca-ad4242ba88f8 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:10.846575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edcf3a-e65f-4833-b1ca-ad4242ba88f8 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:10.847885 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 595/1193] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:57:10.853035 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165c1f0-5286-4ea5-b5ac-30e6efc5d8a6 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:10.853475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165c1f0-5286-4ea5-b5ac-30e6efc5d8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:10.853598 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165c1f0-5286-4ea5-b5ac-30e6efc5d8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:10.869974 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-b165c1f0-5286-4ea5-b5ac-30e6efc5d8a6 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:57:10.871320 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b165c1f0-5286-4ea5-b5ac-30e6efc5d8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:57:10.938965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 599/1194] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:57:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:57:10.964126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edcf3a-e65f-4833-b1ca-ad4242ba88f8 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:10.994650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:11.066844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edcf3a-e65f-4833-b1ca-ad4242ba88f8 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:11.100236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36a28b-5098-4cd5-b286-c848d033fca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:11.101008 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36a28b-5098-4cd5-b286-c848d033fca8 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:11.103525 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36a28b-5098-4cd5-b286-c848d033fca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:11.103525 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36a28b-5098-4cd5-b286-c848d033fca8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:11.111368 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36a28b-5098-4cd5-b286-c848d033fca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:57:11.118775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-7c36a28b-5098-4cd5-b286-c848d033fca8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:57:11.118775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:57:11.118775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:57:11.118775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:57:11.118775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:57:11.118775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:57:11.118775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:57:11.118775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:57:11.118775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:57:11.118775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:57:11.118775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:57:11.118775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:57:11.118775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:57:11.118775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:57:11.118775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:57:11.118775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:57:11.119969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:57:11.119969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:57:11.119969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:57:11.119969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:57:11.119969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:57:11.119969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:57:11.119969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:57:11.119969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:57:11.119969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:57:11.119969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:57:11.119969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:57:11.119969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:57:11.119969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:57:11.119969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:57:11.119969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:57:11.119969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:57:11.120915 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:57:11.120915 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:57:11.120915 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:57:11.120915 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:57:11.120915 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:57:11.120915 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:57:11.120915 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:57:11.120915 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:57:11.120915 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:57:11.120915 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:57:11.120915 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:57:11.120915 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:57:11.120915 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 596/1195] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:57:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:57:11.125982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165c1f0-5286-4ea5-b5ac-30e6efc5d8a6 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:11.220820 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165c1f0-5286-4ea5-b5ac-30e6efc5d8a6 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:11.237439 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:11.255772 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d77fb-939a-4eea-a882-d482a66c0f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:11.256374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d77fb-939a-4eea-a882-d482a66c0f9c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:11.256663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d77fb-939a-4eea-a882-d482a66c0f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:11.256943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d77fb-939a-4eea-a882-d482a66c0f9c None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:11.258297 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d77fb-939a-4eea-a882-d482a66c0f9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:57:11.258645 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d77fb-939a-4eea-a882-d482a66c0f9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:57:11.260003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d77fb-939a-4eea-a882-d482a66c0f9c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:57:11.267947 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 600/1196] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:57:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:57:11.273738 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36a28b-5098-4cd5-b286-c848d033fca8 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:11.361810 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:11.371238 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36a28b-5098-4cd5-b286-c848d033fca8 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:11.405211 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da30899-452a-4bb5-a6a9-f673e181beec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:11.406072 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da30899-452a-4bb5-a6a9-f673e181beec None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:11.406354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da30899-452a-4bb5-a6a9-f673e181beec None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:11.406660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da30899-452a-4bb5-a6a9-f673e181beec None admin] PATH_INFO: `/v3/users/b2291fc85b644b1aa1834a4c49c6ea19` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:11.407874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da30899-452a-4bb5-a6a9-f673e181beec None admin] RBAC: Authorizing `identity:get_user(user_id=b2291fc85b644b1aa1834a4c49c6ea19)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:57:11.409336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da30899-452a-4bb5-a6a9-f673e181beec None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:57:11.411020 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 597/1197] 10.222.0.79 () {56 vars in 1177 bytes} [Thu Jul 14 11:57:11 2022] GET /identity/v3/users/b2291fc85b644b1aa1834a4c49c6ea19 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:57:11.416953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d77fb-939a-4eea-a882-d482a66c0f9c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:11.519229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d77fb-939a-4eea-a882-d482a66c0f9c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:11.552109 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe87b3-1b58-41d6-89ff-4f45e865949e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:11.552757 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe87b3-1b58-41d6-89ff-4f45e865949e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:11.553036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe87b3-1b58-41d6-89ff-4f45e865949e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:11.553321 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe87b3-1b58-41d6-89ff-4f45e865949e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:11.600623 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:11.620916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe87b3-1b58-41d6-89ff-4f45e865949e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:57:11.622389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe87b3-1b58-41d6-89ff-4f45e865949e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:57:11.716605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 601/1198] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:57:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:57:11.722810 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da30899-452a-4bb5-a6a9-f673e181beec None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:11.818407 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da30899-452a-4bb5-a6a9-f673e181beec None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:11.849481 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f88f66-33ae-4c46-bda2-71cebd6403ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:11.850319 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f88f66-33ae-4c46-bda2-71cebd6403ea None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:11.850633 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f88f66-33ae-4c46-bda2-71cebd6403ea None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:11.850908 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f88f66-33ae-4c46-bda2-71cebd6403ea None admin] PATH_INFO: `/v3/projects/a2431769c5bf4edf8e362aec54a6dc4c` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:11.852556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f88f66-33ae-4c46-bda2-71cebd6403ea None admin] RBAC: Authorizing `identity:get_project(project_id=a2431769c5bf4edf8e362aec54a6dc4c)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:57:11.853967 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f88f66-33ae-4c46-bda2-71cebd6403ea None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:57:11.855662 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 598/1199] 10.222.0.79 () {56 vars in 1186 bytes} [Thu Jul 14 11:57:11 2022] GET /identity/v3/projects/a2431769c5bf4edf8e362aec54a6dc4c => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:57:11.861769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe87b3-1b58-41d6-89ff-4f45e865949e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:57:11.938669 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:11.957650 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe87b3-1b58-41d6-89ff-4f45e865949e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:57:11.990933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9cb50-ba87-40e9-a58a-a8e6a5947f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:57:11.991577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9cb50-ba87-40e9-a58a-a8e6a5947f83 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:57:11.991885 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9cb50-ba87-40e9-a58a-a8e6a5947f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:57:11.992160 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9cb50-ba87-40e9-a58a-a8e6a5947f83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:57:11.992975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9cb50-ba87-40e9-a58a-a8e6a5947f83 None admin] RBAC: Adding query filter params (role.id=eff4f9bbb7064bc1a0f9fc55a05fea51, scope.project.id=a2431769c5bf4edf8e362aec54a6dc4c, user.id=b2291fc85b644b1aa1834a4c49c6ea19) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:57:11.993284 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9cb50-ba87-40e9-a58a-a8e6a5947f83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:57:11.994732 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9cb50-ba87-40e9-a58a-a8e6a5947f83 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:57:12.000617 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 602/1200] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:57:11 2022] GET /identity/v3/role_assignments?user.id=b2291fc85b644b1aa1834a4c49c6ea19&scope.project.id=a2431769c5bf4edf8e362aec54a6dc4c&role.id=eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:57:21.845867 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=86 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:21.998143 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=28 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:07.446802 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75391e0-585c-4328-a1db-24e5428936be None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:07.447701 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75391e0-585c-4328-a1db-24e5428936be None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:07.447701 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75391e0-585c-4328-a1db-24e5428936be None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:07.449037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 599/1201] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:58:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:58:07.455097 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cac8e-2836-4db4-b18a-4dbfe1ab5db4 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:07.455973 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cac8e-2836-4db4-b18a-4dbfe1ab5db4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:07.455973 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cac8e-2836-4db4-b18a-4dbfe1ab5db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:07.483355 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-096cac8e-2836-4db4-b18a-4dbfe1ab5db4 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:58:07.484563 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-096cac8e-2836-4db4-b18a-4dbfe1ab5db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:58:07.589723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 603/1202] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:58:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:58:07.614921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75391e0-585c-4328-a1db-24e5428936be None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:07.775501 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75391e0-585c-4328-a1db-24e5428936be None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:07.826134 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef8ee9-1c87-407b-992a-58494169576f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:07.827019 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef8ee9-1c87-407b-992a-58494169576f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:07.827304 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef8ee9-1c87-407b-992a-58494169576f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:07.827600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef8ee9-1c87-407b-992a-58494169576f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:07.840896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef8ee9-1c87-407b-992a-58494169576f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:07.842373 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef8ee9-1c87-407b-992a-58494169576f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:07.865021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-87ef8ee9-1c87-407b-992a-58494169576f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:07.865021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:07.865021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:07.865021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:07.865021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:07.865021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:07.865021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:07.865021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:07.865021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:07.865021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:07.865021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:07.865021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:07.865021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:58:07.865021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:58:07.865021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:58:07.866374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:58:07.866374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:07.866374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:07.866374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:07.866374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:07.866374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:07.866374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:07.866374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:07.866374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:07.866374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:07.866374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:07.866374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:07.866374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:07.866374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:07.866374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:07.866374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:07.866374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:07.872756 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:58:07.872756 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:58:07.872756 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:07.872756 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:58:07.872756 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 600/1203] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:07.873348 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096cac8e-2836-4db4-b18a-4dbfe1ab5db4 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:08.020729 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096cac8e-2836-4db4-b18a-4dbfe1ab5db4 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:08.065393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:08.073574 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea485e0-846a-47dd-bea3-03b35374b3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:08.074338 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea485e0-846a-47dd-bea3-03b35374b3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:08.074693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea485e0-846a-47dd-bea3-03b35374b3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:08.075024 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea485e0-846a-47dd-bea3-03b35374b3c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:08.075773 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea485e0-846a-47dd-bea3-03b35374b3c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:08.076118 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea485e0-846a-47dd-bea3-03b35374b3c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:08.077564 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea485e0-846a-47dd-bea3-03b35374b3c8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:08.098769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 604/1204] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:08.100904 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef8ee9-1c87-407b-992a-58494169576f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:08.166951 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:08.232757 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef8ee9-1c87-407b-992a-58494169576f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:08.280629 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453dafea-f378-45d0-8451-2f1a2d93d7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:08.281576 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dafea-f378-45d0-8451-2f1a2d93d7b6 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:08.282034 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dafea-f378-45d0-8451-2f1a2d93d7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:08.282524 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dafea-f378-45d0-8451-2f1a2d93d7b6 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:08.283613 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453dafea-f378-45d0-8451-2f1a2d93d7b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:08.286279 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453dafea-f378-45d0-8451-2f1a2d93d7b6 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:08.316531 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 601/1205] 10.222.0.79 () {60 vars in 1132 bytes} [Thu Jul 14 11:58:08 2022] POST /identity/v3/users => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:58:10.741867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6fae5-1821-4caa-bb40-8a9bb91fa76d None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:10.741867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6fae5-1821-4caa-bb40-8a9bb91fa76d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:10.742333 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6fae5-1821-4caa-bb40-8a9bb91fa76d None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:10.743653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 605/1206] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:58:10.749251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ff080-e900-433b-9031-aedae9515717 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:10.749755 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ff080-e900-433b-9031-aedae9515717 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:10.749868 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ff080-e900-433b-9031-aedae9515717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:10.768902 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-6d2ff080-e900-433b-9031-aedae9515717 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:58:10.770150 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-6d2ff080-e900-433b-9031-aedae9515717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:58:10.856937 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 602/1207] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:58:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:58:10.883528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6fae5-1821-4caa-bb40-8a9bb91fa76d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:11.017412 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6fae5-1821-4caa-bb40-8a9bb91fa76d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:11.056536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0757d3-1096-4230-b831-32cc8e4fde47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:11.057337 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0757d3-1096-4230-b831-32cc8e4fde47 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:11.057622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0757d3-1096-4230-b831-32cc8e4fde47 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:11.058803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0757d3-1096-4230-b831-32cc8e4fde47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:11.071441 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0757d3-1096-4230-b831-32cc8e4fde47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:58:11.080210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-fc0757d3-1096-4230-b831-32cc8e4fde47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:58:11.080210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:11.080210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:11.080210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:11.080210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:11.080210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:11.080210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:11.080210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:11.080210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:11.080210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:11.080210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:11.080210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:11.080210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:58:11.080210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:58:11.080210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:58:11.080210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:58:11.081307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:58:11.081307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:58:11.081307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:58:11.081307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:58:11.081307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:11.081307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:11.081307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:11.081307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:11.081307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:11.081307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:11.081307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:11.081307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:11.081307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:11.081307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:11.081307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:11.081307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:11.082267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:11.082267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:11.082267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:11.082267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:11.082267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:58:11.082267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:58:11.082267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:58:11.082267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:58:11.082267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:58:11.082267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:58:11.082267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:58:11.082267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:58:11.082267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 606/1208] 10.222.0.79 () {56 vars in 1102 bytes} [Thu Jul 14 11:58:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:11.088320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ff080-e900-433b-9031-aedae9515717 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:11.131306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:11.208829 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ff080-e900-433b-9031-aedae9515717 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:11.252455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44655a38-1870-4b38-ac1a-ba3cbc8f736a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:11.253637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44655a38-1870-4b38-ac1a-ba3cbc8f736a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:11.253930 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44655a38-1870-4b38-ac1a-ba3cbc8f736a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:11.254282 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44655a38-1870-4b38-ac1a-ba3cbc8f736a None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:11.255245 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44655a38-1870-4b38-ac1a-ba3cbc8f736a None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:11.255619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44655a38-1870-4b38-ac1a-ba3cbc8f736a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:11.257262 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44655a38-1870-4b38-ac1a-ba3cbc8f736a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:11.267853 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 603/1209] 10.222.0.79 () {56 vars in 1103 bytes} [Thu Jul 14 11:58:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:58:11.273957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0757d3-1096-4230-b831-32cc8e4fde47 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:11.335343 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:11.391555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0757d3-1096-4230-b831-32cc8e4fde47 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:11.436143 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca144b8-15a4-4d89-9e29-f0fbe82db351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:11.437015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca144b8-15a4-4d89-9e29-f0fbe82db351 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:11.437346 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca144b8-15a4-4d89-9e29-f0fbe82db351 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:11.437605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca144b8-15a4-4d89-9e29-f0fbe82db351 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:11.450869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca144b8-15a4-4d89-9e29-f0fbe82db351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:11.452432 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca144b8-15a4-4d89-9e29-f0fbe82db351 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:11.471697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-3ca144b8-15a4-4d89-9e29-f0fbe82db351 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:11.471697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:11.471697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:11.471697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:11.471697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:11.471697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:11.471697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:11.471697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:11.471697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:11.471697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:11.471697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:11.471697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:11.471697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:58:11.471697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:58:11.471697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:58:11.477464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:58:11.477464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:11.477464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:11.477464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:11.477464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:11.477464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:11.477464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:11.477464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:11.477464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:11.477464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:11.477464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:11.477464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:11.477464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:11.477464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:11.477464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:11.477464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:11.477464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:11.482113 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:58:11.482113 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:58:11.482113 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:11.482113 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:58:11.482113 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 607/1210] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:11.482624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44655a38-1870-4b38-ac1a-ba3cbc8f736a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:11.620690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:11.624229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44655a38-1870-4b38-ac1a-ba3cbc8f736a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:11.682866 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991cdee-cf45-41f6-a133-0d19d21ae376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:11.683635 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991cdee-cf45-41f6-a133-0d19d21ae376 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:11.683916 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991cdee-cf45-41f6-a133-0d19d21ae376 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:11.684194 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991cdee-cf45-41f6-a133-0d19d21ae376 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:11.684965 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991cdee-cf45-41f6-a133-0d19d21ae376 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:11.685354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991cdee-cf45-41f6-a133-0d19d21ae376 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:11.687351 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991cdee-cf45-41f6-a133-0d19d21ae376 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:11.707689 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 604/1211] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:11.714816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca144b8-15a4-4d89-9e29-f0fbe82db351 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:11.860720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca144b8-15a4-4d89-9e29-f0fbe82db351 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:11.862590 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:11.918269 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9c4e8-eeec-4790-9a2c-897873d4da01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:11.919159 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9c4e8-eeec-4790-9a2c-897873d4da01 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:11.919482 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9c4e8-eeec-4790-9a2c-897873d4da01 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:11.919830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9c4e8-eeec-4790-9a2c-897873d4da01 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:11.931152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9c4e8-eeec-4790-9a2c-897873d4da01 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:11.932702 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9c4e8-eeec-4790-9a2c-897873d4da01 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:11.955253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-c6f9c4e8-eeec-4790-9a2c-897873d4da01 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:58:11.955253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:11.955253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:11.955253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:11.955253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:11.955253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:11.955253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:11.955253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:11.955253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:11.955253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:11.955253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:11.955253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:11.955253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:58:11.955253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:58:11.955253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:58:11.955253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:58:11.956753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:11.956753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:11.956753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:58:11.956753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:58:11.956753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:58:11.956753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:58:11.956753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:11.956753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:11.956753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:11.956753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:11.956753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:11.956753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:11.956753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:11.956753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:11.956753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:11.956753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:11.956753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:11.956753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:11.958188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:11.958188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:11.958188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:58:11.958188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:58:11.958188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:58:11.958188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:58:11.958188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:58:11.958188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:58:11.958188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:58:11.958188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:58:11.960954 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 608/1212] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:58:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:11.963494 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991cdee-cf45-41f6-a133-0d19d21ae376 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:12.092320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991cdee-cf45-41f6-a133-0d19d21ae376 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:12.136510 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744216a0-b68e-4086-a1c8-5b94fbbded0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:12.138791 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744216a0-b68e-4086-a1c8-5b94fbbded0e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:12.138791 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744216a0-b68e-4086-a1c8-5b94fbbded0e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:12.138791 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744216a0-b68e-4086-a1c8-5b94fbbded0e None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:12.138791 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744216a0-b68e-4086-a1c8-5b94fbbded0e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:12.139172 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744216a0-b68e-4086-a1c8-5b94fbbded0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:12.140703 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744216a0-b68e-4086-a1c8-5b94fbbded0e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:12.165304 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 605/1213] 10.222.0.79 () {56 vars in 1143 bytes} [Thu Jul 14 11:58:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:58:12.172531 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9c4e8-eeec-4790-9a2c-897873d4da01 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:12.328544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9c4e8-eeec-4790-9a2c-897873d4da01 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:12.378635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09d814-3eb0-45ae-96a5-41a05834de73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:12.379318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09d814-3eb0-45ae-96a5-41a05834de73 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:12.379599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09d814-3eb0-45ae-96a5-41a05834de73 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:12.379871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09d814-3eb0-45ae-96a5-41a05834de73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:12.425977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:12.474197 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df09d814-3eb0-45ae-96a5-41a05834de73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:12.476130 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df09d814-3eb0-45ae-96a5-41a05834de73 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:12.624259 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 609/1214] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:58:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:58:12.625593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744216a0-b68e-4086-a1c8-5b94fbbded0e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:12.650309 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:12.766051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744216a0-b68e-4086-a1c8-5b94fbbded0e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:12.812993 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8b655-3981-43b5-b1ee-30f0ae981650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:12.813863 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8b655-3981-43b5-b1ee-30f0ae981650 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:12.814229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8b655-3981-43b5-b1ee-30f0ae981650 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:12.814599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8b655-3981-43b5-b1ee-30f0ae981650 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:12.827867 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8b655-3981-43b5-b1ee-30f0ae981650 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:12.829608 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8b655-3981-43b5-b1ee-30f0ae981650 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:12.857171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-cdf8b655-3981-43b5-b1ee-30f0ae981650 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:12.857171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:12.857171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:12.857171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:12.857171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:12.857171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:12.857171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:12.857171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:12.857171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:12.857171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:12.857171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:12.857171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:12.857171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:58:12.857171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:58:12.857171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:58:12.858288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:58:12.858288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:12.858288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:12.858288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:12.858288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:12.858288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:12.858288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:12.858288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:12.858288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:12.858288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:12.858288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:12.858288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:12.858288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:12.858288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:12.858288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:12.858288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:12.858288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:12.864476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:58:12.864476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:58:12.864476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:12.864476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:58:12.864476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 606/1215] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:58:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:12.864792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09d814-3eb0-45ae-96a5-41a05834de73 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:12.949705 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:12.997774 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09d814-3eb0-45ae-96a5-41a05834de73 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:13.037955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4ae20-2051-4106-9581-8e1bc53e5521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:13.038670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4ae20-2051-4106-9581-8e1bc53e5521 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:13.039474 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4ae20-2051-4106-9581-8e1bc53e5521 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:13.039807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4ae20-2051-4106-9581-8e1bc53e5521 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:13.040714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4ae20-2051-4106-9581-8e1bc53e5521 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:13.041001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4ae20-2051-4106-9581-8e1bc53e5521 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:13.042762 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4ae20-2051-4106-9581-8e1bc53e5521 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:13.059820 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 610/1216] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:13.066064 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8b655-3981-43b5-b1ee-30f0ae981650 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:13.148476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:13.184554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8b655-3981-43b5-b1ee-30f0ae981650 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:13.222894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8a6a5-5c73-4fdc-a596-fdf357667b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:13.223730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8a6a5-5c73-4fdc-a596-fdf357667b06 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:13.224102 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8a6a5-5c73-4fdc-a596-fdf357667b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:13.224426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8a6a5-5c73-4fdc-a596-fdf357667b06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:13.232745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8a6a5-5c73-4fdc-a596-fdf357667b06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:13.234250 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8a6a5-5c73-4fdc-a596-fdf357667b06 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:13.250686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-a2c8a6a5-5c73-4fdc-a596-fdf357667b06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:58:13.250686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:13.250686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:13.250686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:13.250686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:13.250686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:13.250686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:13.250686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:13.250686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:13.250686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:13.250686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:13.250686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:13.250686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:58:13.250686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:58:13.250686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:58:13.251660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:58:13.251660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:13.251660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:13.251660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:13.251660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:13.251660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:13.251660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:13.251660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:13.251660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:13.251660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:13.251660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:13.251660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:13.251660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:13.251660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:13.251660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:13.251660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:13.251660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:13.252619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:58:13.252619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:58:13.252619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:58:13.252619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:58:13.252619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:58:13.252619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:58:13.252619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:58:13.252619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:58:13.252619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 607/1217] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:58:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:13.256321 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4ae20-2051-4106-9581-8e1bc53e5521 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:13.376945 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4ae20-2051-4106-9581-8e1bc53e5521 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:13.401967 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:13.418288 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c52fc-f806-4076-8e41-42ce5d9cf678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:13.419075 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c52fc-f806-4076-8e41-42ce5d9cf678 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:13.419388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c52fc-f806-4076-8e41-42ce5d9cf678 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:13.419640 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c52fc-f806-4076-8e41-42ce5d9cf678 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:13.420486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c52fc-f806-4076-8e41-42ce5d9cf678 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:13.420859 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c52fc-f806-4076-8e41-42ce5d9cf678 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:13.422392 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c52fc-f806-4076-8e41-42ce5d9cf678 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:13.438566 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 611/1218] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:58:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:13.445296 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8a6a5-5c73-4fdc-a596-fdf357667b06 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:13.565641 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8a6a5-5c73-4fdc-a596-fdf357667b06 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:13.600078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:13.609282 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697c786-c980-4d1b-bebc-7e40dc3899b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:13.610021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697c786-c980-4d1b-bebc-7e40dc3899b7 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:13.610325 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697c786-c980-4d1b-bebc-7e40dc3899b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:13.610638 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697c786-c980-4d1b-bebc-7e40dc3899b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:13.611509 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697c786-c980-4d1b-bebc-7e40dc3899b7 None admin] RBAC: Adding query filter params (role.id=73743e14bfe849198f3a8b549163f32b, scope.project.id=66f531bc924b41faa64743923afac319, user.id=d6070c6b901f4e2ebe621a3e42dd2d0b) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:13.611865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697c786-c980-4d1b-bebc-7e40dc3899b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:13.613332 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697c786-c980-4d1b-bebc-7e40dc3899b7 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:13.626825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 608/1219] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:58:13 2022] GET /identity/v3/role_assignments?user.id=d6070c6b901f4e2ebe621a3e42dd2d0b&scope.project.id=66f531bc924b41faa64743923afac319&role.id=73743e14bfe849198f3a8b549163f32b => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:58:15.871653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da69d3b-9e76-4b9f-a0de-86aaf7f559d5 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:15.872193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da69d3b-9e76-4b9f-a0de-86aaf7f559d5 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:15.872193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da69d3b-9e76-4b9f-a0de-86aaf7f559d5 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:15.873588 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 612/1220] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:58:15.879558 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eea1f3-7302-4e72-a4cd-14013add6143 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:15.880080 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eea1f3-7302-4e72-a4cd-14013add6143 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:15.880187 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eea1f3-7302-4e72-a4cd-14013add6143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:15.897192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-46eea1f3-7302-4e72-a4cd-14013add6143 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:58:15.898980 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-46eea1f3-7302-4e72-a4cd-14013add6143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:58:15.974326 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 609/1221] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:58:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:58:15.999257 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da69d3b-9e76-4b9f-a0de-86aaf7f559d5 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:16.115828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da69d3b-9e76-4b9f-a0de-86aaf7f559d5 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:16.152714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003fbbb-e0bc-4495-9d57-4f3bb9381d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:16.153512 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003fbbb-e0bc-4495-9d57-4f3bb9381d00 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:16.153806 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003fbbb-e0bc-4495-9d57-4f3bb9381d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:16.154086 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003fbbb-e0bc-4495-9d57-4f3bb9381d00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:16.164275 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003fbbb-e0bc-4495-9d57-4f3bb9381d00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:58:16.171955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-6003fbbb-e0bc-4495-9d57-4f3bb9381d00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:58:16.171955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:16.171955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:16.171955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:16.171955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:16.171955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:16.171955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:16.171955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:16.171955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:16.171955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:16.171955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:16.171955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:16.171955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:58:16.171955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:58:16.171955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:58:16.171955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:58:16.173034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:58:16.173034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:58:16.173034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:58:16.173034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:58:16.173034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:16.173034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:16.173034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:16.173034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:16.173034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:16.173034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:16.173034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:16.173034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:16.173034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:16.173034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:16.173034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:16.173034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:16.173901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:16.173901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:16.173901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:16.173901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:16.173901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:58:16.173901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:58:16.173901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:58:16.173901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:58:16.173901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:58:16.173901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:58:16.173901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:58:16.173901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:58:16.173901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 613/1222] 10.222.0.79 () {56 vars in 1102 bytes} [Thu Jul 14 11:58:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:16.180269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eea1f3-7302-4e72-a4cd-14013add6143 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:16.286639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eea1f3-7302-4e72-a4cd-14013add6143 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:16.310961 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:16.326930 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d375c95-919f-49b2-ac3d-b720ee597c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:16.327967 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d375c95-919f-49b2-ac3d-b720ee597c2f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:16.328286 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d375c95-919f-49b2-ac3d-b720ee597c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:16.328753 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d375c95-919f-49b2-ac3d-b720ee597c2f None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:16.329819 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d375c95-919f-49b2-ac3d-b720ee597c2f None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:16.330376 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d375c95-919f-49b2-ac3d-b720ee597c2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:16.331821 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d375c95-919f-49b2-ac3d-b720ee597c2f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:16.344887 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 610/1223] 10.222.0.79 () {56 vars in 1103 bytes} [Thu Jul 14 11:58:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:58:16.350816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003fbbb-e0bc-4495-9d57-4f3bb9381d00 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:16.399804 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:16.471892 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003fbbb-e0bc-4495-9d57-4f3bb9381d00 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:16.509174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca6e2f-50b5-4eaa-aa2a-95d36a3491b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:16.509991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca6e2f-50b5-4eaa-aa2a-95d36a3491b7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:16.510384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca6e2f-50b5-4eaa-aa2a-95d36a3491b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:16.510573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca6e2f-50b5-4eaa-aa2a-95d36a3491b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:16.522187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca6e2f-50b5-4eaa-aa2a-95d36a3491b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:16.524246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca6e2f-50b5-4eaa-aa2a-95d36a3491b7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:16.542344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-d9ca6e2f-50b5-4eaa-aa2a-95d36a3491b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:16.542344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:16.542344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:16.542344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:16.542344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:16.542344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:16.542344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:16.542344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:16.542344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:16.542344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:16.542344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:16.542344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:16.542344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:58:16.542344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:58:16.542344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:58:16.543494 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:58:16.543494 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:16.543494 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:16.543494 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:16.543494 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:16.543494 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:16.543494 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:16.543494 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:16.543494 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:16.543494 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:16.543494 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:16.543494 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:16.543494 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:16.543494 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:16.543494 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:16.543494 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:16.543494 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:16.549318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:58:16.549318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:58:16.549318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:16.549318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:58:16.549318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 614/1224] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:58:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:16.549615 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d375c95-919f-49b2-ac3d-b720ee597c2f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:16.669150 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d375c95-919f-49b2-ac3d-b720ee597c2f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:16.702821 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e4ea8-afaa-4922-b8f8-e970ebafed77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:16.703490 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e4ea8-afaa-4922-b8f8-e970ebafed77 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:16.703777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e4ea8-afaa-4922-b8f8-e970ebafed77 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:16.704057 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e4ea8-afaa-4922-b8f8-e970ebafed77 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:16.704773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e4ea8-afaa-4922-b8f8-e970ebafed77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:16.705084 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e4ea8-afaa-4922-b8f8-e970ebafed77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:16.706462 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e4ea8-afaa-4922-b8f8-e970ebafed77 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:16.719175 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 611/1225] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:16.726467 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca6e2f-50b5-4eaa-aa2a-95d36a3491b7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:16.834037 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:16.842349 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca6e2f-50b5-4eaa-aa2a-95d36a3491b7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:16.886296 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb691d0-424b-46ca-bb2a-9c1ac62c4f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:16.888046 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb691d0-424b-46ca-bb2a-9c1ac62c4f4e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:16.888719 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb691d0-424b-46ca-bb2a-9c1ac62c4f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:16.889314 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb691d0-424b-46ca-bb2a-9c1ac62c4f4e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:16.902834 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb691d0-424b-46ca-bb2a-9c1ac62c4f4e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:16.905464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb691d0-424b-46ca-bb2a-9c1ac62c4f4e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:16.927955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-0bb691d0-424b-46ca-bb2a-9c1ac62c4f4e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:58:16.927955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:16.927955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:16.927955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:16.927955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:16.927955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:16.927955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:16.927955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:16.927955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:16.927955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:16.927955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:16.927955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:16.927955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:58:16.927955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:58:16.927955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:58:16.927955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:58:16.929147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:16.929147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:16.929147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:58:16.929147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:58:16.929147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:58:16.929147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:58:16.929147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:16.929147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:16.929147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:16.929147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:16.929147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:16.929147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:16.929147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:16.929147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:16.929147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:16.929147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:16.929147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:16.929147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:16.930991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:16.930991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:16.930991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:58:16.930991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:58:16.930991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:58:16.930991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:58:16.930991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:58:16.930991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:58:16.930991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:58:16.930991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:58:16.935358 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 615/1226] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:58:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:16.936527 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e4ea8-afaa-4922-b8f8-e970ebafed77 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:16.999517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:17.056917 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e4ea8-afaa-4922-b8f8-e970ebafed77 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:17.093145 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1694365-e9d7-4c9e-80e1-2f6611d2bda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:17.093839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1694365-e9d7-4c9e-80e1-2f6611d2bda9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:17.094141 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1694365-e9d7-4c9e-80e1-2f6611d2bda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:17.094470 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1694365-e9d7-4c9e-80e1-2f6611d2bda9 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:17.095322 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1694365-e9d7-4c9e-80e1-2f6611d2bda9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:17.095658 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1694365-e9d7-4c9e-80e1-2f6611d2bda9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:17.097065 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1694365-e9d7-4c9e-80e1-2f6611d2bda9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:17.122637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 612/1227] 10.222.0.79 () {56 vars in 1143 bytes} [Thu Jul 14 11:58:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:17.129186 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb691d0-424b-46ca-bb2a-9c1ac62c4f4e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:17.246485 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb691d0-424b-46ca-bb2a-9c1ac62c4f4e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:17.289906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1f6b6-8821-4c4f-aeec-0d187d2bedc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:17.290788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1f6b6-8821-4c4f-aeec-0d187d2bedc2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:17.291062 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1f6b6-8821-4c4f-aeec-0d187d2bedc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:17.291371 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1f6b6-8821-4c4f-aeec-0d187d2bedc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:17.306697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1f6b6-8821-4c4f-aeec-0d187d2bedc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:17.308320 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1f6b6-8821-4c4f-aeec-0d187d2bedc2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:17.327184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-1bd1f6b6-8821-4c4f-aeec-0d187d2bedc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:17.327184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:17.327184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:17.327184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:17.327184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:17.327184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:17.327184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:17.327184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:17.327184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:17.327184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:17.327184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:17.327184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:17.327184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:58:17.327184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:58:17.327184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:58:17.328419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:58:17.328419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:17.328419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:17.328419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:17.328419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:17.328419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:17.328419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:17.328419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:17.328419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:17.328419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:17.328419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:17.328419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:17.328419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:17.328419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:17.328419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:17.328419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:17.328419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:17.329306 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:58:17.329306 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:58:17.329306 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:17.329306 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:58:17.329306 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 616/1228] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:58:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:17.334264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1694365-e9d7-4c9e-80e1-2f6611d2bda9 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:17.449961 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1694365-e9d7-4c9e-80e1-2f6611d2bda9 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:17.452480 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:17.487901 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8345015-dca9-422d-a50f-18837ad6c95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:17.488811 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345015-dca9-422d-a50f-18837ad6c95b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:17.489163 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345015-dca9-422d-a50f-18837ad6c95b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:17.489614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345015-dca9-422d-a50f-18837ad6c95b None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:17.490579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8345015-dca9-422d-a50f-18837ad6c95b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:17.491036 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8345015-dca9-422d-a50f-18837ad6c95b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:17.493034 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8345015-dca9-422d-a50f-18837ad6c95b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:17.506911 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 613/1229] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:17.513994 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1f6b6-8821-4c4f-aeec-0d187d2bedc2 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:17.525191 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:17.631580 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1f6b6-8821-4c4f-aeec-0d187d2bedc2 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:17.671334 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22122e7-d5a4-4eda-84a4-24f9d8961d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:17.672144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22122e7-d5a4-4eda-84a4-24f9d8961d0b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:17.672431 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22122e7-d5a4-4eda-84a4-24f9d8961d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:17.672710 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22122e7-d5a4-4eda-84a4-24f9d8961d0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:17.680761 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22122e7-d5a4-4eda-84a4-24f9d8961d0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:17.682279 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22122e7-d5a4-4eda-84a4-24f9d8961d0b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:17.697895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-a22122e7-d5a4-4eda-84a4-24f9d8961d0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:58:17.697895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:17.697895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:17.697895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:17.697895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:17.697895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:17.697895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:17.697895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:17.697895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:17.697895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:17.697895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:17.697895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:17.697895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:58:17.697895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:58:17.697895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:58:17.700374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:58:17.700374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:17.700374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:17.700374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:17.700374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:17.700374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:17.700374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:17.700374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:17.700374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:17.700374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:17.700374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:17.700374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:17.700374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:17.700374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:17.700374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:17.700374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:17.700374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:17.702657 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:58:17.702657 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:58:17.702657 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:58:17.702657 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:58:17.702657 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:58:17.702657 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:58:17.702657 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:58:17.702657 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:58:17.702657 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 617/1230] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:58:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:58:17.707157 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8345015-dca9-422d-a50f-18837ad6c95b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:17.844262 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8345015-dca9-422d-a50f-18837ad6c95b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:17.883792 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85caa3e-d8a8-463a-bc5e-5b3c24d67d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:17.884434 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85caa3e-d8a8-463a-bc5e-5b3c24d67d2f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:17.884723 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85caa3e-d8a8-463a-bc5e-5b3c24d67d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:17.885021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85caa3e-d8a8-463a-bc5e-5b3c24d67d2f None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:17.885793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85caa3e-d8a8-463a-bc5e-5b3c24d67d2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:17.886110 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85caa3e-d8a8-463a-bc5e-5b3c24d67d2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:17.887576 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85caa3e-d8a8-463a-bc5e-5b3c24d67d2f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:17.901198 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 614/1231] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:58:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:17.907400 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22122e7-d5a4-4eda-84a4-24f9d8961d0b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:17.986050 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:18.027326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22122e7-d5a4-4eda-84a4-24f9d8961d0b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:18.065731 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca21977-9647-4891-83f9-58e8f492b1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:18.066604 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21977-9647-4891-83f9-58e8f492b1cb None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:18.066892 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21977-9647-4891-83f9-58e8f492b1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:18.067173 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21977-9647-4891-83f9-58e8f492b1cb None admin] PATH_INFO: `/v3/projects/66f531bc924b41faa64743923afac319/users/d6070c6b901f4e2ebe621a3e42dd2d0b/roles/73743e14bfe849198f3a8b549163f32b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:18.084421 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca21977-9647-4891-83f9-58e8f492b1cb None admin] RBAC: Authorizing `identity:create_grant(project_id=66f531bc924b41faa64743923afac319, user_id=d6070c6b901f4e2ebe621a3e42dd2d0b, role_id=73743e14bfe849198f3a8b549163f32b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:18.086580 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca21977-9647-4891-83f9-58e8f492b1cb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:18.101082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 618/1232] 10.222.0.79 () {58 vars in 1439 bytes} [Thu Jul 14 11:58:17 2022] PUT /identity/v3/projects/66f531bc924b41faa64743923afac319/users/d6070c6b901f4e2ebe621a3e42dd2d0b/roles/73743e14bfe849198f3a8b549163f32b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:58:20.324675 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eada39-a732-46c2-878a-5ba2f21e714b None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:20.325256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eada39-a732-46c2-878a-5ba2f21e714b None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:20.325365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eada39-a732-46c2-878a-5ba2f21e714b None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:20.326933 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 615/1233] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:58:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:58:20.332970 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247129f-59dc-4ff7-af89-83507480d366 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:20.333416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247129f-59dc-4ff7-af89-83507480d366 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:20.333638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247129f-59dc-4ff7-af89-83507480d366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:20.351043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-b247129f-59dc-4ff7-af89-83507480d366 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:58:20.352442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b247129f-59dc-4ff7-af89-83507480d366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:58:20.426261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 619/1234] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:58:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:58:20.452595 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eada39-a732-46c2-878a-5ba2f21e714b None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:20.482716 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:20.563918 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eada39-a732-46c2-878a-5ba2f21e714b None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:20.598994 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e416666-1db4-4edc-af97-24aa712093b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:20.600054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e416666-1db4-4edc-af97-24aa712093b9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:20.600365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e416666-1db4-4edc-af97-24aa712093b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:20.600638 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e416666-1db4-4edc-af97-24aa712093b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:20.612159 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e416666-1db4-4edc-af97-24aa712093b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:58:20.620514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-2e416666-1db4-4edc-af97-24aa712093b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:58:20.620514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:20.620514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:20.620514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:20.620514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:20.620514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:20.620514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:20.620514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:20.620514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:20.620514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:20.620514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:20.620514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:20.620514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:58:20.620514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:58:20.620514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:58:20.620514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:58:20.621637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:58:20.621637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:58:20.621637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:58:20.621637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:58:20.621637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:20.621637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:20.621637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:20.621637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:20.621637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:20.621637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:20.621637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:20.621637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:20.621637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:20.621637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:20.621637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:20.621637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:20.622687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:20.622687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:20.622687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:20.622687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:20.622687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:58:20.622687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:58:20.622687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:58:20.622687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:58:20.622687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:58:20.622687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:58:20.622687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:58:20.622687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:58:20.622687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 616/1235] 10.222.0.79 () {56 vars in 1102 bytes} [Thu Jul 14 11:58:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:20.628465 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247129f-59dc-4ff7-af89-83507480d366 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:20.678416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:20.734931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247129f-59dc-4ff7-af89-83507480d366 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:20.770267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22932fe6-a42e-4bce-a273-dece27fd6a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:20.771027 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22932fe6-a42e-4bce-a273-dece27fd6a4c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:20.771320 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22932fe6-a42e-4bce-a273-dece27fd6a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:20.771603 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22932fe6-a42e-4bce-a273-dece27fd6a4c None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:20.772354 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22932fe6-a42e-4bce-a273-dece27fd6a4c None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:20.772736 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22932fe6-a42e-4bce-a273-dece27fd6a4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:20.774637 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22932fe6-a42e-4bce-a273-dece27fd6a4c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:20.783245 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 620/1236] 10.222.0.79 () {56 vars in 1103 bytes} [Thu Jul 14 11:58:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:20.792266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e416666-1db4-4edc-af97-24aa712093b9 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:20.894354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:20.912710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e416666-1db4-4edc-af97-24aa712093b9 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:20.951130 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd9d0e-f6d3-45d9-b7ac-637ce0becaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:20.952127 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd9d0e-f6d3-45d9-b7ac-637ce0becaee None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:20.952605 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd9d0e-f6d3-45d9-b7ac-637ce0becaee None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:20.952932 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd9d0e-f6d3-45d9-b7ac-637ce0becaee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:20.964185 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd9d0e-f6d3-45d9-b7ac-637ce0becaee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:20.965740 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd9d0e-f6d3-45d9-b7ac-637ce0becaee None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:20.988144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-cbfd9d0e-f6d3-45d9-b7ac-637ce0becaee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:20.988144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:20.988144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:20.988144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:20.988144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:20.988144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:20.988144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:20.988144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:20.988144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:20.988144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:20.988144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:20.988144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:20.988144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:58:20.988144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:58:20.988144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:58:20.989148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:58:20.989148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:20.989148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:20.989148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:20.989148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:20.989148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:20.989148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:20.989148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:20.989148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:20.989148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:20.989148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:20.989148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:20.989148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:20.989148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:20.989148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:20.989148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:20.989148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:20.990034 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:58:20.990034 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:58:20.990034 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:20.990034 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:58:20.990034 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 617/1237] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:20.996805 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22932fe6-a42e-4bce-a273-dece27fd6a4c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:21.114847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22932fe6-a42e-4bce-a273-dece27fd6a4c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:21.125004 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:21.151703 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f1fae-72e5-468c-87d9-b4e13717eed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:21.152292 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f1fae-72e5-468c-87d9-b4e13717eed6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:21.152574 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f1fae-72e5-468c-87d9-b4e13717eed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:21.152847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f1fae-72e5-468c-87d9-b4e13717eed6 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:21.153567 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f1fae-72e5-468c-87d9-b4e13717eed6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:21.153881 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f1fae-72e5-468c-87d9-b4e13717eed6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:21.155263 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f1fae-72e5-468c-87d9-b4e13717eed6 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:21.168036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 621/1238] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:21.173629 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd9d0e-f6d3-45d9-b7ac-637ce0becaee None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:21.284784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd9d0e-f6d3-45d9-b7ac-637ce0becaee None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:21.321994 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e378fc-1456-4ed0-becf-fa000991645b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:21.323007 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e378fc-1456-4ed0-becf-fa000991645b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:21.323326 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e378fc-1456-4ed0-becf-fa000991645b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:21.323796 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e378fc-1456-4ed0-becf-fa000991645b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:21.327687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:21.336160 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e378fc-1456-4ed0-becf-fa000991645b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:21.338302 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e378fc-1456-4ed0-becf-fa000991645b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:21.354818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-73e378fc-1456-4ed0-becf-fa000991645b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:58:21.354818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:21.354818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:21.354818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:21.354818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:21.354818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:21.354818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:21.354818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:21.354818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:21.354818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:21.354818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:21.354818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:21.354818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:58:21.354818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:58:21.354818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:58:21.354818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:58:21.356024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:21.356024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:21.356024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:58:21.356024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:58:21.356024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:58:21.356024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:58:21.356024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:21.356024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:21.356024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:21.356024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:21.356024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:21.356024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:21.356024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:21.356024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:21.356024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:21.356024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:21.356024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:21.356024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:21.357620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:21.357620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:21.357620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:58:21.357620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:58:21.357620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:58:21.357620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:58:21.357620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:58:21.357620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:58:21.357620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:58:21.357620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:58:21.357620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 618/1239] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:58:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:21.361886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f1fae-72e5-468c-87d9-b4e13717eed6 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:21.475346 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f1fae-72e5-468c-87d9-b4e13717eed6 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:21.513955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafcb40-2b4a-44d7-961d-bdc15656968e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:21.514666 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafcb40-2b4a-44d7-961d-bdc15656968e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:21.514956 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafcb40-2b4a-44d7-961d-bdc15656968e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:21.515235 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafcb40-2b4a-44d7-961d-bdc15656968e None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:21.516072 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafcb40-2b4a-44d7-961d-bdc15656968e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:21.516381 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafcb40-2b4a-44d7-961d-bdc15656968e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:21.517805 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafcb40-2b4a-44d7-961d-bdc15656968e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:21.535846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 622/1240] 10.222.0.79 () {56 vars in 1143 bytes} [Thu Jul 14 11:58:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:21.542152 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e378fc-1456-4ed0-becf-fa000991645b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:21.650981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e378fc-1456-4ed0-becf-fa000991645b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:21.691217 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76f8e7-5250-4053-8b23-0e3fb4ae7dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:21.691870 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76f8e7-5250-4053-8b23-0e3fb4ae7dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:21.692153 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76f8e7-5250-4053-8b23-0e3fb4ae7dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:21.692425 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76f8e7-5250-4053-8b23-0e3fb4ae7dd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:21.757725 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:21.764515 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76f8e7-5250-4053-8b23-0e3fb4ae7dd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:21.766171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76f8e7-5250-4053-8b23-0e3fb4ae7dd2 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:21.879840 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 619/1241] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:58:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:58:21.886319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafcb40-2b4a-44d7-961d-bdc15656968e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:21.915463 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:22.004002 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafcb40-2b4a-44d7-961d-bdc15656968e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:22.044709 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ec132-9509-46dd-87ba-732240c04dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:22.045685 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ec132-9509-46dd-87ba-732240c04dde None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:22.045969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ec132-9509-46dd-87ba-732240c04dde None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:22.046241 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ec132-9509-46dd-87ba-732240c04dde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:22.058175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ec132-9509-46dd-87ba-732240c04dde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:22.059648 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ec132-9509-46dd-87ba-732240c04dde None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:22.077105 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-532ec132-9509-46dd-87ba-732240c04dde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:22.077105 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:22.077105 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:22.077105 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:22.077105 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:22.077105 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:22.077105 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:22.077105 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:22.077105 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:22.077105 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:22.077105 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:22.077105 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:22.077105 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:58:22.077105 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:58:22.077105 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:58:22.078203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:58:22.078203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:22.078203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:22.078203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:22.078203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:22.078203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:22.078203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:22.078203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:22.078203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:22.078203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:22.078203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:22.078203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:22.078203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:22.078203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:22.078203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:22.078203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:22.078203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:22.079364 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:58:22.079364 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:58:22.079364 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:22.079364 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:58:22.079364 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 623/1242] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:58:22.085603 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76f8e7-5250-4053-8b23-0e3fb4ae7dd2 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:22.185791 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:22.192778 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76f8e7-5250-4053-8b23-0e3fb4ae7dd2 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:22.231949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66930666-d9d8-419f-b0e2-62f2fe5056fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:22.232666 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66930666-d9d8-419f-b0e2-62f2fe5056fb None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:22.232974 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66930666-d9d8-419f-b0e2-62f2fe5056fb None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:22.233258 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66930666-d9d8-419f-b0e2-62f2fe5056fb None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:22.233989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66930666-d9d8-419f-b0e2-62f2fe5056fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:22.234330 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66930666-d9d8-419f-b0e2-62f2fe5056fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:22.235805 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66930666-d9d8-419f-b0e2-62f2fe5056fb None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:22.249296 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 620/1243] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:22.255073 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ec132-9509-46dd-87ba-732240c04dde None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:22.352524 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:22.377927 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ec132-9509-46dd-87ba-732240c04dde None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:22.416355 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2f226-55f2-4456-988b-f9487ae009a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:22.417240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2f226-55f2-4456-988b-f9487ae009a3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:22.417514 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2f226-55f2-4456-988b-f9487ae009a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:22.417821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2f226-55f2-4456-988b-f9487ae009a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:22.427315 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2f226-55f2-4456-988b-f9487ae009a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:22.429188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2f226-55f2-4456-988b-f9487ae009a3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:22.446975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f0a2f226-55f2-4456-988b-f9487ae009a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:58:22.446975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:22.446975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:22.446975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:22.446975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:22.446975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:22.446975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:22.446975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:22.446975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:22.446975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:22.446975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:22.446975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:22.446975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:58:22.446975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:58:22.446975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:58:22.448057 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:58:22.448057 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:22.448057 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:22.448057 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:22.448057 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:22.448057 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:22.448057 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:22.448057 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:22.448057 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:22.448057 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:22.448057 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:22.448057 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:22.448057 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:22.448057 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:22.448057 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:22.448057 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:22.448057 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:22.448950 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:58:22.448950 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:58:22.448950 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:58:22.448950 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:58:22.448950 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:58:22.448950 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:58:22.448950 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:58:22.448950 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:58:22.448950 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 624/1244] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:58:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:22.454787 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66930666-d9d8-419f-b0e2-62f2fe5056fb None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:22.567850 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66930666-d9d8-419f-b0e2-62f2fe5056fb None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:22.607811 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ed25a-35fb-4481-8e56-d584a1f87945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:22.608667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ed25a-35fb-4481-8e56-d584a1f87945 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:22.609047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ed25a-35fb-4481-8e56-d584a1f87945 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:22.609394 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ed25a-35fb-4481-8e56-d584a1f87945 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:22.610321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ed25a-35fb-4481-8e56-d584a1f87945 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:22.610757 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ed25a-35fb-4481-8e56-d584a1f87945 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:22.612362 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ed25a-35fb-4481-8e56-d584a1f87945 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:22.625804 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 621/1245] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:58:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:22.632817 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2f226-55f2-4456-988b-f9487ae009a3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:22.759764 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2f226-55f2-4456-988b-f9487ae009a3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:22.798960 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14754e-dcd0-448c-a45c-41823fc78160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:22.800082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14754e-dcd0-448c-a45c-41823fc78160 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:22.800485 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14754e-dcd0-448c-a45c-41823fc78160 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:22.800877 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14754e-dcd0-448c-a45c-41823fc78160 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:22.801807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14754e-dcd0-448c-a45c-41823fc78160 None admin] RBAC: Adding query filter params (role.id=73743e14bfe849198f3a8b549163f32b, scope.project.id=66f531bc924b41faa64743923afac319, user.id=d6070c6b901f4e2ebe621a3e42dd2d0b) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:22.802082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14754e-dcd0-448c-a45c-41823fc78160 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:22.803831 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14754e-dcd0-448c-a45c-41823fc78160 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:22.811082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 625/1246] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:58:22 2022] GET /identity/v3/role_assignments?user.id=d6070c6b901f4e2ebe621a3e42dd2d0b&scope.project.id=66f531bc924b41faa64743923afac319&role.id=73743e14bfe849198f3a8b549163f32b => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:58:25.085736 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71baef-a0be-47b0-9f4d-11031775d23c None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:25.086256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71baef-a0be-47b0-9f4d-11031775d23c None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:25.086364 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71baef-a0be-47b0-9f4d-11031775d23c None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:25.087707 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 622/1247] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:58:25.093372 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9acec-1a52-4931-9a8b-1ca6c5b207e5 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:25.094011 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9acec-1a52-4931-9a8b-1ca6c5b207e5 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:25.094011 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9acec-1a52-4931-9a8b-1ca6c5b207e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:25.099739 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:25.114787 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-7cd9acec-1a52-4931-9a8b-1ca6c5b207e5 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:58:25.116032 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7cd9acec-1a52-4931-9a8b-1ca6c5b207e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:58:25.203151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 626/1248] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:58:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:58:25.232786 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71baef-a0be-47b0-9f4d-11031775d23c None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:25.255068 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:25.356852 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71baef-a0be-47b0-9f4d-11031775d23c None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:25.401882 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7ccbb-bee5-41b7-8b02-c43cdaa53a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:25.402795 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7ccbb-bee5-41b7-8b02-c43cdaa53a0b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:25.403056 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7ccbb-bee5-41b7-8b02-c43cdaa53a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:25.403329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7ccbb-bee5-41b7-8b02-c43cdaa53a0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:25.415465 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7ccbb-bee5-41b7-8b02-c43cdaa53a0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:58:25.423561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-97b7ccbb-bee5-41b7-8b02-c43cdaa53a0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:58:25.423561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:25.423561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:25.423561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:25.423561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:25.423561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:25.423561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:25.423561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:25.423561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:25.423561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:25.423561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:25.423561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:25.423561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:58:25.423561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:58:25.423561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:58:25.423561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:58:25.425765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:58:25.425765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:58:25.425765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:58:25.425765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:58:25.425765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:25.425765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:25.425765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:25.425765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:25.425765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:25.425765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:25.425765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:25.425765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:25.425765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:25.425765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:25.425765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:25.425765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:25.427593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:25.427593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:25.427593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:25.427593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:25.427593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:58:25.427593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:58:25.427593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:58:25.427593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:58:25.427593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:58:25.427593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:58:25.427593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:58:25.427593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:58:25.427593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 623/1249] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:58:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:25.433874 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9acec-1a52-4931-9a8b-1ca6c5b207e5 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:25.556858 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9acec-1a52-4931-9a8b-1ca6c5b207e5 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:25.588087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:25.594476 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e7886-8d4e-4669-a50e-00ebb416e151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:25.595180 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e7886-8d4e-4669-a50e-00ebb416e151 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:25.595488 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e7886-8d4e-4669-a50e-00ebb416e151 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:25.595751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e7886-8d4e-4669-a50e-00ebb416e151 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:25.596489 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e7886-8d4e-4669-a50e-00ebb416e151 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:25.596805 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e7886-8d4e-4669-a50e-00ebb416e151 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:25.598174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e7886-8d4e-4669-a50e-00ebb416e151 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:25.607718 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 627/1250] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:58:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:25.613824 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7ccbb-bee5-41b7-8b02-c43cdaa53a0b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:25.712089 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:25.738081 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7ccbb-bee5-41b7-8b02-c43cdaa53a0b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:25.776515 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896d7dc-c326-4974-987e-45a30c013b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:25.777337 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896d7dc-c326-4974-987e-45a30c013b34 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:25.777592 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896d7dc-c326-4974-987e-45a30c013b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:25.777867 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896d7dc-c326-4974-987e-45a30c013b34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:25.788366 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896d7dc-c326-4974-987e-45a30c013b34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:25.789867 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896d7dc-c326-4974-987e-45a30c013b34 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:25.806670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-e896d7dc-c326-4974-987e-45a30c013b34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:25.806670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:25.806670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:25.806670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:25.806670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:25.806670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:25.806670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:25.806670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:25.806670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:25.806670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:25.806670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:25.806670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:25.806670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:58:25.806670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:58:25.806670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:58:25.807731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:58:25.807731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:25.807731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:25.807731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:25.807731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:25.807731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:25.807731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:25.807731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:25.807731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:25.807731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:25.807731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:25.807731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:25.807731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:25.807731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:25.807731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:25.807731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:25.807731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:25.808630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:58:25.808630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:58:25.808630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:25.808630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:58:25.808630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 624/1251] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:58:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:58:25.814606 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e7886-8d4e-4669-a50e-00ebb416e151 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:25.936400 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e7886-8d4e-4669-a50e-00ebb416e151 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:25.976501 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe584ba-4d2a-4722-9122-bcd27c404acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:25.977233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe584ba-4d2a-4722-9122-bcd27c404acd None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:25.977508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe584ba-4d2a-4722-9122-bcd27c404acd None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:25.977762 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe584ba-4d2a-4722-9122-bcd27c404acd None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:25.978505 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe584ba-4d2a-4722-9122-bcd27c404acd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:25.978837 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe584ba-4d2a-4722-9122-bcd27c404acd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:25.980219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe584ba-4d2a-4722-9122-bcd27c404acd None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:25.995047 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 628/1252] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:26.000811 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896d7dc-c326-4974-987e-45a30c013b34 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:26.114294 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896d7dc-c326-4974-987e-45a30c013b34 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:26.146957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:26.155546 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09be67-c865-4cf4-995a-5d98c4bc8d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:26.156340 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09be67-c865-4cf4-995a-5d98c4bc8d96 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:26.156632 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09be67-c865-4cf4-995a-5d98c4bc8d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:26.156918 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09be67-c865-4cf4-995a-5d98c4bc8d96 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:26.164550 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09be67-c865-4cf4-995a-5d98c4bc8d96 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:26.166002 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09be67-c865-4cf4-995a-5d98c4bc8d96 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:26.181235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-1f09be67-c865-4cf4-995a-5d98c4bc8d96 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:58:26.181235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:26.181235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:26.181235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:26.181235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:26.181235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:26.181235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:26.181235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:26.181235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:26.181235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:26.181235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:26.181235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:26.181235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:58:26.181235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:58:26.181235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:58:26.181235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:58:26.182446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:26.182446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:26.182446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:58:26.182446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:58:26.182446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:58:26.182446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:58:26.182446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:26.182446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:26.182446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:26.182446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:26.182446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:26.182446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:26.182446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:26.182446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:26.182446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:26.182446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:26.182446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:26.182446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:26.183452 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:26.183452 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:26.183452 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:58:26.183452 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:58:26.183452 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:58:26.183452 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:58:26.183452 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:58:26.183452 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:58:26.183452 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:58:26.183452 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:58:26.183452 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 625/1253] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:58:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:26.188607 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe584ba-4d2a-4722-9122-bcd27c404acd None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:26.250834 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:26.296654 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe584ba-4d2a-4722-9122-bcd27c404acd None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:26.335452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eee65a-b929-4bb2-a254-1bb667cf8f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:26.336172 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eee65a-b929-4bb2-a254-1bb667cf8f30 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:26.336441 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eee65a-b929-4bb2-a254-1bb667cf8f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:26.336718 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eee65a-b929-4bb2-a254-1bb667cf8f30 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:26.337542 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eee65a-b929-4bb2-a254-1bb667cf8f30 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:26.337853 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eee65a-b929-4bb2-a254-1bb667cf8f30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:26.339294 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eee65a-b929-4bb2-a254-1bb667cf8f30 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:26.357657 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 629/1254] 10.222.0.79 () {56 vars in 1143 bytes} [Thu Jul 14 11:58:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:26.363813 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09be67-c865-4cf4-995a-5d98c4bc8d96 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:26.479334 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09be67-c865-4cf4-995a-5d98c4bc8d96 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:26.522408 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503df53f-e25f-4458-ab28-36472f3d246f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:26.523433 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503df53f-e25f-4458-ab28-36472f3d246f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:26.523868 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503df53f-e25f-4458-ab28-36472f3d246f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:26.524256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503df53f-e25f-4458-ab28-36472f3d246f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:26.586009 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:26.601834 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503df53f-e25f-4458-ab28-36472f3d246f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:26.603323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503df53f-e25f-4458-ab28-36472f3d246f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:26.709217 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 626/1255] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:58:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:58:26.715600 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eee65a-b929-4bb2-a254-1bb667cf8f30 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:26.821753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eee65a-b929-4bb2-a254-1bb667cf8f30 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:26.835295 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:26.860191 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f7e3e-d935-4164-824f-980f484cd88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:26.860996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f7e3e-d935-4164-824f-980f484cd88b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:26.861275 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f7e3e-d935-4164-824f-980f484cd88b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:26.861599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f7e3e-d935-4164-824f-980f484cd88b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:26.873103 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f7e3e-d935-4164-824f-980f484cd88b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:26.874966 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f7e3e-d935-4164-824f-980f484cd88b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:26.892933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-fe1f7e3e-d935-4164-824f-980f484cd88b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:26.892933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:26.892933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:26.892933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:26.892933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:26.892933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:26.892933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:26.892933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:26.892933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:26.892933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:26.892933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:26.892933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:26.892933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:58:26.892933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:58:26.892933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:58:26.893940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:58:26.893940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:26.893940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:26.893940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:26.893940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:26.893940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:26.893940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:26.893940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:26.893940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:26.893940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:26.893940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:26.893940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:26.893940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:26.893940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:26.893940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:26.893940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:26.893940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:26.895003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:58:26.895003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:58:26.895003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:26.895003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:58:26.895003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 630/1256] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:26.900820 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503df53f-e25f-4458-ab28-36472f3d246f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:27.000354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:27.013242 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503df53f-e25f-4458-ab28-36472f3d246f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:27.050293 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f6c3a-7570-455a-b2bc-b61a5fc451b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:27.050997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f6c3a-7570-455a-b2bc-b61a5fc451b1 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:27.051275 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f6c3a-7570-455a-b2bc-b61a5fc451b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:27.051555 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f6c3a-7570-455a-b2bc-b61a5fc451b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:27.052342 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f6c3a-7570-455a-b2bc-b61a5fc451b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:27.052708 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f6c3a-7570-455a-b2bc-b61a5fc451b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:27.054284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f6c3a-7570-455a-b2bc-b61a5fc451b1 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:27.068038 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 627/1257] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:27.073806 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f7e3e-d935-4164-824f-980f484cd88b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:27.185298 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f7e3e-d935-4164-824f-980f484cd88b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:27.222998 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61dd14-c63a-436b-a91f-6686a396906e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:27.223816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61dd14-c63a-436b-a91f-6686a396906e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:27.224103 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61dd14-c63a-436b-a91f-6686a396906e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:27.224379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61dd14-c63a-436b-a91f-6686a396906e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:27.232836 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61dd14-c63a-436b-a91f-6686a396906e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:27.234319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61dd14-c63a-436b-a91f-6686a396906e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:27.249982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-9f61dd14-c63a-436b-a91f-6686a396906e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:58:27.249982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:27.249982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:27.249982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:27.249982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:27.249982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:27.249982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:27.249982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:27.249982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:27.249982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:27.249982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:27.249982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:27.249982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:58:27.249982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:58:27.249982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:58:27.251266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:58:27.251266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:27.251266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:27.251266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:27.251266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:27.251266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:27.251266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:27.251266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:27.251266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:27.251266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:27.251266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:27.251266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:27.251266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:27.251266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:27.251266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:27.251266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:27.251266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:27.257271 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:58:27.257271 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:58:27.257271 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:58:27.257271 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:58:27.257271 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:58:27.257271 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:58:27.257271 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:58:27.257271 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:58:27.257271 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 631/1258] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:58:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:58:27.257869 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f6c3a-7570-455a-b2bc-b61a5fc451b1 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:27.368399 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f6c3a-7570-455a-b2bc-b61a5fc451b1 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:27.406407 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58746762-52eb-4de3-b33b-11000c603ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:27.407120 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58746762-52eb-4de3-b33b-11000c603ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:27.407401 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58746762-52eb-4de3-b33b-11000c603ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:27.407677 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58746762-52eb-4de3-b33b-11000c603ad5 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:27.408474 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58746762-52eb-4de3-b33b-11000c603ad5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:27.408785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58746762-52eb-4de3-b33b-11000c603ad5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:27.410251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58746762-52eb-4de3-b33b-11000c603ad5 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:27.426567 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 628/1259] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:58:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:27.433175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61dd14-c63a-436b-a91f-6686a396906e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:27.467572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:27.561305 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61dd14-c63a-436b-a91f-6686a396906e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:27.597598 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ac9c8-496c-4379-b1cf-df001fa3c5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:27.598270 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ac9c8-496c-4379-b1cf-df001fa3c5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:27.598649 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ac9c8-496c-4379-b1cf-df001fa3c5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:27.598932 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ac9c8-496c-4379-b1cf-df001fa3c5a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:27.599762 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ac9c8-496c-4379-b1cf-df001fa3c5a8 None admin] RBAC: Adding query filter params (role.id=eff4f9bbb7064bc1a0f9fc55a05fea51, scope.project.id=66f531bc924b41faa64743923afac319, user.id=d6070c6b901f4e2ebe621a3e42dd2d0b) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:27.600076 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ac9c8-496c-4379-b1cf-df001fa3c5a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:27.602025 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ac9c8-496c-4379-b1cf-df001fa3c5a8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:27.607611 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 632/1260] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:58:27 2022] GET /identity/v3/role_assignments?user.id=d6070c6b901f4e2ebe621a3e42dd2d0b&scope.project.id=66f531bc924b41faa64743923afac319&role.id=eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:29.607036 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286e721-9d02-44ed-80df-a269f0368fec None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:29.607567 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286e721-9d02-44ed-80df-a269f0368fec None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:29.607653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286e721-9d02-44ed-80df-a269f0368fec None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:29.608974 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 629/1261] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:58:29.614063 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571f5e8-a93d-40a6-88f9-2b8940d0f19a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:29.614442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571f5e8-a93d-40a6-88f9-2b8940d0f19a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:29.614660 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571f5e8-a93d-40a6-88f9-2b8940d0f19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:29.631474 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-2571f5e8-a93d-40a6-88f9-2b8940d0f19a None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:58:29.632699 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2571f5e8-a93d-40a6-88f9-2b8940d0f19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:58:29.697493 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 633/1262] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:58:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:58:29.720031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286e721-9d02-44ed-80df-a269f0368fec None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:29.731275 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:29.820143 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286e721-9d02-44ed-80df-a269f0368fec None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:29.852846 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae721ee3-8c58-4935-b9cb-b6ea5b8e5e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:29.853623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae721ee3-8c58-4935-b9cb-b6ea5b8e5e81 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:29.853905 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae721ee3-8c58-4935-b9cb-b6ea5b8e5e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:29.854178 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae721ee3-8c58-4935-b9cb-b6ea5b8e5e81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:29.864228 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae721ee3-8c58-4935-b9cb-b6ea5b8e5e81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:58:29.872149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-ae721ee3-8c58-4935-b9cb-b6ea5b8e5e81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:58:29.872149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:29.872149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:29.872149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:29.872149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:29.872149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:29.872149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:29.872149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:29.872149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:29.872149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:29.872149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:29.872149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:29.872149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:58:29.872149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:58:29.872149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:58:29.872149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:58:29.873266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:58:29.873266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:58:29.873266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:58:29.873266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:58:29.873266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:29.873266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:29.873266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:29.873266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:29.873266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:29.873266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:29.873266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:29.873266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:29.873266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:29.873266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:29.873266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:29.873266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:29.874152 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:29.874152 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:29.874152 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:29.874152 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:29.874152 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:58:29.874152 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:58:29.874152 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:58:29.874152 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:58:29.874152 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:58:29.874152 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:58:29.874152 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:58:29.874152 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:58:29.874152 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 630/1263] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:58:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:29.879591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571f5e8-a93d-40a6-88f9-2b8940d0f19a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:29.897405 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:29.975578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571f5e8-a93d-40a6-88f9-2b8940d0f19a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:30.008232 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d569cd-ff2c-4dad-970f-599e429e2d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:30.008891 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d569cd-ff2c-4dad-970f-599e429e2d25 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:30.009176 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d569cd-ff2c-4dad-970f-599e429e2d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:30.009450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d569cd-ff2c-4dad-970f-599e429e2d25 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:30.010186 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d569cd-ff2c-4dad-970f-599e429e2d25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:30.010521 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d569cd-ff2c-4dad-970f-599e429e2d25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:30.011874 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d569cd-ff2c-4dad-970f-599e429e2d25 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:30.019726 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 634/1264] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:58:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:30.025891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae721ee3-8c58-4935-b9cb-b6ea5b8e5e81 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:30.092149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:30.124723 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae721ee3-8c58-4935-b9cb-b6ea5b8e5e81 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:30.156774 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063408aa-af14-400b-8934-4762fa2929d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:30.157547 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063408aa-af14-400b-8934-4762fa2929d3 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:30.157830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063408aa-af14-400b-8934-4762fa2929d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:30.158125 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063408aa-af14-400b-8934-4762fa2929d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:30.168938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063408aa-af14-400b-8934-4762fa2929d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:30.170384 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063408aa-af14-400b-8934-4762fa2929d3 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:30.186966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-063408aa-af14-400b-8934-4762fa2929d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:30.186966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:30.186966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:30.186966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:30.186966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:30.186966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:30.186966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:30.186966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:30.186966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:30.186966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:30.186966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:30.186966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:30.186966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:58:30.186966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:58:30.186966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:58:30.187883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:58:30.187883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:30.187883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:30.187883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:30.187883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:30.187883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:30.187883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:30.187883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:30.187883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:30.187883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:30.187883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:30.187883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:30.187883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:30.187883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:30.187883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:30.187883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:30.187883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:30.188799 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:58:30.188799 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:58:30.188799 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:30.188799 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:58:30.188799 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 631/1265] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:58:30.193930 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d569cd-ff2c-4dad-970f-599e429e2d25 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:30.273641 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:30.292444 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d569cd-ff2c-4dad-970f-599e429e2d25 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:30.324615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278ddeb-ec42-48ce-b5ad-904178e89309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:30.325280 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278ddeb-ec42-48ce-b5ad-904178e89309 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:30.325571 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278ddeb-ec42-48ce-b5ad-904178e89309 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:30.325850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278ddeb-ec42-48ce-b5ad-904178e89309 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:30.326596 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278ddeb-ec42-48ce-b5ad-904178e89309 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:30.326914 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278ddeb-ec42-48ce-b5ad-904178e89309 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:30.328330 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278ddeb-ec42-48ce-b5ad-904178e89309 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:30.340274 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 635/1266] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:30.346143 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063408aa-af14-400b-8934-4762fa2929d3 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:30.449249 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063408aa-af14-400b-8934-4762fa2929d3 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:30.472903 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:30.490440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eab212-befa-4c0c-b17f-d65de00af20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:30.491431 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eab212-befa-4c0c-b17f-d65de00af20a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:30.491817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eab212-befa-4c0c-b17f-d65de00af20a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:30.492141 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eab212-befa-4c0c-b17f-d65de00af20a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:30.502551 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eab212-befa-4c0c-b17f-d65de00af20a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:30.504030 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eab212-befa-4c0c-b17f-d65de00af20a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:30.518379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-36eab212-befa-4c0c-b17f-d65de00af20a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:58:30.518379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:30.518379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:30.518379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:30.518379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:30.518379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:30.518379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:30.518379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:30.518379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:30.518379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:30.518379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:30.518379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:30.518379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:58:30.518379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:58:30.518379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:58:30.518379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:58:30.519548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:30.519548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:30.519548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:58:30.519548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:58:30.519548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:58:30.519548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:58:30.519548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:30.519548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:30.519548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:30.519548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:30.519548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:30.519548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:30.519548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:30.519548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:30.519548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:30.519548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:30.519548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:30.519548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:30.520684 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:30.520684 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:30.520684 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:58:30.520684 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:58:30.520684 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:58:30.520684 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:58:30.520684 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:58:30.520684 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:58:30.520684 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:58:30.520684 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:58:30.520684 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 632/1267] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:58:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:30.526069 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278ddeb-ec42-48ce-b5ad-904178e89309 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:30.622092 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278ddeb-ec42-48ce-b5ad-904178e89309 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:30.654876 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904aaa7d-62a7-4eee-926e-bd8c2761c1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:30.655542 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aaa7d-62a7-4eee-926e-bd8c2761c1de None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:30.655829 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aaa7d-62a7-4eee-926e-bd8c2761c1de None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:30.656108 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aaa7d-62a7-4eee-926e-bd8c2761c1de None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:30.656941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904aaa7d-62a7-4eee-926e-bd8c2761c1de None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:30.657256 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904aaa7d-62a7-4eee-926e-bd8c2761c1de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:30.658706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904aaa7d-62a7-4eee-926e-bd8c2761c1de None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:30.667344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:30.676735 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 636/1268] 10.222.0.79 () {56 vars in 1143 bytes} [Thu Jul 14 11:58:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:30.682947 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eab212-befa-4c0c-b17f-d65de00af20a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:30.779829 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eab212-befa-4c0c-b17f-d65de00af20a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:30.812233 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fedbdd-2ba2-4e60-a0d3-f57edd5adfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:30.813009 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fedbdd-2ba2-4e60-a0d3-f57edd5adfb4 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:30.813294 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fedbdd-2ba2-4e60-a0d3-f57edd5adfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:30.813571 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fedbdd-2ba2-4e60-a0d3-f57edd5adfb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:30.824246 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fedbdd-2ba2-4e60-a0d3-f57edd5adfb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:30.825702 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fedbdd-2ba2-4e60-a0d3-f57edd5adfb4 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:30.842037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-41fedbdd-2ba2-4e60-a0d3-f57edd5adfb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:30.842037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:30.842037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:30.842037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:30.842037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:30.842037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:30.842037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:30.842037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:30.842037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:30.842037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:30.842037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:30.842037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:30.842037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:58:30.842037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:58:30.842037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:58:30.843112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:58:30.843112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:30.843112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:30.843112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:30.843112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:30.843112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:30.843112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:30.843112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:30.843112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:30.843112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:30.843112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:30.843112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:30.843112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:30.843112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:30.843112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:30.843112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:30.843112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:30.844135 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:58:30.844135 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:58:30.844135 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:30.844135 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:58:30.844135 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 633/1269] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:30.848943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904aaa7d-62a7-4eee-926e-bd8c2761c1de None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:30.944605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904aaa7d-62a7-4eee-926e-bd8c2761c1de None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:30.977707 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03cffca-c3b0-4b01-a1f9-a5aad0f9959c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:30.978373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cffca-c3b0-4b01-a1f9-a5aad0f9959c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:30.978697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cffca-c3b0-4b01-a1f9-a5aad0f9959c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:30.978971 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cffca-c3b0-4b01-a1f9-a5aad0f9959c None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:30.979682 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03cffca-c3b0-4b01-a1f9-a5aad0f9959c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:30.979989 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03cffca-c3b0-4b01-a1f9-a5aad0f9959c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:30.981347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03cffca-c3b0-4b01-a1f9-a5aad0f9959c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:30.992798 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 637/1270] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:30.998839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fedbdd-2ba2-4e60-a0d3-f57edd5adfb4 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:31.029265 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:31.096770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fedbdd-2ba2-4e60-a0d3-f57edd5adfb4 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:31.129428 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417eb2fb-ecab-446d-a9c0-0c46801b0e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:31.130210 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417eb2fb-ecab-446d-a9c0-0c46801b0e94 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:31.130521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417eb2fb-ecab-446d-a9c0-0c46801b0e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:31.130812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417eb2fb-ecab-446d-a9c0-0c46801b0e94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:31.137294 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417eb2fb-ecab-446d-a9c0-0c46801b0e94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:31.138770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417eb2fb-ecab-446d-a9c0-0c46801b0e94 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:31.152564 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-417eb2fb-ecab-446d-a9c0-0c46801b0e94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:58:31.152564 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:31.152564 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:31.152564 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:31.152564 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:31.152564 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:31.152564 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:31.152564 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:31.152564 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:31.152564 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:31.152564 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:31.152564 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:31.152564 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:58:31.152564 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:58:31.152564 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:58:31.153573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:58:31.153573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:31.153573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:31.153573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:31.153573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:31.153573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:31.153573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:31.153573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:31.153573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:31.153573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:31.153573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:31.153573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:31.153573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:31.153573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:31.153573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:31.153573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:31.153573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:31.154529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:58:31.154529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:58:31.154529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:58:31.154529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:58:31.154529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:58:31.154529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:58:31.154529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:58:31.154529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:58:31.154529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 634/1271] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:58:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:58:31.159566 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03cffca-c3b0-4b01-a1f9-a5aad0f9959c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:31.216694 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:31.258192 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03cffca-c3b0-4b01-a1f9-a5aad0f9959c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:31.290581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f3a21-80bd-43b0-9b43-d3c826a3cbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:31.291238 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f3a21-80bd-43b0-9b43-d3c826a3cbb5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:31.291523 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f3a21-80bd-43b0-9b43-d3c826a3cbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:31.291804 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f3a21-80bd-43b0-9b43-d3c826a3cbb5 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:31.292581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f3a21-80bd-43b0-9b43-d3c826a3cbb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:31.292894 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f3a21-80bd-43b0-9b43-d3c826a3cbb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:31.294318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f3a21-80bd-43b0-9b43-d3c826a3cbb5 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:31.306752 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 638/1272] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:58:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:31.312664 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417eb2fb-ecab-446d-a9c0-0c46801b0e94 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:31.397653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:31.407452 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417eb2fb-ecab-446d-a9c0-0c46801b0e94 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:31.445748 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83425d-e2b4-47e4-b293-eb7999af6c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:31.446743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83425d-e2b4-47e4-b293-eb7999af6c0e None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:31.447074 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83425d-e2b4-47e4-b293-eb7999af6c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:31.447353 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83425d-e2b4-47e4-b293-eb7999af6c0e None admin] PATH_INFO: `/v3/projects/66f531bc924b41faa64743923afac319/users/d6070c6b901f4e2ebe621a3e42dd2d0b/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:31.449448 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83425d-e2b4-47e4-b293-eb7999af6c0e None admin] RBAC: Authorizing `identity:create_grant(project_id=66f531bc924b41faa64743923afac319, user_id=d6070c6b901f4e2ebe621a3e42dd2d0b, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:31.450917 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83425d-e2b4-47e4-b293-eb7999af6c0e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:31.463531 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 635/1273] 10.222.0.79 () {58 vars in 1439 bytes} [Thu Jul 14 11:58:31 2022] PUT /identity/v3/projects/66f531bc924b41faa64743923afac319/users/d6070c6b901f4e2ebe621a3e42dd2d0b/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:58:33.471526 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc072e-e1c1-45b5-ae4f-cd82ba1644ba None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:33.472062 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc072e-e1c1-45b5-ae4f-cd82ba1644ba None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:33.472062 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc072e-e1c1-45b5-ae4f-cd82ba1644ba None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:33.473450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 639/1274] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:58:33.479224 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d5ac1-fa58-4c33-b5eb-a408a129f2d7 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:33.479610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d5ac1-fa58-4c33-b5eb-a408a129f2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:33.479784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d5ac1-fa58-4c33-b5eb-a408a129f2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:33.496642 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-8b1d5ac1-fa58-4c33-b5eb-a408a129f2d7 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:58:33.497836 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-8b1d5ac1-fa58-4c33-b5eb-a408a129f2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:58:33.561536 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 636/1275] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:58:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:58:33.584429 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc072e-e1c1-45b5-ae4f-cd82ba1644ba None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:33.683422 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc072e-e1c1-45b5-ae4f-cd82ba1644ba None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:33.700255 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:33.717199 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04e029-b148-43f9-84ca-e897168514d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:33.717982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04e029-b148-43f9-84ca-e897168514d5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:33.718266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04e029-b148-43f9-84ca-e897168514d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:33.718569 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04e029-b148-43f9-84ca-e897168514d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:33.729051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04e029-b148-43f9-84ca-e897168514d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:58:33.736551 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-8a04e029-b148-43f9-84ca-e897168514d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:58:33.736551 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:33.736551 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:33.736551 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:33.736551 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:33.736551 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:33.736551 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:33.736551 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:33.736551 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:33.736551 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:33.736551 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:33.736551 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:33.736551 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:58:33.736551 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:58:33.736551 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:58:33.736551 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:58:33.737643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:58:33.737643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:58:33.737643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:58:33.737643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:58:33.737643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:33.737643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:33.737643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:33.737643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:33.737643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:33.737643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:33.737643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:33.737643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:33.737643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:33.737643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:33.737643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:33.737643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:33.738680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:33.738680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:33.738680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:33.738680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:33.738680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:58:33.738680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:58:33.738680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:58:33.738680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:58:33.738680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:58:33.738680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:58:33.738680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:58:33.738680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:58:33.742619 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 640/1276] 10.222.0.79 () {56 vars in 1096 bytes} [Thu Jul 14 11:58:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:33.743765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d5ac1-fa58-4c33-b5eb-a408a129f2d7 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:33.822447 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:33.841235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d5ac1-fa58-4c33-b5eb-a408a129f2d7 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:33.874891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a202f4-78ff-45c2-8df3-9efa7cc06cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:33.875550 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a202f4-78ff-45c2-8df3-9efa7cc06cec None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:33.875830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a202f4-78ff-45c2-8df3-9efa7cc06cec None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:33.876102 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a202f4-78ff-45c2-8df3-9efa7cc06cec None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:33.876837 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a202f4-78ff-45c2-8df3-9efa7cc06cec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:33.877142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a202f4-78ff-45c2-8df3-9efa7cc06cec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:33.878536 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a202f4-78ff-45c2-8df3-9efa7cc06cec None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:33.886263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 637/1277] 10.222.0.79 () {56 vars in 1099 bytes} [Thu Jul 14 11:58:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:33.891987 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04e029-b148-43f9-84ca-e897168514d5 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:33.988182 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04e029-b148-43f9-84ca-e897168514d5 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:34.020764 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987a8ba-3f12-4ce1-9d94-ab4a523bc527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:34.021552 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987a8ba-3f12-4ce1-9d94-ab4a523bc527 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:34.021837 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987a8ba-3f12-4ce1-9d94-ab4a523bc527 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:34.022116 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987a8ba-3f12-4ce1-9d94-ab4a523bc527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:34.032986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987a8ba-3f12-4ce1-9d94-ab4a523bc527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:34.034422 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987a8ba-3f12-4ce1-9d94-ab4a523bc527 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:34.051211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-c987a8ba-3f12-4ce1-9d94-ab4a523bc527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:34.051211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:34.051211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:34.051211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:34.051211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:34.051211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:34.051211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:34.051211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:34.051211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:34.051211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:34.051211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:34.051211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:34.051211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:58:34.051211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:58:34.051211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:58:34.052223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:58:34.052223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:34.052223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:34.052223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:34.052223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:34.052223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:34.052223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:34.052223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:34.052223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:34.052223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:34.052223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:34.052223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:34.052223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:34.052223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:34.052223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:34.052223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:34.052223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:34.053140 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:58:34.053140 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:58:34.053140 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:34.053140 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:58:34.053140 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 641/1278] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:34.058222 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a202f4-78ff-45c2-8df3-9efa7cc06cec None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:34.154197 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a202f4-78ff-45c2-8df3-9efa7cc06cec None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:34.185867 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e0a3b-aa75-47b9-b780-bf04d9efd16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:34.186547 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e0a3b-aa75-47b9-b780-bf04d9efd16a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:34.186836 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e0a3b-aa75-47b9-b780-bf04d9efd16a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:34.187116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e0a3b-aa75-47b9-b780-bf04d9efd16a None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:34.187832 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e0a3b-aa75-47b9-b780-bf04d9efd16a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:34.188142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e0a3b-aa75-47b9-b780-bf04d9efd16a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:34.189516 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e0a3b-aa75-47b9-b780-bf04d9efd16a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:34.201238 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 638/1279] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:34.206980 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987a8ba-3f12-4ce1-9d94-ab4a523bc527 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:34.237493 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:34.305798 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987a8ba-3f12-4ce1-9d94-ab4a523bc527 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:34.337983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b5eae-8301-4723-af65-bd26e61fd67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:34.338794 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b5eae-8301-4723-af65-bd26e61fd67e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:34.339078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b5eae-8301-4723-af65-bd26e61fd67e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:34.339352 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b5eae-8301-4723-af65-bd26e61fd67e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:34.346447 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b5eae-8301-4723-af65-bd26e61fd67e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:34.347895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b5eae-8301-4723-af65-bd26e61fd67e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:34.361543 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-2b3b5eae-8301-4723-af65-bd26e61fd67e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:58:34.361543 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:34.361543 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:34.361543 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:34.361543 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:34.361543 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:34.361543 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:34.361543 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:34.361543 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:34.361543 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:34.361543 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:34.361543 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:34.361543 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:58:34.361543 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:58:34.361543 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:58:34.361543 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:58:34.362664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:34.362664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:34.362664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:58:34.362664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:58:34.362664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:58:34.362664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:58:34.362664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:34.362664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:34.362664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:34.362664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:34.362664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:34.362664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:34.362664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:34.362664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:34.362664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:34.362664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:34.362664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:34.362664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:34.363990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:34.363990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:34.363990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:58:34.363990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:58:34.363990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:58:34.363990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:58:34.363990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:58:34.363990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:58:34.363990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:58:34.363990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:58:34.363990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 642/1280] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:58:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:34.369422 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e0a3b-aa75-47b9-b780-bf04d9efd16a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:34.373142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:34.476500 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e0a3b-aa75-47b9-b780-bf04d9efd16a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:34.514071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cac3a0-702e-440a-87ef-053c8c0022a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:34.514782 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cac3a0-702e-440a-87ef-053c8c0022a2 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:34.515050 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cac3a0-702e-440a-87ef-053c8c0022a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:34.515325 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cac3a0-702e-440a-87ef-053c8c0022a2 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:34.516161 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cac3a0-702e-440a-87ef-053c8c0022a2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:34.516476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cac3a0-702e-440a-87ef-053c8c0022a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:34.517907 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cac3a0-702e-440a-87ef-053c8c0022a2 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:34.535699 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 639/1281] 10.222.0.79 () {56 vars in 1143 bytes} [Thu Jul 14 11:58:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:34.541943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b5eae-8301-4723-af65-bd26e61fd67e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:34.631003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:34.641083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b5eae-8301-4723-af65-bd26e61fd67e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:34.675509 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21827ffb-3b50-4dfa-beac-27af2cac4b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:34.676148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827ffb-3b50-4dfa-beac-27af2cac4b1c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:34.676431 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827ffb-3b50-4dfa-beac-27af2cac4b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:34.676734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827ffb-3b50-4dfa-beac-27af2cac4b1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:34.743526 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21827ffb-3b50-4dfa-beac-27af2cac4b1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:34.744972 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21827ffb-3b50-4dfa-beac-27af2cac4b1c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:34.831047 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:34.841677 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 643/1282] 10.222.0.79 () {58 vars in 1282 bytes} [Thu Jul 14 11:58:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:58:34.847466 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cac3a0-702e-440a-87ef-053c8c0022a2 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:34.907147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:34.946890 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cac3a0-702e-440a-87ef-053c8c0022a2 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:34.979659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42673722-736d-4367-824c-ef5858fd89b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:34.980435 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42673722-736d-4367-824c-ef5858fd89b6 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:34.980721 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42673722-736d-4367-824c-ef5858fd89b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:34.980994 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42673722-736d-4367-824c-ef5858fd89b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:34.990632 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42673722-736d-4367-824c-ef5858fd89b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:34.992699 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42673722-736d-4367-824c-ef5858fd89b6 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:35.009989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-42673722-736d-4367-824c-ef5858fd89b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:35.009989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:35.009989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:35.009989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:35.009989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:35.009989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:35.009989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:35.009989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:35.009989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:35.009989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:35.009989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:35.009989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:35.009989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:58:35.009989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:58:35.009989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:58:35.011091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:58:35.011091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:35.011091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:35.011091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:35.011091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:35.011091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:35.011091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:35.011091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:35.011091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:35.011091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:35.011091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:35.011091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:35.011091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:35.011091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:35.011091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:35.011091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:35.011091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:35.012200 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:58:35.012200 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:58:35.012200 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:58:35.012200 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:58:35.012200 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 640/1283] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 11:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:35.017299 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21827ffb-3b50-4dfa-beac-27af2cac4b1c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:35.115798 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21827ffb-3b50-4dfa-beac-27af2cac4b1c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:35.150639 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44144f1c-19d0-47c5-8999-8ed49081c6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:35.151295 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44144f1c-19d0-47c5-8999-8ed49081c6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:35.151580 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44144f1c-19d0-47c5-8999-8ed49081c6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:35.151854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44144f1c-19d0-47c5-8999-8ed49081c6b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:35.152569 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44144f1c-19d0-47c5-8999-8ed49081c6b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:35.152877 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44144f1c-19d0-47c5-8999-8ed49081c6b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:35.154322 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44144f1c-19d0-47c5-8999-8ed49081c6b4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:35.166035 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 644/1284] 10.222.0.79 () {56 vars in 1109 bytes} [Thu Jul 14 11:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:35.171679 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42673722-736d-4367-824c-ef5858fd89b6 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:35.269161 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42673722-736d-4367-824c-ef5858fd89b6 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:35.282802 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:35.302589 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af58aed-a657-46db-ab67-10c1a4e2a8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:35.303369 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af58aed-a657-46db-ab67-10c1a4e2a8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:35.303660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af58aed-a657-46db-ab67-10c1a4e2a8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:35.303922 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af58aed-a657-46db-ab67-10c1a4e2a8d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:35.310226 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af58aed-a657-46db-ab67-10c1a4e2a8d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:35.311708 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af58aed-a657-46db-ab67-10c1a4e2a8d2 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:35.324727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-8af58aed-a657-46db-ab67-10c1a4e2a8d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:58:35.324727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:35.324727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:35.324727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:35.324727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:35.324727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:35.324727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:35.324727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:35.324727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:35.324727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:35.324727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:35.324727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:35.324727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:58:35.324727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:58:35.324727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:58:35.325752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:58:35.325752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:35.325752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:35.325752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:35.325752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:35.325752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:35.325752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:35.325752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:35.325752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:35.325752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:35.325752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:35.325752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:35.325752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:35.325752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:35.325752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:35.325752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:35.325752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:35.326880 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:58:35.326880 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:58:35.326880 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:58:35.326880 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:58:35.326880 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:58:35.326880 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:58:35.326880 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:58:35.326880 dv-cinder-848900-3-smb devstack@keystone.service[80165]: ERROR keystone.server.flask.application Jul 14 11:58:35.326880 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 641/1285] 10.222.0.79 () {56 vars in 1111 bytes} [Thu Jul 14 11:58:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:35.331705 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44144f1c-19d0-47c5-8999-8ed49081c6b4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:35.380672 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:35.432891 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44144f1c-19d0-47c5-8999-8ed49081c6b4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:35.465499 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba3c13-b639-476c-87d4-527dc427d170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:35.466156 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba3c13-b639-476c-87d4-527dc427d170 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:35.466442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba3c13-b639-476c-87d4-527dc427d170 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:35.466746 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba3c13-b639-476c-87d4-527dc427d170 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:35.467524 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba3c13-b639-476c-87d4-527dc427d170 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:35.467831 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba3c13-b639-476c-87d4-527dc427d170 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:35.469232 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba3c13-b639-476c-87d4-527dc427d170 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:35.481438 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 645/1286] 10.222.0.79 () {56 vars in 1148 bytes} [Thu Jul 14 11:58:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:35.487490 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af58aed-a657-46db-ab67-10c1a4e2a8d2 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:35.584076 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af58aed-a657-46db-ab67-10c1a4e2a8d2 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:35.616283 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ba468-f258-44fb-91b5-2db1e001d937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:35.616958 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ba468-f258-44fb-91b5-2db1e001d937 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:35.617240 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ba468-f258-44fb-91b5-2db1e001d937 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:35.617513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ba468-f258-44fb-91b5-2db1e001d937 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:35.618328 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ba468-f258-44fb-91b5-2db1e001d937 None admin] RBAC: Adding query filter params (role.id=eff4f9bbb7064bc1a0f9fc55a05fea51, scope.project.id=66f531bc924b41faa64743923afac319, user.id=d6070c6b901f4e2ebe621a3e42dd2d0b) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:35.618667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ba468-f258-44fb-91b5-2db1e001d937 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:35.620086 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ba468-f258-44fb-91b5-2db1e001d937 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:35.625697 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 642/1287] 10.222.0.79 () {56 vars in 1374 bytes} [Thu Jul 14 11:58:35 2022] GET /identity/v3/role_assignments?user.id=d6070c6b901f4e2ebe621a3e42dd2d0b&scope.project.id=66f531bc924b41faa64743923afac319&role.id=eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:37.658592 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b497aa-9d2f-4386-9a66-b61654bf31c3 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:37.659164 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b497aa-9d2f-4386-9a66-b61654bf31c3 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:37.659164 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b497aa-9d2f-4386-9a66-b61654bf31c3 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:37.660521 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 646/1288] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:58:37.666356 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b84d16-64ca-4e60-a032-9e8f07e6ad9f None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:37.666783 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b84d16-64ca-4e60-a032-9e8f07e6ad9f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:37.666947 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b84d16-64ca-4e60-a032-9e8f07e6ad9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:37.683501 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-00b84d16-64ca-4e60-a032-9e8f07e6ad9f None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:58:37.684686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-00b84d16-64ca-4e60-a032-9e8f07e6ad9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:58:37.713032 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:37.750240 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 643/1289] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:58:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:58:37.772563 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b497aa-9d2f-4386-9a66-b61654bf31c3 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:37.871675 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b497aa-9d2f-4386-9a66-b61654bf31c3 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:37.881902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:37.905772 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc2892-cd8c-4599-a1eb-7dabd1d2d8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:37.906595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc2892-cd8c-4599-a1eb-7dabd1d2d8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:37.906882 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc2892-cd8c-4599-a1eb-7dabd1d2d8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:37.907157 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc2892-cd8c-4599-a1eb-7dabd1d2d8a9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:37.907800 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc2892-cd8c-4599-a1eb-7dabd1d2d8a9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:37.909206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc2892-cd8c-4599-a1eb-7dabd1d2d8a9 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:37.920918 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-82bc2892-cd8c-4599-a1eb-7dabd1d2d8a9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:58:37.920918 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:37.920918 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:58:37.920918 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:58:37.920918 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:58:37.920918 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:58:37.920918 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:58:37.920918 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:58:37.920918 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:58:37.920918 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:58:37.920918 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:58:37.920918 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:58:37.920918 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:37.920918 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:37.920918 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:37.920918 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:37.920918 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:37.922135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:37.922135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:37.922135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:37.922135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:37.922135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:37.922135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:37.922135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:58:37.922135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:58:37.922135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:58:37.922135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:58:37.922135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:37.922135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:37.922135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:37.922135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:37.922135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:37.922135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:37.923223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:37.923223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:37.923223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:37.923223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:37.923223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:37.923223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:37.923223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:37.923223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:37.923223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:37.923223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:37.923223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:58:37.923223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:58:37.923223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:58:37.923223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:58:37.923223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 647/1290] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Jul 14 11:58:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:37.928416 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b84d16-64ca-4e60-a032-9e8f07e6ad9f None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:38.022041 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b84d16-64ca-4e60-a032-9e8f07e6ad9f None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:38.056357 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d1802-3bbc-425b-99d1-458b17ed1825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:38.057018 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d1802-3bbc-425b-99d1-458b17ed1825 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:38.057354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d1802-3bbc-425b-99d1-458b17ed1825 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:38.057753 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d1802-3bbc-425b-99d1-458b17ed1825 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:38.058815 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d1802-3bbc-425b-99d1-458b17ed1825 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:38.059124 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d1802-3bbc-425b-99d1-458b17ed1825 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:38.060531 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d1802-3bbc-425b-99d1-458b17ed1825 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:38.065688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 644/1291] 10.222.0.79 () {56 vars in 1116 bytes} [Thu Jul 14 11:58:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:38.071908 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc2892-cd8c-4599-a1eb-7dabd1d2d8a9 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:38.167869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc2892-cd8c-4599-a1eb-7dabd1d2d8a9 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:38.200981 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab814e3a-dee0-4ac1-b830-04ae81a3511f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:38.201639 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab814e3a-dee0-4ac1-b830-04ae81a3511f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:38.201925 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab814e3a-dee0-4ac1-b830-04ae81a3511f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:38.202202 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab814e3a-dee0-4ac1-b830-04ae81a3511f None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:38.202935 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab814e3a-dee0-4ac1-b830-04ae81a3511f None admin] RBAC: Adding query filter params (type=placement) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:38.203246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab814e3a-dee0-4ac1-b830-04ae81a3511f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:38.204601 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab814e3a-dee0-4ac1-b830-04ae81a3511f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:38.208930 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 648/1292] 10.222.0.79 () {56 vars in 1116 bytes} [Thu Jul 14 11:58:38 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:40.187227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722c24e-00b3-44d8-951a-a1d09809e6ba None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:40.187767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722c24e-00b3-44d8-951a-a1d09809e6ba None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:40.187767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722c24e-00b3-44d8-951a-a1d09809e6ba None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:40.189156 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 645/1293] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:58:40.195003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab2eb1-5bfe-4cbd-b6f6-2de6b0358493 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:40.195452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab2eb1-5bfe-4cbd-b6f6-2de6b0358493 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:40.195586 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab2eb1-5bfe-4cbd-b6f6-2de6b0358493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:40.212620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-fcab2eb1-5bfe-4cbd-b6f6-2de6b0358493 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:58:40.213803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-fcab2eb1-5bfe-4cbd-b6f6-2de6b0358493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:58:40.242254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:40.279891 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 649/1294] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:58:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:58:40.303432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722c24e-00b3-44d8-951a-a1d09809e6ba None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:40.333439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:40.401035 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722c24e-00b3-44d8-951a-a1d09809e6ba None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:40.435589 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a3892-c5ee-47c9-8114-d73aeb42706e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:40.436236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a3892-c5ee-47c9-8114-d73aeb42706e None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:40.436512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a3892-c5ee-47c9-8114-d73aeb42706e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:40.436805 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a3892-c5ee-47c9-8114-d73aeb42706e None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:40.437554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a3892-c5ee-47c9-8114-d73aeb42706e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:40.438917 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a3892-c5ee-47c9-8114-d73aeb42706e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:40.453989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 646/1295] 10.222.0.79 () {60 vars in 1141 bytes} [Thu Jul 14 11:58:40 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:58:42.468143 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d75c33-727b-497c-8e24-690bc9c80aff None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:42.468703 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d75c33-727b-497c-8e24-690bc9c80aff None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:42.468703 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d75c33-727b-497c-8e24-690bc9c80aff None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:42.470080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 650/1296] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:58:42.475145 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ae879-066a-48fb-a2ff-29725ff136f8 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:42.475593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ae879-066a-48fb-a2ff-29725ff136f8 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:42.476272 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ae879-066a-48fb-a2ff-29725ff136f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:42.493171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-f42ae879-066a-48fb-a2ff-29725ff136f8 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:58:42.494464 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-f42ae879-066a-48fb-a2ff-29725ff136f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:58:42.564677 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 647/1297] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:58:42 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:58:42.587284 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d75c33-727b-497c-8e24-690bc9c80aff None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:42.686477 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d75c33-727b-497c-8e24-690bc9c80aff None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:42.719259 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d95051-1fd0-4c9f-a868-704fe4ce68be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:42.719987 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d95051-1fd0-4c9f-a868-704fe4ce68be None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:42.720268 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d95051-1fd0-4c9f-a868-704fe4ce68be None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:42.720540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d95051-1fd0-4c9f-a868-704fe4ce68be None admin] PATH_INFO: `/v3/services/placement` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:42.721183 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d95051-1fd0-4c9f-a868-704fe4ce68be None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:42.722565 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d95051-1fd0-4c9f-a868-704fe4ce68be None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:42.734867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-a7d95051-1fd0-4c9f-a868-704fe4ce68be None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:58:42.734867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:42.734867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:58:42.734867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:58:42.734867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:58:42.734867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:58:42.734867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:58:42.734867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:58:42.734867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:58:42.734867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:58:42.734867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:58:42.734867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:58:42.734867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:42.734867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:42.734867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:42.734867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:42.734867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:42.736023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:42.736023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:42.736023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:42.736023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:42.736023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:42.736023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:42.736023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:58:42.736023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:58:42.736023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:58:42.736023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:58:42.736023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:42.736023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:42.736023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:42.736023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:42.736023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:42.736023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:42.741880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:42.741880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:42.741880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:42.741880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:42.741880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:42.741880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:42.741880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:42.741880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:42.741880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:42.741880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:42.741880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:58:42.741880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:58:42.741880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:58:42.741880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:58:42.741880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 651/1298] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Jul 14 11:58:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:42.743432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ae879-066a-48fb-a2ff-29725ff136f8 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:42.759634 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:42.836650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ae879-066a-48fb-a2ff-29725ff136f8 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:42.869137 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51650711-a3df-44d3-b8f5-19a3fc8b3f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:42.869787 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51650711-a3df-44d3-b8f5-19a3fc8b3f3f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:42.870068 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51650711-a3df-44d3-b8f5-19a3fc8b3f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:42.870341 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51650711-a3df-44d3-b8f5-19a3fc8b3f3f None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:42.871061 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51650711-a3df-44d3-b8f5-19a3fc8b3f3f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:42.871367 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51650711-a3df-44d3-b8f5-19a3fc8b3f3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:42.872720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51650711-a3df-44d3-b8f5-19a3fc8b3f3f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:42.877719 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 648/1299] 10.222.0.79 () {56 vars in 1116 bytes} [Thu Jul 14 11:58:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:42.884184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d95051-1fd0-4c9f-a868-704fe4ce68be None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:42.915349 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:42.982464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d95051-1fd0-4c9f-a868-704fe4ce68be None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:43.014694 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be894c-6ae9-47f1-b7b6-d886ca128359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:43.015350 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be894c-6ae9-47f1-b7b6-d886ca128359 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:43.015637 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be894c-6ae9-47f1-b7b6-d886ca128359 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:43.015916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be894c-6ae9-47f1-b7b6-d886ca128359 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:43.016693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be894c-6ae9-47f1-b7b6-d886ca128359 None admin] RBAC: Adding query filter params (interface=public, service_id=931ad9463468457a942f009072733bc2, region_id=RegionOne) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:43.017007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be894c-6ae9-47f1-b7b6-d886ca128359 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:43.018360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be894c-6ae9-47f1-b7b6-d886ca128359 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:43.023347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 652/1300] 10.222.0.79 () {56 vars in 1251 bytes} [Thu Jul 14 11:58:42 2022] GET /identity/v3/endpoints?service_id=931ad9463468457a942f009072733bc2&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:43.028982 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51650711-a3df-44d3-b8f5-19a3fc8b3f3f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:43.107600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:43.125609 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51650711-a3df-44d3-b8f5-19a3fc8b3f3f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:43.157199 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b9488-c8a3-4959-be52-53e598c5955e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:43.157850 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b9488-c8a3-4959-be52-53e598c5955e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:43.158136 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b9488-c8a3-4959-be52-53e598c5955e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:43.158411 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b9488-c8a3-4959-be52-53e598c5955e None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:43.159114 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b9488-c8a3-4959-be52-53e598c5955e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:43.160481 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b9488-c8a3-4959-be52-53e598c5955e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:43.167671 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 649/1301] 10.222.0.79 () {56 vars in 1087 bytes} [Thu Jul 14 11:58:43 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:58:45.151481 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da5e06-7157-472e-a0c6-f47a868b74ba None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:45.152031 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da5e06-7157-472e-a0c6-f47a868b74ba None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:45.152031 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da5e06-7157-472e-a0c6-f47a868b74ba None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:45.153338 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 653/1302] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:58:45.158438 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd345ae6-17d5-4cef-b10e-26e195fb0bc9 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:45.158894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd345ae6-17d5-4cef-b10e-26e195fb0bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:45.159027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd345ae6-17d5-4cef-b10e-26e195fb0bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:45.176057 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-bd345ae6-17d5-4cef-b10e-26e195fb0bc9 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:58:45.177335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-bd345ae6-17d5-4cef-b10e-26e195fb0bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:58:45.240546 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 650/1303] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:58:45 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:58:45.263333 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da5e06-7157-472e-a0c6-f47a868b74ba None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:45.355760 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:45.362680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da5e06-7157-472e-a0c6-f47a868b74ba None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:45.396363 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d1354-9075-4c74-b68d-f2c9e18cdc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:45.397153 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d1354-9075-4c74-b68d-f2c9e18cdc82 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:45.397507 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d1354-9075-4c74-b68d-f2c9e18cdc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:45.398246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d1354-9075-4c74-b68d-f2c9e18cdc82 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:45.398925 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d1354-9075-4c74-b68d-f2c9e18cdc82 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:45.400294 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d1354-9075-4c74-b68d-f2c9e18cdc82 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:45.412508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-b38d1354-9075-4c74-b68d-f2c9e18cdc82 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:58:45.412508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:45.412508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:58:45.412508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:58:45.412508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:58:45.412508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:58:45.412508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:58:45.412508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:58:45.412508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:58:45.412508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:58:45.412508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:58:45.412508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:58:45.412508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:58:45.412508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:58:45.412508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:58:45.412508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:58:45.412508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:58:45.413846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:58:45.413846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:58:45.413846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:58:45.413846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:58:45.413846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:58:45.413846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:58:45.413846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:58:45.413846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:58:45.413846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:58:45.413846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:58:45.413846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:58:45.413846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:58:45.413846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:58:45.413846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:58:45.413846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:58:45.413846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:58:45.415082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:58:45.415082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( Jul 14 11:58:45.415082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:58:45.415082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:58:45.415082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:58:45.415082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:58:45.415082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:58:45.415082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:58:45.415082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:58:45.415082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:58:45.415082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:58:45.415082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:58:45.415082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:58:45.415082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: ERROR keystone.server.flask.application Jul 14 11:58:45.415082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 654/1304] 10.222.0.79 () {56 vars in 1117 bytes} [Thu Jul 14 11:58:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:58:45.420246 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd345ae6-17d5-4cef-b10e-26e195fb0bc9 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:45.495031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:45.518087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd345ae6-17d5-4cef-b10e-26e195fb0bc9 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:45.551107 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186ba35-34fa-4f9d-9653-9fb497ea4528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:45.551763 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186ba35-34fa-4f9d-9653-9fb497ea4528 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:45.552050 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186ba35-34fa-4f9d-9653-9fb497ea4528 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:45.552330 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186ba35-34fa-4f9d-9653-9fb497ea4528 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:45.553057 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186ba35-34fa-4f9d-9653-9fb497ea4528 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:58:45.553367 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186ba35-34fa-4f9d-9653-9fb497ea4528 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:45.554804 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186ba35-34fa-4f9d-9653-9fb497ea4528 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:45.559915 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 651/1305] 10.222.0.79 () {56 vars in 1116 bytes} [Thu Jul 14 11:58:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:58:45.565843 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d1354-9075-4c74-b68d-f2c9e18cdc82 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:58:45.663538 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d1354-9075-4c74-b68d-f2c9e18cdc82 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:58:45.696814 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662795c9-0b06-41e4-85b8-ebd867713f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:58:45.697465 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662795c9-0b06-41e4-85b8-ebd867713f3d None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:58:45.697753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662795c9-0b06-41e4-85b8-ebd867713f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:58:45.698030 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662795c9-0b06-41e4-85b8-ebd867713f3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:58:45.698906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662795c9-0b06-41e4-85b8-ebd867713f3d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:58:45.700259 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662795c9-0b06-41e4-85b8-ebd867713f3d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:58:45.717811 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 655/1306] 10.222.0.79 () {60 vars in 1144 bytes} [Thu Jul 14 11:58:45 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:58:55.557045 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=30 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:58:55.713535 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:59:49.547769 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11821d8f-1b9d-477f-a81b-c1d7ff3ab9e7 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:49.547769 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11821d8f-1b9d-477f-a81b-c1d7ff3ab9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:49.547769 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11821d8f-1b9d-477f-a81b-c1d7ff3ab9e7 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:49.553481 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 652/1307] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:59:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:59:49.555496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26288c28-a027-453a-b945-2160ffe09214 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:49.556405 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26288c28-a027-453a-b945-2160ffe09214 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:49.556890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26288c28-a027-453a-b945-2160ffe09214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:49.665636 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-26288c28-a027-453a-b945-2160ffe09214 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:59:49.667092 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-26288c28-a027-453a-b945-2160ffe09214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:50.054005 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 656/1308] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 499 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:59:50.120418 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda3483-cde8-4c7e-988d-81d11641b0ef None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:50.120636 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda3483-cde8-4c7e-988d-81d11641b0ef None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:50.121093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda3483-cde8-4c7e-988d-81d11641b0ef None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:50.122736 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 653/1309] 10.222.0.79 () {54 vars in 964 bytes} [Thu Jul 14 11:59:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:59:50.129447 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c4b2c-5786-4cdf-aebb-9697923910a7 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:50.129995 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c4b2c-5786-4cdf-aebb-9697923910a7 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:50.130463 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c4b2c-5786-4cdf-aebb-9697923910a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:50.280639 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6b2c4b2c-5786-4cdf-aebb-9697923910a7 None None] MFA Rules not processed for user `2fedd4e015384379bf41c2e01ecc0a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:59:50.282333 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6b2c4b2c-5786-4cdf-aebb-9697923910a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:50.307929 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:59:50.375907 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 657/1310] 10.222.0.79 () {58 vars in 1061 bytes} [Thu Jul 14 11:59:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:59:50.390605 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda3483-cde8-4c7e-988d-81d11641b0ef None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:50.393362 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-2cda3483-cde8-4c7e-988d-81d11641b0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:50.545366 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda3483-cde8-4c7e-988d-81d11641b0ef None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:50.640585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a545a62-ded4-4a2e-8e5a-68631cfad1b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:50.641597 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a545a62-ded4-4a2e-8e5a-68631cfad1b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:50.641597 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a545a62-ded4-4a2e-8e5a-68631cfad1b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:50.641886 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a545a62-ded4-4a2e-8e5a-68631cfad1b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:50.643437 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-9a545a62-ded4-4a2e-8e5a-68631cfad1b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:50.717078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:59:50.787198 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a545a62-ded4-4a2e-8e5a-68631cfad1b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:50.788763 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a545a62-ded4-4a2e-8e5a-68631cfad1b6 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:50.835006 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 654/1311] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 11:59:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:59:53.726313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a951ba-332c-4373-bec0-a5ba0e400373 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:53.727192 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a951ba-332c-4373-bec0-a5ba0e400373 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:53.727192 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a951ba-332c-4373-bec0-a5ba0e400373 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:53.729509 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 658/1312] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:59:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:59:53.738732 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4078e4-7438-4c00-a2dc-d4e4b3b18596 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:53.739640 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4078e4-7438-4c00-a2dc-d4e4b3b18596 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:53.739820 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4078e4-7438-4c00-a2dc-d4e4b3b18596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:53.832064 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-8e4078e4-7438-4c00-a2dc-d4e4b3b18596 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:59:53.833958 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-8e4078e4-7438-4c00-a2dc-d4e4b3b18596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:53.953333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 655/1313] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:59:54.005068 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae132b24-44ae-4f64-8235-2e845b55673c None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:54.005942 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae132b24-44ae-4f64-8235-2e845b55673c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:54.006276 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae132b24-44ae-4f64-8235-2e845b55673c None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:54.007659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 659/1314] 10.222.0.79 () {54 vars in 964 bytes} [Thu Jul 14 11:59:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:59:54.014542 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d0a58-9f00-4a72-b647-4f6817c6af1e None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:54.014818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d0a58-9f00-4a72-b647-4f6817c6af1e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:54.015099 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d0a58-9f00-4a72-b647-4f6817c6af1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:54.026875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:59:54.104437 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-e10d0a58-9f00-4a72-b647-4f6817c6af1e None None] MFA Rules not processed for user `2fedd4e015384379bf41c2e01ecc0a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:59:54.105678 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e10d0a58-9f00-4a72-b647-4f6817c6af1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:54.195349 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 656/1315] 10.222.0.79 () {58 vars in 1061 bytes} [Thu Jul 14 11:59:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:59:54.204792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae132b24-44ae-4f64-8235-2e845b55673c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:54.206342 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ae132b24-44ae-4f64-8235-2e845b55673c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:54.334674 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae132b24-44ae-4f64-8235-2e845b55673c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:54.439988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:59:54.443443 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6d130-f797-468b-b2f8-f5042de70883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:54.444513 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6d130-f797-468b-b2f8-f5042de70883 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:54.445121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6d130-f797-468b-b2f8-f5042de70883 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:54.445517 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6d130-f797-468b-b2f8-f5042de70883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:54.447680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-36c6d130-f797-468b-b2f8-f5042de70883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:54.577463 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6d130-f797-468b-b2f8-f5042de70883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:54.578896 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6d130-f797-468b-b2f8-f5042de70883 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:54.601430 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 660/1316] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 11:59:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:59:57.330309 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b9825-1358-49db-9280-31063c51e0b1 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:57.330994 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b9825-1358-49db-9280-31063c51e0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:57.330994 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b9825-1358-49db-9280-31063c51e0b1 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:57.332380 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 657/1317] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 11:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:59:57.339933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c453d76-d58b-4ec4-abea-ef58da249b26 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:57.340508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c453d76-d58b-4ec4-abea-ef58da249b26 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:57.340508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c453d76-d58b-4ec4-abea-ef58da249b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:57.419845 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-0c453d76-d58b-4ec4-abea-ef58da249b26 None None] MFA Rules not processed for user `5786c5828f214152a6e9a90fca93504e`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:59:57.421138 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0c453d76-d58b-4ec4-abea-ef58da249b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:57.487144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:59:57.541780 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 661/1318] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 11:59:57 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:59:57.584206 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b9825-1358-49db-9280-31063c51e0b1 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:59:57.585670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-c61b9825-1358-49db-9280-31063c51e0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:57.712683 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b9825-1358-49db-9280-31063c51e0b1 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:59:57.715972 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:59:57.800317 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d66b2f-12f1-4029-9828-37eafe784dce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:59:57.800984 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d66b2f-12f1-4029-9828-37eafe784dce service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:59:57.801265 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d66b2f-12f1-4029-9828-37eafe784dce service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:59:57.801539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d66b2f-12f1-4029-9828-37eafe784dce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:59:57.803885 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-c5d66b2f-12f1-4029-9828-37eafe784dce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:59:57.937046 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d66b2f-12f1-4029-9828-37eafe784dce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:59:57.938813 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d66b2f-12f1-4029-9828-37eafe784dce service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:59:57.961344 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 658/1319] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 11:59:57 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:00:00.753384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f838d18-b1ed-40ac-afdf-1d0a0e2945bb None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:00.754034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f838d18-b1ed-40ac-afdf-1d0a0e2945bb None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:00.754342 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f838d18-b1ed-40ac-afdf-1d0a0e2945bb None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:00.757579 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 662/1320] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:00:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:00:00.763828 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb0cce-86c5-49ab-8436-993d12de511a None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:00.764483 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb0cce-86c5-49ab-8436-993d12de511a None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:00.764483 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb0cce-86c5-49ab-8436-993d12de511a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:00.809867 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:00.841624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-54fb0cce-86c5-49ab-8436-993d12de511a None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:00.842893 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-54fb0cce-86c5-49ab-8436-993d12de511a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:00.954521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 659/1321] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:00:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:00:00.995256 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f838d18-b1ed-40ac-afdf-1d0a0e2945bb None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:00:00.996810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4f838d18-b1ed-40ac-afdf-1d0a0e2945bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:01.119522 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f838d18-b1ed-40ac-afdf-1d0a0e2945bb None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:00:01.204486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a65f45-055d-436a-940e-3266d64458e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:00:01.205225 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a65f45-055d-436a-940e-3266d64458e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:01.205553 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a65f45-055d-436a-940e-3266d64458e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:01.205871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a65f45-055d-436a-940e-3266d64458e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:01.207743 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b4a65f45-055d-436a-940e-3266d64458e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:01.216522 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:01.334647 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a65f45-055d-436a-940e-3266d64458e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:00:01.336056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a65f45-055d-436a-940e-3266d64458e9 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:00:01.357826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 663/1322] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:00:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:00:04.372884 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52edfa5-cea4-4d38-b3ad-aecea1847b8b None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:04.373533 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52edfa5-cea4-4d38-b3ad-aecea1847b8b None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:04.373533 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52edfa5-cea4-4d38-b3ad-aecea1847b8b None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:04.374912 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 660/1323] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:00:04.382472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bc0e0-20b5-4beb-aa58-2752b1972c0d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:04.383076 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bc0e0-20b5-4beb-aa58-2752b1972c0d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:04.383558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bc0e0-20b5-4beb-aa58-2752b1972c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:04.507078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3a4bc0e0-20b5-4beb-aa58-2752b1972c0d None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:04.508620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3a4bc0e0-20b5-4beb-aa58-2752b1972c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:04.585673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:04.678261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 664/1324] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:00:04.719795 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52edfa5-cea4-4d38-b3ad-aecea1847b8b None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:00:04.721568 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b52edfa5-cea4-4d38-b3ad-aecea1847b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:04.857782 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52edfa5-cea4-4d38-b3ad-aecea1847b8b None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:00:04.874328 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:04.986969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d827d96-452a-4802-98e9-57dd73665782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:00:04.988050 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d827d96-452a-4802-98e9-57dd73665782 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:04.988527 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d827d96-452a-4802-98e9-57dd73665782 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:04.989006 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d827d96-452a-4802-98e9-57dd73665782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:04.992745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-2d827d96-452a-4802-98e9-57dd73665782 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:05.215957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d827d96-452a-4802-98e9-57dd73665782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:00:05.218837 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d827d96-452a-4802-98e9-57dd73665782 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:00:05.245011 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 661/1325] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:00:07.481621 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d4baf-aee9-4498-b61d-3903a0ce469f None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:07.482269 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d4baf-aee9-4498-b61d-3903a0ce469f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:07.482269 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d4baf-aee9-4498-b61d-3903a0ce469f None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:07.483653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 665/1326] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:00:07.490269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b64dbf-cd06-4271-b5c3-67d745254107 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:07.491145 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b64dbf-cd06-4271-b5c3-67d745254107 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:07.491145 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b64dbf-cd06-4271-b5c3-67d745254107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:07.542928 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:07.572960 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-a3b64dbf-cd06-4271-b5c3-67d745254107 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:07.574986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a3b64dbf-cd06-4271-b5c3-67d745254107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:07.696365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 662/1327] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:00:07.756044 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d4baf-aee9-4498-b61d-3903a0ce469f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:00:07.757820 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8a8d4baf-aee9-4498-b61d-3903a0ce469f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:07.912915 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d4baf-aee9-4498-b61d-3903a0ce469f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:00:08.008178 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c31bef-c2ba-4ace-9b9e-be8ff461be5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:00:08.008761 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c31bef-c2ba-4ace-9b9e-be8ff461be5a service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:08.009065 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c31bef-c2ba-4ace-9b9e-be8ff461be5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:08.009314 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c31bef-c2ba-4ace-9b9e-be8ff461be5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:08.011124 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e2c31bef-c2ba-4ace-9b9e-be8ff461be5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:08.031983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:08.186336 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c31bef-c2ba-4ace-9b9e-be8ff461be5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:00:08.188932 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c31bef-c2ba-4ace-9b9e-be8ff461be5a service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:00:08.223690 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 666/1328] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:00:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:00:10.619719 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2348d00-61ef-405a-8568-a798b34a85ff None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:10.620565 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2348d00-61ef-405a-8568-a798b34a85ff None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:10.620565 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2348d00-61ef-405a-8568-a798b34a85ff None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:10.621585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 663/1329] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:00:10.628366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338cd10-f6dd-40da-8773-36ea99a0d99c None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:10.628931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338cd10-f6dd-40da-8773-36ea99a0d99c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:10.629283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338cd10-f6dd-40da-8773-36ea99a0d99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:10.722620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6338cd10-f6dd-40da-8773-36ea99a0d99c None None] MFA Rules not processed for user `5786c5828f214152a6e9a90fca93504e`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:10.725501 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6338cd10-f6dd-40da-8773-36ea99a0d99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:10.835299 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:10.885749 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 667/1330] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:00:10 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:00:10.925699 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2348d00-61ef-405a-8568-a798b34a85ff None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:00:10.927805 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a2348d00-61ef-405a-8568-a798b34a85ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:11.044049 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2348d00-61ef-405a-8568-a798b34a85ff None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:00:11.067011 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:11.129025 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b9551-2b1e-4243-81e5-b5b54e396f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:00:11.129741 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b9551-2b1e-4243-81e5-b5b54e396f38 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:11.130558 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b9551-2b1e-4243-81e5-b5b54e396f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:11.130828 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b9551-2b1e-4243-81e5-b5b54e396f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:11.132653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b25b9551-2b1e-4243-81e5-b5b54e396f38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:11.279635 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b9551-2b1e-4243-81e5-b5b54e396f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:00:11.281394 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b9551-2b1e-4243-81e5-b5b54e396f38 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:00:11.302604 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 664/1331] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:00:10 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:00:13.738305 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55ae39-f33c-4240-92b6-6a97e28b7dfc None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:13.739082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55ae39-f33c-4240-92b6-6a97e28b7dfc None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:13.739082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55ae39-f33c-4240-92b6-6a97e28b7dfc None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:13.740451 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 668/1332] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:00:13.746333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df36641-5514-499f-84fc-98be5124e292 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:13.746949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df36641-5514-499f-84fc-98be5124e292 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:13.746949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df36641-5514-499f-84fc-98be5124e292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:13.817980 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:13.822328 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-5df36641-5514-499f-84fc-98be5124e292 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:13.823923 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5df36641-5514-499f-84fc-98be5124e292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:13.936105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 665/1333] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:00:13.973078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55ae39-f33c-4240-92b6-6a97e28b7dfc None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:00:13.974785 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1c55ae39-f33c-4240-92b6-6a97e28b7dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:14.104094 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55ae39-f33c-4240-92b6-6a97e28b7dfc None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:00:14.213688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73752a05-8dfa-48f5-a409-2c3799bdb86f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:00:14.214774 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73752a05-8dfa-48f5-a409-2c3799bdb86f service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:14.215266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73752a05-8dfa-48f5-a409-2c3799bdb86f service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:14.215730 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73752a05-8dfa-48f5-a409-2c3799bdb86f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:14.218956 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-73752a05-8dfa-48f5-a409-2c3799bdb86f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:14.272273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:14.391047 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73752a05-8dfa-48f5-a409-2c3799bdb86f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:00:14.392687 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73752a05-8dfa-48f5-a409-2c3799bdb86f service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:00:14.424954 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 669/1334] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:00:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:00:16.605570 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c5fb5-6fc6-44ef-85f2-e5b6082eb239 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:16.606170 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c5fb5-6fc6-44ef-85f2-e5b6082eb239 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:16.606170 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c5fb5-6fc6-44ef-85f2-e5b6082eb239 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:16.607451 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 666/1335] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:00:16.613093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c08f8-7039-4dc0-a7c9-f7af301712d3 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:16.613661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c08f8-7039-4dc0-a7c9-f7af301712d3 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:16.613661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c08f8-7039-4dc0-a7c9-f7af301712d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:16.681759 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-561c08f8-7039-4dc0-a7c9-f7af301712d3 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:16.683025 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-561c08f8-7039-4dc0-a7c9-f7af301712d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:16.792216 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:16.818149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 670/1336] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:00:16.858483 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c5fb5-6fc6-44ef-85f2-e5b6082eb239 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:00:16.860285 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-c03c5fb5-6fc6-44ef-85f2-e5b6082eb239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:16.978788 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c5fb5-6fc6-44ef-85f2-e5b6082eb239 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:00:17.021125 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:17.097679 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4aa115-6f38-452a-852c-3fc5f0cc2718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:00:17.098372 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4aa115-6f38-452a-852c-3fc5f0cc2718 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:17.098679 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4aa115-6f38-452a-852c-3fc5f0cc2718 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:17.098957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4aa115-6f38-452a-852c-3fc5f0cc2718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:17.100708 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-6e4aa115-6f38-452a-852c-3fc5f0cc2718 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:17.219516 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4aa115-6f38-452a-852c-3fc5f0cc2718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:00:17.221008 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4aa115-6f38-452a-852c-3fc5f0cc2718 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:00:17.243520 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 667/1337] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:00:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:00:19.726986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e393e-003f-4150-98e6-ef6d7aaf5ac6 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:19.727651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e393e-003f-4150-98e6-ef6d7aaf5ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:19.727651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e393e-003f-4150-98e6-ef6d7aaf5ac6 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:19.728988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 671/1338] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:00:19.735047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491da11-8015-4889-a306-b69f46800f68 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:19.735837 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491da11-8015-4889-a306-b69f46800f68 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:19.735837 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491da11-8015-4889-a306-b69f46800f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:19.812652 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-5491da11-8015-4889-a306-b69f46800f68 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:19.813924 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5491da11-8015-4889-a306-b69f46800f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:19.824202 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:19.927104 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 668/1339] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:00:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:00:19.963291 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e393e-003f-4150-98e6-ef6d7aaf5ac6 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:00:19.964914 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e12e393e-003f-4150-98e6-ef6d7aaf5ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:20.090056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e393e-003f-4150-98e6-ef6d7aaf5ac6 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:00:20.172950 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb1f8e-b60f-431b-91a6-fd742185de8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:00:20.173620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb1f8e-b60f-431b-91a6-fd742185de8b service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:20.174164 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb1f8e-b60f-431b-91a6-fd742185de8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:20.174442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb1f8e-b60f-431b-91a6-fd742185de8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:20.176226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a2eb1f8e-b60f-431b-91a6-fd742185de8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:20.217643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:20.296471 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb1f8e-b60f-431b-91a6-fd742185de8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:00:20.297969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb1f8e-b60f-431b-91a6-fd742185de8b service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:00:20.319260 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 672/1340] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:00:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:00:24.633992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafce5af-053a-40cc-a557-9cc6352862c8 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:24.634698 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafce5af-053a-40cc-a557-9cc6352862c8 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:24.634698 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafce5af-053a-40cc-a557-9cc6352862c8 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:24.636127 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 669/1341] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:00:24.641974 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea0218-b019-49e9-a16a-7c053a01b146 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:24.642563 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea0218-b019-49e9-a16a-7c053a01b146 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:24.642563 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea0218-b019-49e9-a16a-7c053a01b146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:24.730073 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-96ea0218-b019-49e9-a16a-7c053a01b146 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:24.731670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-96ea0218-b019-49e9-a16a-7c053a01b146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:24.840787 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:24.853720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 673/1342] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:00:24.893227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafce5af-053a-40cc-a557-9cc6352862c8 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:00:24.897233 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-eafce5af-053a-40cc-a557-9cc6352862c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:25.064934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafce5af-053a-40cc-a557-9cc6352862c8 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:00:25.115219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:25.159221 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8719aea-8648-42e4-9338-bc20170bae87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:00:25.159880 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8719aea-8648-42e4-9338-bc20170bae87 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:25.160166 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8719aea-8648-42e4-9338-bc20170bae87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:25.160439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8719aea-8648-42e4-9338-bc20170bae87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:25.162222 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e8719aea-8648-42e4-9338-bc20170bae87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:25.289409 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8719aea-8648-42e4-9338-bc20170bae87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:00:25.290782 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8719aea-8648-42e4-9338-bc20170bae87 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:00:25.314240 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 670/1343] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:00:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:00:28.425723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafaa47-4295-424e-8c72-4a30eff50f99 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:28.426951 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafaa47-4295-424e-8c72-4a30eff50f99 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:28.426951 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafaa47-4295-424e-8c72-4a30eff50f99 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:28.428930 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 674/1344] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:00:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:00:28.435609 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b74504-d16e-46d4-9889-1e9d92b5e51b None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:28.436189 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b74504-d16e-46d4-9889-1e9d92b5e51b None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:28.436189 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b74504-d16e-46d4-9889-1e9d92b5e51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:28.503357 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-f1b74504-d16e-46d4-9889-1e9d92b5e51b None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:28.504649 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-f1b74504-d16e-46d4-9889-1e9d92b5e51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:28.522792 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:28.600964 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 671/1345] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:00:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:00:28.638916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafaa47-4295-424e-8c72-4a30eff50f99 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:00:28.640580 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-efafaa47-4295-424e-8c72-4a30eff50f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:28.750957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafaa47-4295-424e-8c72-4a30eff50f99 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:00:28.835574 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc2a44-30c9-4d04-959a-02f4fc23eedd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:00:28.836245 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc2a44-30c9-4d04-959a-02f4fc23eedd service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:28.836533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc2a44-30c9-4d04-959a-02f4fc23eedd service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:28.836810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc2a44-30c9-4d04-959a-02f4fc23eedd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:28.838657 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d5fc2a44-30c9-4d04-959a-02f4fc23eedd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:28.886050 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:28.959174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc2a44-30c9-4d04-959a-02f4fc23eedd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:00:28.960638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc2a44-30c9-4d04-959a-02f4fc23eedd service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:00:28.980758 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 675/1346] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:00:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:00:33.330681 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdac488-2848-4932-8cfa-56afcd02c55b None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:33.331204 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdac488-2848-4932-8cfa-56afcd02c55b None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:33.331299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdac488-2848-4932-8cfa-56afcd02c55b None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:33.332704 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 672/1347] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:00:33.338229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138ee26-8844-40cd-be9d-41bc2456270f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:33.338743 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138ee26-8844-40cd-be9d-41bc2456270f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:33.338860 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138ee26-8844-40cd-be9d-41bc2456270f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:33.411382 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-9138ee26-8844-40cd-be9d-41bc2456270f None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:33.412601 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9138ee26-8844-40cd-be9d-41bc2456270f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:33.515594 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:33.520610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 676/1348] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:00:33.560799 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdac488-2848-4932-8cfa-56afcd02c55b None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:00:33.562435 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5cdac488-2848-4932-8cfa-56afcd02c55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:33.687699 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdac488-2848-4932-8cfa-56afcd02c55b None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:00:33.749089 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:33.777834 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06c454-3ab2-4bf3-9884-6b9f39918444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:00:33.778602 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06c454-3ab2-4bf3-9884-6b9f39918444 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:33.778948 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06c454-3ab2-4bf3-9884-6b9f39918444 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:33.779281 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06c454-3ab2-4bf3-9884-6b9f39918444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:33.781311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ac06c454-3ab2-4bf3-9884-6b9f39918444 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:33.908997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06c454-3ab2-4bf3-9884-6b9f39918444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:00:33.910525 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06c454-3ab2-4bf3-9884-6b9f39918444 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:00:33.930374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 673/1349] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:00:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:00:39.028587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca3614-7ec0-4545-ae03-0de400fbe3f1 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:39.029101 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca3614-7ec0-4545-ae03-0de400fbe3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:39.029350 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca3614-7ec0-4545-ae03-0de400fbe3f1 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:39.030873 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 677/1350] 10.222.0.79 () {54 vars in 921 bytes} [Thu Jul 14 12:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:00:39.037786 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ec5af-097c-44fa-a9c5-0f324534e216 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:39.038232 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ec5af-097c-44fa-a9c5-0f324534e216 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:39.038331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ec5af-097c-44fa-a9c5-0f324534e216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:39.147527 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-582ec5af-097c-44fa-a9c5-0f324534e216 None None] MFA Rules not processed for user `d6070c6b901f4e2ebe621a3e42dd2d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:39.148948 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-582ec5af-097c-44fa-a9c5-0f324534e216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:39.173295 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:39.304479 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 674/1351] 10.222.0.79 () {58 vars in 1018 bytes} [Thu Jul 14 12:00:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:00:43.711381 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9243c21-5e90-4b26-ad11-678e1e1a1afb None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:43.711926 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9243c21-5e90-4b26-ad11-678e1e1a1afb None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:43.711926 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9243c21-5e90-4b26-ad11-678e1e1a1afb None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:43.713487 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 678/1352] 10.222.0.79 () {54 vars in 921 bytes} [Thu Jul 14 12:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:00:43.718457 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2953f13-a9ec-431f-94ed-147bdf82498d None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:43.718925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2953f13-a9ec-431f-94ed-147bdf82498d None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:43.719073 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2953f13-a9ec-431f-94ed-147bdf82498d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:43.805702 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-b2953f13-a9ec-431f-94ed-147bdf82498d None None] MFA Rules not processed for user `d6070c6b901f4e2ebe621a3e42dd2d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:43.807069 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b2953f13-a9ec-431f-94ed-147bdf82498d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:43.884126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:43.923356 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 675/1353] 10.222.0.79 () {58 vars in 1018 bytes} [Thu Jul 14 12:00:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:00:45.309908 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a544a45-693e-432c-bcb2-fa9e1b721da4 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:45.310460 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a544a45-693e-432c-bcb2-fa9e1b721da4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:45.310460 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a544a45-693e-432c-bcb2-fa9e1b721da4 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:45.311885 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 679/1354] 10.222.0.79 () {54 vars in 921 bytes} [Thu Jul 14 12:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:00:45.317118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8fe77-eadd-419d-8e6c-9c469cf3a464 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:45.317528 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8fe77-eadd-419d-8e6c-9c469cf3a464 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:45.317807 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8fe77-eadd-419d-8e6c-9c469cf3a464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:45.391369 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-fde8fe77-eadd-419d-8e6c-9c469cf3a464 None None] MFA Rules not processed for user `d6070c6b901f4e2ebe621a3e42dd2d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:45.392558 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-fde8fe77-eadd-419d-8e6c-9c469cf3a464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:45.507439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 676/1355] 10.222.0.79 () {58 vars in 1018 bytes} [Thu Jul 14 12:00:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:00:48.857064 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe08a9-fe11-46bb-bb5b-1317761b7b18 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:48.857752 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe08a9-fe11-46bb-bb5b-1317761b7b18 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:48.857752 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe08a9-fe11-46bb-bb5b-1317761b7b18 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:48.858999 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 680/1356] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:00:48.864975 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c3425-17bc-461a-97ce-dce69f93e1c5 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:48.865524 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c3425-17bc-461a-97ce-dce69f93e1c5 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:48.865524 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c3425-17bc-461a-97ce-dce69f93e1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:48.917708 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:48.959005 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-d42c3425-17bc-461a-97ce-dce69f93e1c5 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:48.960469 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-d42c3425-17bc-461a-97ce-dce69f93e1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:49.078600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 677/1357] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:00:49.125338 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c10c40-5803-426b-bde5-5e9143a05b94 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:49.126441 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c10c40-5803-426b-bde5-5e9143a05b94 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:49.127151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c10c40-5803-426b-bde5-5e9143a05b94 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:49.130001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 681/1358] 10.222.0.79 () {54 vars in 961 bytes} [Thu Jul 14 12:00:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:00:49.140595 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b36f95-b7fa-461e-a30f-cef296ecea3c None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:49.141512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b36f95-b7fa-461e-a30f-cef296ecea3c None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:49.142101 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b36f95-b7fa-461e-a30f-cef296ecea3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:49.231362 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-64b36f95-b7fa-461e-a30f-cef296ecea3c None None] MFA Rules not processed for user `e41a4d3a822c403fad048764a0edf209`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:49.232821 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-64b36f95-b7fa-461e-a30f-cef296ecea3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:49.282596 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:49.368232 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 678/1359] 10.222.0.79 () {58 vars in 1058 bytes} [Thu Jul 14 12:00:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:00:49.376514 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c10c40-5803-426b-bde5-5e9143a05b94 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:00:49.378104 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b6c10c40-5803-426b-bde5-5e9143a05b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:49.569866 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c10c40-5803-426b-bde5-5e9143a05b94 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:00:49.655248 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:49.707815 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056739f-af10-4c6f-90f1-4859c9df0daa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:00:49.708623 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056739f-af10-4c6f-90f1-4859c9df0daa service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:49.709013 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056739f-af10-4c6f-90f1-4859c9df0daa service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:49.709391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056739f-af10-4c6f-90f1-4859c9df0daa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:49.711290 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a056739f-af10-4c6f-90f1-4859c9df0daa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:49.818288 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a056739f-af10-4c6f-90f1-4859c9df0daa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:00:49.820029 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a056739f-af10-4c6f-90f1-4859c9df0daa service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:00:49.841138 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 682/1360] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:00:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:00:52.201521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae29bc-7edf-4048-8526-dc3c16427b1b None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:52.202104 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae29bc-7edf-4048-8526-dc3c16427b1b None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:52.202104 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae29bc-7edf-4048-8526-dc3c16427b1b None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:52.203534 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 679/1361] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:00:52.209852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45add5-91a1-4cf5-8413-66c60b081125 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:52.210873 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45add5-91a1-4cf5-8413-66c60b081125 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:52.211166 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45add5-91a1-4cf5-8413-66c60b081125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:52.302174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-1d45add5-91a1-4cf5-8413-66c60b081125 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:52.304715 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1d45add5-91a1-4cf5-8413-66c60b081125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:52.351011 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:52.445666 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 683/1362] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:00:52.494031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae29bc-7edf-4048-8526-dc3c16427b1b None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:00:52.499831 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-77ae29bc-7edf-4048-8526-dc3c16427b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:52.734532 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae29bc-7edf-4048-8526-dc3c16427b1b None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:00:52.746561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:52.884331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0456ea-a794-404d-9f7d-0e1d6061f46f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:00:52.884979 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0456ea-a794-404d-9f7d-0e1d6061f46f service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:52.885259 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0456ea-a794-404d-9f7d-0e1d6061f46f service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:52.885697 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0456ea-a794-404d-9f7d-0e1d6061f46f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:52.887366 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-4a0456ea-a794-404d-9f7d-0e1d6061f46f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:53.008928 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0456ea-a794-404d-9f7d-0e1d6061f46f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:00:53.010665 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0456ea-a794-404d-9f7d-0e1d6061f46f service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:00:53.034679 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 680/1363] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:00:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:00:55.748774 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2f1fb-93e4-41e4-b805-fa8ad0740ed4 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:55.749366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2f1fb-93e4-41e4-b805-fa8ad0740ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:55.749366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2f1fb-93e4-41e4-b805-fa8ad0740ed4 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:55.750823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 684/1364] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:00:55.757244 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f224dac-9443-40b9-a2dc-0ee48d2be8c3 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:55.757836 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f224dac-9443-40b9-a2dc-0ee48d2be8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:55.757836 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f224dac-9443-40b9-a2dc-0ee48d2be8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:55.774838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:55.839406 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-1f224dac-9443-40b9-a2dc-0ee48d2be8c3 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:55.840983 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-1f224dac-9443-40b9-a2dc-0ee48d2be8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:56.005650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 681/1365] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:00:56.075207 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba336ed-d91f-4681-bf5c-45fc6970074d None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:56.076034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba336ed-d91f-4681-bf5c-45fc6970074d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:56.076483 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba336ed-d91f-4681-bf5c-45fc6970074d None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:56.078461 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 685/1366] 10.222.0.79 () {54 vars in 961 bytes} [Thu Jul 14 12:00:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:00:56.086727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11383446-e2a3-4988-93ff-abf6ced57e8a None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:56.087179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11383446-e2a3-4988-93ff-abf6ced57e8a None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:56.087590 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11383446-e2a3-4988-93ff-abf6ced57e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:56.193544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-11383446-e2a3-4988-93ff-abf6ced57e8a None None] MFA Rules not processed for user `e41a4d3a822c403fad048764a0edf209`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:56.194840 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-11383446-e2a3-4988-93ff-abf6ced57e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:56.243036 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:56.353279 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 682/1367] 10.222.0.79 () {58 vars in 1058 bytes} [Thu Jul 14 12:00:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:00:56.369363 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba336ed-d91f-4681-bf5c-45fc6970074d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:00:56.370948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1ba336ed-d91f-4681-bf5c-45fc6970074d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:56.585968 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba336ed-d91f-4681-bf5c-45fc6970074d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:00:56.625341 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:56.795396 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4097951-d7fa-4ba8-bd60-536e38dccb76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:00:56.796326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4097951-d7fa-4ba8-bd60-536e38dccb76 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:56.796664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4097951-d7fa-4ba8-bd60-536e38dccb76 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:56.796831 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4097951-d7fa-4ba8-bd60-536e38dccb76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:56.799517 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c4097951-d7fa-4ba8-bd60-536e38dccb76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:56.904207 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4097951-d7fa-4ba8-bd60-536e38dccb76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:00:56.905175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4097951-d7fa-4ba8-bd60-536e38dccb76 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:00:56.928019 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 686/1368] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:00:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:00:57.412937 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d03b6-665c-46c4-bc48-c73d72ef7ca2 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:57.413843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d03b6-665c-46c4-bc48-c73d72ef7ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:57.413843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d03b6-665c-46c4-bc48-c73d72ef7ca2 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:57.415411 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 683/1369] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:00:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:00:57.421613 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0deb2d6-7f86-4dd3-ae38-f610653e1ff2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:57.421949 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0deb2d6-7f86-4dd3-ae38-f610653e1ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:57.422179 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0deb2d6-7f86-4dd3-ae38-f610653e1ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:57.461186 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:57.506614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f0deb2d6-7f86-4dd3-ae38-f610653e1ff2 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:57.508107 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f0deb2d6-7f86-4dd3-ae38-f610653e1ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:57.636162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 687/1370] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:00:57.995401 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d6d9c-8dc6-47e7-ad70-b10f992b1d75 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:57.995401 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d6d9c-8dc6-47e7-ad70-b10f992b1d75 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:57.995401 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d6d9c-8dc6-47e7-ad70-b10f992b1d75 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:57.996713 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 684/1371] 10.222.0.79 () {54 vars in 963 bytes} [Thu Jul 14 12:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:00:58.002919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6b817-c8fc-42bd-8667-5318db218074 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:58.002919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6b817-c8fc-42bd-8667-5318db218074 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:58.002919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6b817-c8fc-42bd-8667-5318db218074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:58.090298 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-38b6b817-c8fc-42bd-8667-5318db218074 None None] MFA Rules not processed for user `7deede571e7d42408c2fb86665eccfe7`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:58.091600 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-38b6b817-c8fc-42bd-8667-5318db218074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:58.147098 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:58.208513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d6d9c-8dc6-47e7-ad70-b10f992b1d75 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:00:58.209700 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 688/1372] 10.222.0.79 () {58 vars in 1060 bytes} [Thu Jul 14 12:00:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:00:58.210086 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-095d6d9c-8dc6-47e7-ad70-b10f992b1d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:58.365695 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d6d9c-8dc6-47e7-ad70-b10f992b1d75 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:00:58.422448 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:58.474916 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa48e80-841e-4650-9127-0fa1b056936a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:00:58.475965 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa48e80-841e-4650-9127-0fa1b056936a service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:58.476460 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa48e80-841e-4650-9127-0fa1b056936a service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:58.476815 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa48e80-841e-4650-9127-0fa1b056936a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:58.480082 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-afa48e80-841e-4650-9127-0fa1b056936a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:58.676753 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa48e80-841e-4650-9127-0fa1b056936a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:00:58.680319 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa48e80-841e-4650-9127-0fa1b056936a service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:00:58.716642 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 685/1373] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:00:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:00:59.306255 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8adc0-956e-4438-8cf5-71a96fa6ba63 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:59.306906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8adc0-956e-4438-8cf5-71a96fa6ba63 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:59.307565 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8adc0-956e-4438-8cf5-71a96fa6ba63 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:59.310616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 689/1374] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:00:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:00:59.317302 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b7ba9-5cd9-4009-a196-0704bf8d2e71 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:00:59.317486 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b7ba9-5cd9-4009-a196-0704bf8d2e71 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:00:59.318048 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b7ba9-5cd9-4009-a196-0704bf8d2e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:00:59.412681 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-1a5b7ba9-5cd9-4009-a196-0704bf8d2e71 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:00:59.414199 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-1a5b7ba9-5cd9-4009-a196-0704bf8d2e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:59.448467 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:00:59.546935 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 686/1375] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:00:59.591563 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8adc0-956e-4438-8cf5-71a96fa6ba63 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:00:59.594397 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e1a8adc0-956e-4438-8cf5-71a96fa6ba63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:00:59.819725 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8adc0-956e-4438-8cf5-71a96fa6ba63 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:00:59.896840 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:00.018885 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b0c75-854f-441d-aa7a-6c54824ef30d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:01:00.020268 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b0c75-854f-441d-aa7a-6c54824ef30d service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:00.020783 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b0c75-854f-441d-aa7a-6c54824ef30d service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:00.021297 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b0c75-854f-441d-aa7a-6c54824ef30d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:00.024795 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-787b0c75-854f-441d-aa7a-6c54824ef30d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:00.138308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b0c75-854f-441d-aa7a-6c54824ef30d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:01:00.139886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b0c75-854f-441d-aa7a-6c54824ef30d service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:01:00.160968 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 690/1376] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:00:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:01:02.299162 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b861c-90fb-4e0a-80ad-b05a3e242158 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:02.299589 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b861c-90fb-4e0a-80ad-b05a3e242158 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:02.299589 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b861c-90fb-4e0a-80ad-b05a3e242158 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:02.301547 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 687/1377] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:01:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:01:02.307213 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c7c5e-af79-4d1c-99ba-423feac784a4 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:02.307728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c7c5e-af79-4d1c-99ba-423feac784a4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:02.308277 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c7c5e-af79-4d1c-99ba-423feac784a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:02.397546 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-169c7c5e-af79-4d1c-99ba-423feac784a4 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:02.399083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-169c7c5e-af79-4d1c-99ba-423feac784a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:02.408456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:02.520295 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 691/1378] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:01:02.567882 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b861c-90fb-4e0a-80ad-b05a3e242158 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:01:02.569392 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-201b861c-90fb-4e0a-80ad-b05a3e242158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:02.724849 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b861c-90fb-4e0a-80ad-b05a3e242158 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:01:02.736576 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:02.854911 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7585ac-83ca-44ba-a869-6c025fd60c35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:01:02.855564 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7585ac-83ca-44ba-a869-6c025fd60c35 service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:02.855850 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7585ac-83ca-44ba-a869-6c025fd60c35 service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:02.856129 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7585ac-83ca-44ba-a869-6c025fd60c35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:02.857778 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-4c7585ac-83ca-44ba-a869-6c025fd60c35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:02.959284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7585ac-83ca-44ba-a869-6c025fd60c35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:01:02.961547 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7585ac-83ca-44ba-a869-6c025fd60c35 service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:01:02.981952 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 688/1379] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:01:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:01:05.052118 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8b2c5-915d-4a44-a6f1-9f2f5e9cb4a1 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:05.052660 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8b2c5-915d-4a44-a6f1-9f2f5e9cb4a1 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:05.052660 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8b2c5-915d-4a44-a6f1-9f2f5e9cb4a1 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:05.054108 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 692/1380] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:01:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:01:05.059528 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0b018-3782-4795-bc50-d86100729b6c None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:05.059982 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0b018-3782-4795-bc50-d86100729b6c None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:05.060099 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0b018-3782-4795-bc50-d86100729b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:05.072442 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:05.135856 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-f3d0b018-3782-4795-bc50-d86100729b6c None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:05.137060 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-f3d0b018-3782-4795-bc50-d86100729b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:05.244629 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 689/1381] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:01:05.289559 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8b2c5-915d-4a44-a6f1-9f2f5e9cb4a1 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:01:05.291154 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4ec8b2c5-915d-4a44-a6f1-9f2f5e9cb4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:05.453502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:05.465819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8b2c5-915d-4a44-a6f1-9f2f5e9cb4a1 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:01:05.583382 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf558f-78c2-4523-b498-e51ec5e9cb3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:01:05.584036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf558f-78c2-4523-b498-e51ec5e9cb3c service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:05.584320 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf558f-78c2-4523-b498-e51ec5e9cb3c service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:05.584597 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf558f-78c2-4523-b498-e51ec5e9cb3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:05.586222 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f8bf558f-78c2-4523-b498-e51ec5e9cb3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:05.683270 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf558f-78c2-4523-b498-e51ec5e9cb3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:01:05.684864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf558f-78c2-4523-b498-e51ec5e9cb3c service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:01:05.697656 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:05.709596 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 693/1382] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:01:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:01:07.984528 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb461eb-953c-4f87-836c-88cd83570657 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:07.985246 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb461eb-953c-4f87-836c-88cd83570657 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:07.985246 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb461eb-953c-4f87-836c-88cd83570657 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:07.986756 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 690/1383] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:01:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:01:07.993248 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc195298-b872-4941-a202-6e696a675bcb None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:07.993761 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc195298-b872-4941-a202-6e696a675bcb None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:07.993880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc195298-b872-4941-a202-6e696a675bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:08.078668 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-fc195298-b872-4941-a202-6e696a675bcb None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:08.079918 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-fc195298-b872-4941-a202-6e696a675bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:08.197567 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 694/1384] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:01:08.247330 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb461eb-953c-4f87-836c-88cd83570657 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:01:08.248769 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-aeb461eb-953c-4f87-836c-88cd83570657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:08.347842 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:08.416102 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb461eb-953c-4f87-836c-88cd83570657 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:01:08.535177 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c3aff-37c6-4bce-a9f6-16cd8aa778aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:01:08.535774 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c3aff-37c6-4bce-a9f6-16cd8aa778aa service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:08.536071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c3aff-37c6-4bce-a9f6-16cd8aa778aa service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:08.536356 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c3aff-37c6-4bce-a9f6-16cd8aa778aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:08.538040 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-3d5c3aff-37c6-4bce-a9f6-16cd8aa778aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:08.598169 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:08.644487 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c3aff-37c6-4bce-a9f6-16cd8aa778aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:01:08.646111 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c3aff-37c6-4bce-a9f6-16cd8aa778aa service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:01:08.663949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 691/1385] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:01:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:01:10.744338 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424fdfb-412d-47ae-a6f4-88aad39a675f None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:10.744821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424fdfb-412d-47ae-a6f4-88aad39a675f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:10.744911 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424fdfb-412d-47ae-a6f4-88aad39a675f None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:10.746331 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 695/1386] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:01:10.751856 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb973232-a34f-4771-acd2-c05894211476 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:10.752431 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb973232-a34f-4771-acd2-c05894211476 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:10.752431 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb973232-a34f-4771-acd2-c05894211476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:10.836482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-fb973232-a34f-4771-acd2-c05894211476 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:10.837859 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-fb973232-a34f-4771-acd2-c05894211476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:10.963442 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 692/1387] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:01:11.008197 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424fdfb-412d-47ae-a6f4-88aad39a675f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:01:11.010176 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5424fdfb-412d-47ae-a6f4-88aad39a675f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:11.099682 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:11.188338 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424fdfb-412d-47ae-a6f4-88aad39a675f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:01:11.344564 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6acbc8-2493-4f03-9c1c-4fa05f2ea141 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:01:11.345687 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6acbc8-2493-4f03-9c1c-4fa05f2ea141 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:11.346261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6acbc8-2493-4f03-9c1c-4fa05f2ea141 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:11.346859 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6acbc8-2493-4f03-9c1c-4fa05f2ea141 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:11.350304 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6f6acbc8-2493-4f03-9c1c-4fa05f2ea141 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:11.397716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:11.455415 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6acbc8-2493-4f03-9c1c-4fa05f2ea141 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:01:11.457736 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6acbc8-2493-4f03-9c1c-4fa05f2ea141 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:01:11.476671 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 696/1388] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:01:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:01:13.533683 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04385cb-23bd-415d-87d2-082d39458c9e None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:13.534776 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04385cb-23bd-415d-87d2-082d39458c9e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:13.534776 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04385cb-23bd-415d-87d2-082d39458c9e None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:13.535730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 693/1389] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:01:13.541589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d2c43-a6db-45e5-96f0-27355ef70d44 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:13.542112 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d2c43-a6db-45e5-96f0-27355ef70d44 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:13.542112 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d2c43-a6db-45e5-96f0-27355ef70d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:13.623159 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-da6d2c43-a6db-45e5-96f0-27355ef70d44 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:13.624426 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-da6d2c43-a6db-45e5-96f0-27355ef70d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:13.749096 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 697/1390] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:01:13.794554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04385cb-23bd-415d-87d2-082d39458c9e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:01:13.796080 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b04385cb-23bd-415d-87d2-082d39458c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:13.830101 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:13.959715 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04385cb-23bd-415d-87d2-082d39458c9e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:01:14.066330 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:14.090188 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bd4f0-004f-4990-96c8-0a8987c16eaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:01:14.091359 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bd4f0-004f-4990-96c8-0a8987c16eaa service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:14.091878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bd4f0-004f-4990-96c8-0a8987c16eaa service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:14.092385 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bd4f0-004f-4990-96c8-0a8987c16eaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:14.095602 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b67bd4f0-004f-4990-96c8-0a8987c16eaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:14.098657 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27151f83-05db-4b5b-a9f3-82783e264ac8 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:14.098952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27151f83-05db-4b5b-a9f3-82783e264ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:14.099229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27151f83-05db-4b5b-a9f3-82783e264ac8 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:14.102676 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 698/1391] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:01:14.107816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348eaa8-14e3-4993-bf24-37f4034e8ea5 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:14.108420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348eaa8-14e3-4993-bf24-37f4034e8ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:14.108992 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348eaa8-14e3-4993-bf24-37f4034e8ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:14.135196 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:14.204448 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-8348eaa8-14e3-4993-bf24-37f4034e8ea5 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:14.205825 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8348eaa8-14e3-4993-bf24-37f4034e8ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:14.212976 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bd4f0-004f-4990-96c8-0a8987c16eaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:01:14.214892 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bd4f0-004f-4990-96c8-0a8987c16eaa service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:01:14.236089 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 694/1392] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:01:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:01:14.323432 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 699/1393] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:01:14.381796 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6b806-1d22-45b0-869d-24c6b60f1815 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:14.382072 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6b806-1d22-45b0-869d-24c6b60f1815 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:14.382378 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6b806-1d22-45b0-869d-24c6b60f1815 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:14.385125 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 695/1394] 10.222.0.79 () {54 vars in 962 bytes} [Thu Jul 14 12:01:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:01:14.391057 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3ebcc-bac0-467c-b7ff-2a10210e07c2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:14.391439 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3ebcc-bac0-467c-b7ff-2a10210e07c2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:14.391786 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3ebcc-bac0-467c-b7ff-2a10210e07c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:14.479343 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-03f3ebcc-bac0-467c-b7ff-2a10210e07c2 None None] MFA Rules not processed for user `d6921990ec98492f8f4420f911208b84`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:14.480573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-03f3ebcc-bac0-467c-b7ff-2a10210e07c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:14.519541 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:14.563803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 700/1395] 10.222.0.79 () {58 vars in 1059 bytes} [Thu Jul 14 12:01:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:01:14.571561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6b806-1d22-45b0-869d-24c6b60f1815 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:01:14.573164 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-67a6b806-1d22-45b0-869d-24c6b60f1815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:14.677792 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6b806-1d22-45b0-869d-24c6b60f1815 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:01:14.693106 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:14.769808 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f5a22-5de8-47f2-b56f-96955f272078 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6921990ec98492f8f4420f911208b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:01:14.770472 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f5a22-5de8-47f2-b56f-96955f272078 service glance] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:14.770781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f5a22-5de8-47f2-b56f-96955f272078 service glance] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:14.771056 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f5a22-5de8-47f2-b56f-96955f272078 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:14.772761 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5c9f5a22-5de8-47f2-b56f-96955f272078 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:14.894832 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f5a22-5de8-47f2-b56f-96955f272078 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:01:14.896666 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f5a22-5de8-47f2-b56f-96955f272078 service glance] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:01:14.917111 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 696/1396] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:01:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:01:15.654001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d8d7f-b018-4a09-9214-91fd4337723b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:15.654487 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d8d7f-b018-4a09-9214-91fd4337723b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:15.654614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d8d7f-b018-4a09-9214-91fd4337723b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:15.721642 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-162d8d7f-b018-4a09-9214-91fd4337723b None None] MFA Rules not processed for user `f64d942793a5493787c3e5c7815bc134`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:15.722949 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-162d8d7f-b018-4a09-9214-91fd4337723b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:15.815012 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 701/1397] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Jul 14 12:01:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:01:15.865621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13358fa-533d-41bd-ac16-adce57da158c None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:15.866178 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13358fa-533d-41bd-ac16-adce57da158c None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:15.866178 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13358fa-533d-41bd-ac16-adce57da158c None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:15.867639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 697/1398] 10.222.0.79 () {54 vars in 942 bytes} [Thu Jul 14 12:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:01:15.874669 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e40b7-08f6-4730-a54d-5312a40055e6 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:15.875013 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e40b7-08f6-4730-a54d-5312a40055e6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:15.875283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e40b7-08f6-4730-a54d-5312a40055e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:15.938351 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:15.962481 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-042e40b7-08f6-4730-a54d-5312a40055e6 None None] MFA Rules not processed for user `969ee98dfe644ef2a016860aa1585317`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:15.963718 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-042e40b7-08f6-4730-a54d-5312a40055e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:16.078989 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 702/1399] 10.222.0.79 () {58 vars in 1039 bytes} [Thu Jul 14 12:01:15 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:01:16.088656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13358fa-533d-41bd-ac16-adce57da158c None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:01:16.090107 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-d13358fa-533d-41bd-ac16-adce57da158c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:16.137269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:16.228984 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13358fa-533d-41bd-ac16-adce57da158c None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:01:16.313887 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434795a5-f00b-4b80-82b4-3ae109ea13fc None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:16.314169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434795a5-f00b-4b80-82b4-3ae109ea13fc None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:16.314445 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434795a5-f00b-4b80-82b4-3ae109ea13fc None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:16.316451 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 703/1400] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:01:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:01:16.321526 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c460f-1227-4463-8539-b958ca599e4a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:16.321850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c460f-1227-4463-8539-b958ca599e4a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:16.322132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c460f-1227-4463-8539-b958ca599e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:16.333309 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585faa6-a44e-4be0-aaba-2b902700ee39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969ee98dfe644ef2a016860aa1585317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:01:16.334043 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585faa6-a44e-4be0-aaba-2b902700ee39 service swift] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:16.334322 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585faa6-a44e-4be0-aaba-2b902700ee39 service swift] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:16.334623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585faa6-a44e-4be0-aaba-2b902700ee39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:16.336298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-2585faa6-a44e-4be0-aaba-2b902700ee39 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:16.366337 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:16.390352 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3d8c460f-1227-4463-8539-b958ca599e4a None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:16.391624 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3d8c460f-1227-4463-8539-b958ca599e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:16.422428 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585faa6-a44e-4be0-aaba-2b902700ee39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:01:16.424330 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585faa6-a44e-4be0-aaba-2b902700ee39 service swift] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:01:16.433118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 698/1401] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Jul 14 12:01:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 12:01:16.452969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:16.502149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 704/1402] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:01:16.548590 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585faa6-a44e-4be0-aaba-2b902700ee39 service swift] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:01:16.549984 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-2585faa6-a44e-4be0-aaba-2b902700ee39 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:16.669256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585faa6-a44e-4be0-aaba-2b902700ee39 service swift] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:01:16.752049 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:16.817864 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753684cc-40a2-4b82-a6fb-f6426a38b998 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:01:16.818582 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753684cc-40a2-4b82-a6fb-f6426a38b998 service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:16.818889 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753684cc-40a2-4b82-a6fb-f6426a38b998 service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:16.819159 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753684cc-40a2-4b82-a6fb-f6426a38b998 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:16.820874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-753684cc-40a2-4b82-a6fb-f6426a38b998 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:16.924418 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753684cc-40a2-4b82-a6fb-f6426a38b998 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:01:16.926624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753684cc-40a2-4b82-a6fb-f6426a38b998 service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:01:16.951368 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 699/1403] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:01:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:01:19.046761 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20035e4f-f94b-4525-8570-2f6a49c93398 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:19.047526 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20035e4f-f94b-4525-8570-2f6a49c93398 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:19.047526 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20035e4f-f94b-4525-8570-2f6a49c93398 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:19.048898 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 705/1404] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:01:19.055080 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309855af-1fbc-4759-8773-6eb6b4cb2263 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:19.055960 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309855af-1fbc-4759-8773-6eb6b4cb2263 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:19.056421 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309855af-1fbc-4759-8773-6eb6b4cb2263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:19.142236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-309855af-1fbc-4759-8773-6eb6b4cb2263 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:19.143585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-309855af-1fbc-4759-8773-6eb6b4cb2263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:19.188856 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:19.260466 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 700/1405] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:01:19.304904 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20035e4f-f94b-4525-8570-2f6a49c93398 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:01:19.306329 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-20035e4f-f94b-4525-8570-2f6a49c93398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:19.512501 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20035e4f-f94b-4525-8570-2f6a49c93398 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:01:19.566211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:19.709705 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec2366-199f-4a1f-af33-82ebfbaf9eb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:01:19.711103 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec2366-199f-4a1f-af33-82ebfbaf9eb9 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:19.711408 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec2366-199f-4a1f-af33-82ebfbaf9eb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:19.712150 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec2366-199f-4a1f-af33-82ebfbaf9eb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:19.715000 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-37ec2366-199f-4a1f-af33-82ebfbaf9eb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:19.857140 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec2366-199f-4a1f-af33-82ebfbaf9eb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:01:19.858913 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec2366-199f-4a1f-af33-82ebfbaf9eb9 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:01:19.883065 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 706/1406] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:01:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:01:22.071071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1bec4-c72f-4c56-8e78-59bbda377517 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:22.071639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1bec4-c72f-4c56-8e78-59bbda377517 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:22.071639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1bec4-c72f-4c56-8e78-59bbda377517 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:22.074345 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 701/1407] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:01:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:01:22.079185 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25973ea0-8952-4d01-af54-8876e01bf5ea None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:22.079730 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25973ea0-8952-4d01-af54-8876e01bf5ea None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:22.079730 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25973ea0-8952-4d01-af54-8876e01bf5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:22.149803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:22.158478 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-25973ea0-8952-4d01-af54-8876e01bf5ea None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:22.160565 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-25973ea0-8952-4d01-af54-8876e01bf5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:22.286436 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 707/1408] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:01:22.332384 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1bec4-c72f-4c56-8e78-59bbda377517 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:01:22.333995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-95b1bec4-c72f-4c56-8e78-59bbda377517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:22.504770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1bec4-c72f-4c56-8e78-59bbda377517 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:01:22.528245 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:22.641157 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7641db-b7e7-448e-b2a0-422a94cc01f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:01:22.641729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7641db-b7e7-448e-b2a0-422a94cc01f6 service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:22.642180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7641db-b7e7-448e-b2a0-422a94cc01f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:22.642346 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7641db-b7e7-448e-b2a0-422a94cc01f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:22.644369 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-7b7641db-b7e7-448e-b2a0-422a94cc01f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:22.761851 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7641db-b7e7-448e-b2a0-422a94cc01f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:01:22.763768 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7641db-b7e7-448e-b2a0-422a94cc01f6 service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:01:22.794820 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 702/1409] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:01:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:01:32.284213 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=44 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:32.782378 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=90 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:38.844073 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c66db-1f78-4cef-bc84-b2c4891c3edc None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:38.844612 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c66db-1f78-4cef-bc84-b2c4891c3edc None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:38.844612 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c66db-1f78-4cef-bc84-b2c4891c3edc None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:38.846011 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 708/1410] 10.222.0.79 () {54 vars in 918 bytes} [Thu Jul 14 12:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:01:38.851406 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1dcbd4-01cb-4a28-91ce-84fe2f8eb2aa None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:38.851839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1dcbd4-01cb-4a28-91ce-84fe2f8eb2aa None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:38.851995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1dcbd4-01cb-4a28-91ce-84fe2f8eb2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:38.927532 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-ed1dcbd4-01cb-4a28-91ce-84fe2f8eb2aa None None] MFA Rules not processed for user `d6070c6b901f4e2ebe621a3e42dd2d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:38.928780 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ed1dcbd4-01cb-4a28-91ce-84fe2f8eb2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:39.036514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 703/1411] 10.222.0.79 () {58 vars in 1015 bytes} [Thu Jul 14 12:01:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:01:39.051921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31e663-f79f-47a6-8bb5-063e1597c7b7 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:39.052212 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31e663-f79f-47a6-8bb5-063e1597c7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:39.052511 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31e663-f79f-47a6-8bb5-063e1597c7b7 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:39.053912 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 709/1412] 10.222.0.79 () {54 vars in 918 bytes} [Thu Jul 14 12:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:01:39.058680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a987a-df98-4860-92ff-962c9c33c74b None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:39.058975 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a987a-df98-4860-92ff-962c9c33c74b None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:39.059260 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a987a-df98-4860-92ff-962c9c33c74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:39.129588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:39.132396 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-1b6a987a-df98-4860-92ff-962c9c33c74b None None] MFA Rules not processed for user `e41a4d3a822c403fad048764a0edf209`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:39.134276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-1b6a987a-df98-4860-92ff-962c9c33c74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:39.255583 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 704/1413] 10.222.0.79 () {58 vars in 1015 bytes} [Thu Jul 14 12:01:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:01:41.777212 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0f915-5179-4ec8-bf80-03550cbbaf08 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:41.777685 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0f915-5179-4ec8-bf80-03550cbbaf08 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:41.777777 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0f915-5179-4ec8-bf80-03550cbbaf08 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:41.779180 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 12:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:01:41.784499 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1a7de-78d5-4fa0-89be-ebb8fd40a5e0 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:41.784964 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1a7de-78d5-4fa0-89be-ebb8fd40a5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:41.785082 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1a7de-78d5-4fa0-89be-ebb8fd40a5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:41.847568 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-63e1a7de-78d5-4fa0-89be-ebb8fd40a5e0 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:41.848761 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-63e1a7de-78d5-4fa0-89be-ebb8fd40a5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:41.901910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:41.946427 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 12:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:01:41.990136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0f915-5179-4ec8-bf80-03550cbbaf08 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:01:41.991891 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-73f0f915-5179-4ec8-bf80-03550cbbaf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:42.140224 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0f915-5179-4ec8-bf80-03550cbbaf08 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:01:42.214882 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:42.255518 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a9c1a-008d-4ec9-b60b-213f5aa5d39f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:01:42.256165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a9c1a-008d-4ec9-b60b-213f5aa5d39f service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:42.256448 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a9c1a-008d-4ec9-b60b-213f5aa5d39f service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:42.256722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a9c1a-008d-4ec9-b60b-213f5aa5d39f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:42.258330 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3f0a9c1a-008d-4ec9-b60b-213f5aa5d39f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:42.348649 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a9c1a-008d-4ec9-b60b-213f5aa5d39f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:01:42.350242 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a9c1a-008d-4ec9-b60b-213f5aa5d39f service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:01:42.368337 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 711/1416] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:01:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:01:43.274318 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa65cab-55c3-4039-a186-f7f2f6925df1 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:43.274918 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa65cab-55c3-4039-a186-f7f2f6925df1 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:43.275010 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa65cab-55c3-4039-a186-f7f2f6925df1 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:43.276325 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 12:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:01:43.281313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29016363-12cb-4f3b-8d35-37830cf6856a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:43.281743 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29016363-12cb-4f3b-8d35-37830cf6856a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:43.281874 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29016363-12cb-4f3b-8d35-37830cf6856a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:43.355558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-29016363-12cb-4f3b-8d35-37830cf6856a None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:43.356778 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-29016363-12cb-4f3b-8d35-37830cf6856a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:43.382852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:43.452941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 12:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:01:43.612474 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa65cab-55c3-4039-a186-f7f2f6925df1 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:01:43.613901 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-2aa65cab-55c3-4039-a186-f7f2f6925df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:43.758589 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa65cab-55c3-4039-a186-f7f2f6925df1 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:01:43.797066 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:43.868524 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb55857-b4f1-4b4a-8d40-598f3da193d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:01:43.869080 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb55857-b4f1-4b4a-8d40-598f3da193d5 service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:43.869361 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb55857-b4f1-4b4a-8d40-598f3da193d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:43.869636 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb55857-b4f1-4b4a-8d40-598f3da193d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:43.871296 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-bbb55857-b4f1-4b4a-8d40-598f3da193d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:43.958418 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb55857-b4f1-4b4a-8d40-598f3da193d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:01:43.960062 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb55857-b4f1-4b4a-8d40-598f3da193d5 service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:01:43.978207 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 707/1419] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:01:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:01:44.876720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4388c38-0167-4891-a2fe-8140f5c68433 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:44.877834 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4388c38-0167-4891-a2fe-8140f5c68433 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:44.877974 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4388c38-0167-4891-a2fe-8140f5c68433 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:44.879441 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 12:01:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:01:44.884542 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311bbae-a548-4cb3-b6e3-8bb39de18721 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:44.884984 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311bbae-a548-4cb3-b6e3-8bb39de18721 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:44.885147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311bbae-a548-4cb3-b6e3-8bb39de18721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:44.941020 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:44.963028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-4311bbae-a548-4cb3-b6e3-8bb39de18721 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:44.964140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-4311bbae-a548-4cb3-b6e3-8bb39de18721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:45.061159 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 12:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:01:45.212665 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4388c38-0167-4891-a2fe-8140f5c68433 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:01:45.214202 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e4388c38-0167-4891-a2fe-8140f5c68433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:45.358541 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4388c38-0167-4891-a2fe-8140f5c68433 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:01:45.370651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:45.470405 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22172234-f6d2-4e78-b537-201515b427a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:01:45.472114 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22172234-f6d2-4e78-b537-201515b427a2 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:45.472389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22172234-f6d2-4e78-b537-201515b427a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:45.472693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22172234-f6d2-4e78-b537-201515b427a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:45.474338 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-22172234-f6d2-4e78-b537-201515b427a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:45.564424 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22172234-f6d2-4e78-b537-201515b427a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:01:45.566695 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22172234-f6d2-4e78-b537-201515b427a2 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:01:45.584601 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 714/1422] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:01:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:01:46.459331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be62654-b226-493b-9616-b3f168d6662e None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:46.459907 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be62654-b226-493b-9616-b3f168d6662e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:46.459907 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be62654-b226-493b-9616-b3f168d6662e None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:46.461279 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 12:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:01:46.466277 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9b340-18c2-49c5-83d4-4546078374b1 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:46.466789 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9b340-18c2-49c5-83d4-4546078374b1 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:46.466895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9b340-18c2-49c5-83d4-4546078374b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:46.486467 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:46.666650 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-5ff9b340-18c2-49c5-83d4-4546078374b1 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:46.667877 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5ff9b340-18c2-49c5-83d4-4546078374b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:46.766601 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 12:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:01:46.947723 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be62654-b226-493b-9616-b3f168d6662e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:01:46.949295 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-3be62654-b226-493b-9616-b3f168d6662e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:47.063134 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:47.100935 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be62654-b226-493b-9616-b3f168d6662e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:01:47.218682 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb608418-e884-4973-a68a-9629030cb064 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:01:47.219336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb608418-e884-4973-a68a-9629030cb064 service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:47.219618 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb608418-e884-4973-a68a-9629030cb064 service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:47.219892 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb608418-e884-4973-a68a-9629030cb064 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:47.221653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-cb608418-e884-4973-a68a-9629030cb064 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:47.299493 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:47.314374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb608418-e884-4973-a68a-9629030cb064 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:01:47.316471 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb608418-e884-4973-a68a-9629030cb064 service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:01:47.335518 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 710/1425] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:01:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:01:48.198989 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda56c79-cf16-47f3-a708-cc7906bf25ed None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:48.199561 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda56c79-cf16-47f3-a708-cc7906bf25ed None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:48.199561 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda56c79-cf16-47f3-a708-cc7906bf25ed None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:48.200921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 12:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:01:48.205808 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6defd-c8fa-4810-9cc5-74ebce258d01 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:48.206258 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6defd-c8fa-4810-9cc5-74ebce258d01 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:48.206365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6defd-c8fa-4810-9cc5-74ebce258d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:48.279982 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-21f6defd-c8fa-4810-9cc5-74ebce258d01 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:48.281195 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-21f6defd-c8fa-4810-9cc5-74ebce258d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:48.375957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 12:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:01:48.526629 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda56c79-cf16-47f3-a708-cc7906bf25ed None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:01:48.528144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-eda56c79-cf16-47f3-a708-cc7906bf25ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:48.612554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:48.674885 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda56c79-cf16-47f3-a708-cc7906bf25ed None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:01:48.788708 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70381499-5740-4afc-9928-e79919aa463d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:01:48.789357 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70381499-5740-4afc-9928-e79919aa463d service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:48.789643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70381499-5740-4afc-9928-e79919aa463d service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:48.789920 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70381499-5740-4afc-9928-e79919aa463d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:48.791616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-70381499-5740-4afc-9928-e79919aa463d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:48.840332 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:48.881678 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70381499-5740-4afc-9928-e79919aa463d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:01:48.883324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70381499-5740-4afc-9928-e79919aa463d service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:01:48.901278 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 717/1428] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:01:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:01:49.704332 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8b912-80ba-41dd-9f40-d2044ce2a011 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:49.704876 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8b912-80ba-41dd-9f40-d2044ce2a011 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:49.704876 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8b912-80ba-41dd-9f40-d2044ce2a011 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:49.706800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 12:01:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:01:49.711670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0a127-9035-400a-a9bd-a587e1e63154 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:49.712093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0a127-9035-400a-a9bd-a587e1e63154 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:49.712217 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0a127-9035-400a-a9bd-a587e1e63154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:49.785343 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-35f0a127-9035-400a-a9bd-a587e1e63154 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:49.786587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-35f0a127-9035-400a-a9bd-a587e1e63154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:49.881627 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 12:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:01:50.030734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8b912-80ba-41dd-9f40-d2044ce2a011 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:01:50.032485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-2ad8b912-80ba-41dd-9f40-d2044ce2a011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:50.083911 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:50.188120 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8b912-80ba-41dd-9f40-d2044ce2a011 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:01:50.297600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02126bee-7faa-425a-94fe-5c1bd1c779a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:01:50.298412 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02126bee-7faa-425a-94fe-5c1bd1c779a4 service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:50.298721 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02126bee-7faa-425a-94fe-5c1bd1c779a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:50.299595 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02126bee-7faa-425a-94fe-5c1bd1c779a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:50.301240 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-02126bee-7faa-425a-94fe-5c1bd1c779a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:50.308143 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:50.389559 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02126bee-7faa-425a-94fe-5c1bd1c779a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:01:50.391197 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02126bee-7faa-425a-94fe-5c1bd1c779a4 service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:01:50.409410 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 713/1431] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:01:51.226229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa2741-12b1-4969-81a7-fb9ac170c02f None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:51.226871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa2741-12b1-4969-81a7-fb9ac170c02f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:51.226871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa2741-12b1-4969-81a7-fb9ac170c02f None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:51.228266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 12:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:01:51.233822 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c76b5-4660-4874-937a-3d2b73b47134 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:51.235189 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c76b5-4660-4874-937a-3d2b73b47134 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:51.235189 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c76b5-4660-4874-937a-3d2b73b47134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:51.434149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-7c0c76b5-4660-4874-937a-3d2b73b47134 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:51.435456 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-7c0c76b5-4660-4874-937a-3d2b73b47134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:51.507556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:51.543228 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 12:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:01:51.699599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa2741-12b1-4969-81a7-fb9ac170c02f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:01:51.701149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a8fa2741-12b1-4969-81a7-fb9ac170c02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:51.720410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:51.860771 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa2741-12b1-4969-81a7-fb9ac170c02f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:01:51.947242 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:51.974513 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19293120-17a5-4022-96f6-337899f6a5ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:01:51.975175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19293120-17a5-4022-96f6-337899f6a5ea service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:51.975457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19293120-17a5-4022-96f6-337899f6a5ea service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:51.975733 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19293120-17a5-4022-96f6-337899f6a5ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:51.977352 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-19293120-17a5-4022-96f6-337899f6a5ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:52.065330 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19293120-17a5-4022-96f6-337899f6a5ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:01:52.067018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19293120-17a5-4022-96f6-337899f6a5ea service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:01:52.085743 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 720/1434] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:01:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:01:52.911235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d6b4e-2011-426d-867e-05408cb3683a None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:52.911848 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d6b4e-2011-426d-867e-05408cb3683a None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:52.911848 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d6b4e-2011-426d-867e-05408cb3683a None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:52.913224 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 12:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:01:52.918689 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176cfa8-548b-4b7c-a9de-3f6da95213b1 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:52.919230 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176cfa8-548b-4b7c-a9de-3f6da95213b1 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:52.919230 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176cfa8-548b-4b7c-a9de-3f6da95213b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:53.013099 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f176cfa8-548b-4b7c-a9de-3f6da95213b1 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:53.014255 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f176cfa8-548b-4b7c-a9de-3f6da95213b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:53.062906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:53.126525 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 12:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:01:53.279453 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d6b4e-2011-426d-867e-05408cb3683a None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:01:53.280908 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-272d6b4e-2011-426d-867e-05408cb3683a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:53.439545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d6b4e-2011-426d-867e-05408cb3683a None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:01:53.500890 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:53.569574 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1d79b-676e-4941-abd0-3960dd8f72da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:01:53.570142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1d79b-676e-4941-abd0-3960dd8f72da service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:53.570424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1d79b-676e-4941-abd0-3960dd8f72da service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:53.570724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1d79b-676e-4941-abd0-3960dd8f72da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:53.572447 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-12e1d79b-676e-4941-abd0-3960dd8f72da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:53.683396 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1d79b-676e-4941-abd0-3960dd8f72da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:01:53.685023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1d79b-676e-4941-abd0-3960dd8f72da service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:01:53.704810 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 716/1437] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:01:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:01:54.525312 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2f2ab-fadc-405d-a916-adbdc65b05a8 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:54.525894 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2f2ab-fadc-405d-a916-adbdc65b05a8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:54.525894 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2f2ab-fadc-405d-a916-adbdc65b05a8 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:54.527283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 12:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:01:54.532414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8b091-3d3b-4c24-9981-d49d7c1f9337 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:54.532900 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8b091-3d3b-4c24-9981-d49d7c1f9337 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:54.533159 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8b091-3d3b-4c24-9981-d49d7c1f9337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:54.608370 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-a5c8b091-3d3b-4c24-9981-d49d7c1f9337 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:54.609583 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a5c8b091-3d3b-4c24-9981-d49d7c1f9337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:54.611677 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:54.713449 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 12:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:01:54.863917 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2f2ab-fadc-405d-a916-adbdc65b05a8 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:01:54.865549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-00c2f2ab-fadc-405d-a916-adbdc65b05a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:55.015195 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2f2ab-fadc-405d-a916-adbdc65b05a8 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:01:55.042322 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:55.128661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91c2c0-d6a7-4f4e-bea1-808ff173175c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:01:55.129303 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91c2c0-d6a7-4f4e-bea1-808ff173175c service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:55.129582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91c2c0-d6a7-4f4e-bea1-808ff173175c service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:55.129852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91c2c0-d6a7-4f4e-bea1-808ff173175c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:55.131489 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2b91c2c0-d6a7-4f4e-bea1-808ff173175c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:55.217784 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91c2c0-d6a7-4f4e-bea1-808ff173175c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:01:55.219386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91c2c0-d6a7-4f4e-bea1-808ff173175c service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:01:55.239789 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 723/1440] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:01:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:01:57.214720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440a23d-2bab-4078-94df-6ead67471c1a None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:57.215281 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440a23d-2bab-4078-94df-6ead67471c1a None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:57.215281 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440a23d-2bab-4078-94df-6ead67471c1a None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:57.216670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 12:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:01:57.222387 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79726bd6-0d71-42f3-81f8-a84b65af3df4 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:57.222908 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79726bd6-0d71-42f3-81f8-a84b65af3df4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:57.223009 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79726bd6-0d71-42f3-81f8-a84b65af3df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:57.263686 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:57.289403 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-79726bd6-0d71-42f3-81f8-a84b65af3df4 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:57.290643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-79726bd6-0d71-42f3-81f8-a84b65af3df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:57.386088 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 12:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:01:57.424538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440a23d-2bab-4078-94df-6ead67471c1a None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:01:57.426157 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-0440a23d-2bab-4078-94df-6ead67471c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:57.527204 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440a23d-2bab-4078-94df-6ead67471c1a None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:01:57.559400 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:01:57.601087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00abf99-f9f1-4da6-acfa-b8a9d43f1d5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:01:57.601734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00abf99-f9f1-4da6-acfa-b8a9d43f1d5a service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:57.602015 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00abf99-f9f1-4da6-acfa-b8a9d43f1d5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:57.602286 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00abf99-f9f1-4da6-acfa-b8a9d43f1d5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:57.603932 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-d00abf99-f9f1-4da6-acfa-b8a9d43f1d5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:57.709982 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00abf99-f9f1-4da6-acfa-b8a9d43f1d5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:01:57.711443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00abf99-f9f1-4da6-acfa-b8a9d43f1d5a service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:01:57.729666 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 719/1443] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:01:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:01:59.900034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9e906-b2ae-4c3b-9c9b-299e8a7f8dc6 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:59.900595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9e906-b2ae-4c3b-9c9b-299e8a7f8dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:59.900595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9e906-b2ae-4c3b-9c9b-299e8a7f8dc6 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:59.901967 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 12:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:01:59.907246 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5a49f-f773-4919-8f97-d287aed76b34 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:01:59.907662 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5a49f-f773-4919-8f97-d287aed76b34 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:01:59.907802 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5a49f-f773-4919-8f97-d287aed76b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:01:59.971893 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-0ee5a49f-f773-4919-8f97-d287aed76b34 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:01:59.973151 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-0ee5a49f-f773-4919-8f97-d287aed76b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:01:59.986624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:00.068967 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 12:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:02:00.106248 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9e906-b2ae-4c3b-9c9b-299e8a7f8dc6 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:02:00.107817 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8aa9e906-b2ae-4c3b-9c9b-299e8a7f8dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:00.210282 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9e906-b2ae-4c3b-9c9b-299e8a7f8dc6 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:02:00.222193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:00.290865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca92805-3568-4144-8e2b-953856518f45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:02:00.291514 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca92805-3568-4144-8e2b-953856518f45 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:00.291799 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca92805-3568-4144-8e2b-953856518f45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:00.292073 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca92805-3568-4144-8e2b-953856518f45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:00.293703 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-fca92805-3568-4144-8e2b-953856518f45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:00.401243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca92805-3568-4144-8e2b-953856518f45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:02:00.402627 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca92805-3568-4144-8e2b-953856518f45 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:02:00.420870 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 726/1446] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:02:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:02:02.775272 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2f8e0-9e01-40eb-b967-9444ccd10ba7 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:02.775771 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2f8e0-9e01-40eb-b967-9444ccd10ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:02.775866 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2f8e0-9e01-40eb-b967-9444ccd10ba7 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:02.777213 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 12:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:02:02.782444 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf4f88-4b40-44b6-af5e-1e40583bb530 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:02.782970 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf4f88-4b40-44b6-af5e-1e40583bb530 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:02.783111 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf4f88-4b40-44b6-af5e-1e40583bb530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:02.830047 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:02.848278 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-36bf4f88-4b40-44b6-af5e-1e40583bb530 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:02:02.849506 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-36bf4f88-4b40-44b6-af5e-1e40583bb530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:02.946686 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 12:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:02:02.986143 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2f8e0-9e01-40eb-b967-9444ccd10ba7 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:02:02.987804 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-77f2f8e0-9e01-40eb-b967-9444ccd10ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:03.095063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2f8e0-9e01-40eb-b967-9444ccd10ba7 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:02:03.136670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:03.171508 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c28c8-3819-4e16-ae2b-8b958371a916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:02:03.172156 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c28c8-3819-4e16-ae2b-8b958371a916 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:03.172445 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c28c8-3819-4e16-ae2b-8b958371a916 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:03.172978 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c28c8-3819-4e16-ae2b-8b958371a916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:03.175286 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-514c28c8-3819-4e16-ae2b-8b958371a916 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:03.281808 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c28c8-3819-4e16-ae2b-8b958371a916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:02:03.283939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c28c8-3819-4e16-ae2b-8b958371a916 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:02:03.304324 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 722/1449] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:02:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:02:05.528877 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e4069-dadb-44b6-b901-e7c12f951415 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:05.529489 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e4069-dadb-44b6-b901-e7c12f951415 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:05.529489 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e4069-dadb-44b6-b901-e7c12f951415 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:05.530833 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 12:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:02:05.536199 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e14f89-a626-47a7-8391-e84cbfe37b8b None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:05.536632 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e14f89-a626-47a7-8391-e84cbfe37b8b None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:05.536778 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e14f89-a626-47a7-8391-e84cbfe37b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:05.605866 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-38e14f89-a626-47a7-8391-e84cbfe37b8b None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:02:05.607186 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-38e14f89-a626-47a7-8391-e84cbfe37b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:05.628008 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:05.702282 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 12:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:02:05.741377 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e4069-dadb-44b6-b901-e7c12f951415 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:02:05.742953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0a8e4069-dadb-44b6-b901-e7c12f951415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:05.852688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e4069-dadb-44b6-b901-e7c12f951415 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:02:05.873000 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:05.928433 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed168ac3-0c7b-4fa0-aa1a-53b8fb328166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:02:05.929090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed168ac3-0c7b-4fa0-aa1a-53b8fb328166 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:05.929374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed168ac3-0c7b-4fa0-aa1a-53b8fb328166 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:05.929649 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed168ac3-0c7b-4fa0-aa1a-53b8fb328166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:05.931357 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ed168ac3-0c7b-4fa0-aa1a-53b8fb328166 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:06.039574 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed168ac3-0c7b-4fa0-aa1a-53b8fb328166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:02:06.041063 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed168ac3-0c7b-4fa0-aa1a-53b8fb328166 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:02:06.061867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 729/1452] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:02:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:02:08.167920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b94e65-862e-4874-961f-71b937e0b5c8 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:08.168469 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b94e65-862e-4874-961f-71b937e0b5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:08.168469 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b94e65-862e-4874-961f-71b937e0b5c8 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:08.169758 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 12:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:02:08.175400 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9fac6-a8fc-4a13-969d-623fc48b1e63 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:08.175841 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9fac6-a8fc-4a13-969d-623fc48b1e63 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:08.175963 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9fac6-a8fc-4a13-969d-623fc48b1e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:08.238351 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:08.240980 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-76b9fac6-a8fc-4a13-969d-623fc48b1e63 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:02:08.242851 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-76b9fac6-a8fc-4a13-969d-623fc48b1e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:08.338365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 12:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:02:08.375228 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b94e65-862e-4874-961f-71b937e0b5c8 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:02:08.377505 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-c1b94e65-862e-4874-961f-71b937e0b5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:08.487290 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b94e65-862e-4874-961f-71b937e0b5c8 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:02:08.537230 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:08.562465 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09450b82-5d89-4ca7-8acd-9f7f101c6417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:02:08.563141 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09450b82-5d89-4ca7-8acd-9f7f101c6417 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:08.563425 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09450b82-5d89-4ca7-8acd-9f7f101c6417 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:08.563697 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09450b82-5d89-4ca7-8acd-9f7f101c6417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:08.566007 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-09450b82-5d89-4ca7-8acd-9f7f101c6417 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:08.672958 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09450b82-5d89-4ca7-8acd-9f7f101c6417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:02:08.674940 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09450b82-5d89-4ca7-8acd-9f7f101c6417 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:02:08.693868 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 725/1455] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:02:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:02:10.768497 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18acef-0d83-485b-a644-48e5930f2e48 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:10.769025 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18acef-0d83-485b-a644-48e5930f2e48 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:10.769025 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18acef-0d83-485b-a644-48e5930f2e48 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:10.770499 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 12:02:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:02:10.775675 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59105c7a-de58-46bd-8f3f-a11f0d302c0f None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:10.776085 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59105c7a-de58-46bd-8f3f-a11f0d302c0f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:10.776229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59105c7a-de58-46bd-8f3f-a11f0d302c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:10.841741 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-59105c7a-de58-46bd-8f3f-a11f0d302c0f None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:02:10.842990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-59105c7a-de58-46bd-8f3f-a11f0d302c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:10.872093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:10.949856 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 12:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:02:10.988059 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18acef-0d83-485b-a644-48e5930f2e48 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:02:10.989649 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7f18acef-0d83-485b-a644-48e5930f2e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:11.092110 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18acef-0d83-485b-a644-48e5930f2e48 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:02:11.120418 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:11.166629 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4697f3-3cdd-4e0e-a23e-0b217fe0525b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:02:11.167283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4697f3-3cdd-4e0e-a23e-0b217fe0525b service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:11.167566 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4697f3-3cdd-4e0e-a23e-0b217fe0525b service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:11.167841 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4697f3-3cdd-4e0e-a23e-0b217fe0525b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:11.169482 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ba4697f3-3cdd-4e0e-a23e-0b217fe0525b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:11.278305 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4697f3-3cdd-4e0e-a23e-0b217fe0525b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:02:11.279760 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4697f3-3cdd-4e0e-a23e-0b217fe0525b service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:02:11.298102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 732/1458] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:02:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:02:13.441253 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc1db3-ee6f-4d93-bb1d-aabc91b8c8c3 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:13.441845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc1db3-ee6f-4d93-bb1d-aabc91b8c8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:13.441845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc1db3-ee6f-4d93-bb1d-aabc91b8c8c3 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:13.443201 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 12:02:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:02:13.448424 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af100cae-b88c-4600-b6d9-6b89d9baf8b9 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:13.448861 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af100cae-b88c-4600-b6d9-6b89d9baf8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:13.448957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af100cae-b88c-4600-b6d9-6b89d9baf8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:13.513545 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-af100cae-b88c-4600-b6d9-6b89d9baf8b9 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:02:13.514788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-af100cae-b88c-4600-b6d9-6b89d9baf8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:13.523112 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:13.611158 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 12:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:02:13.649265 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc1db3-ee6f-4d93-bb1d-aabc91b8c8c3 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:02:13.650852 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-90dc1db3-ee6f-4d93-bb1d-aabc91b8c8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:13.754078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc1db3-ee6f-4d93-bb1d-aabc91b8c8c3 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:02:13.807754 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:13.827184 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fbbf26-c02a-4468-b53a-df1ad1e0f36c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:02:13.828161 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbbf26-c02a-4468-b53a-df1ad1e0f36c service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:13.828462 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbbf26-c02a-4468-b53a-df1ad1e0f36c service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:13.828792 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbbf26-c02a-4468-b53a-df1ad1e0f36c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:13.830591 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a4fbbf26-c02a-4468-b53a-df1ad1e0f36c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:13.936856 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fbbf26-c02a-4468-b53a-df1ad1e0f36c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:02:13.938296 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fbbf26-c02a-4468-b53a-df1ad1e0f36c service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:02:13.957025 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 728/1461] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:02:16.046626 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235ab64-a30c-4eeb-bda5-10f4361ddca4 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:16.047339 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235ab64-a30c-4eeb-bda5-10f4361ddca4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:16.047339 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235ab64-a30c-4eeb-bda5-10f4361ddca4 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:16.048837 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 12:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:02:16.054411 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcde79-637e-4a3b-8d9e-aaa638a13d18 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:16.054955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcde79-637e-4a3b-8d9e-aaa638a13d18 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:16.055077 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcde79-637e-4a3b-8d9e-aaa638a13d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:16.121942 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-99dcde79-637e-4a3b-8d9e-aaa638a13d18 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:02:16.123183 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-99dcde79-637e-4a3b-8d9e-aaa638a13d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:16.164010 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:16.221381 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 12:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:02:16.259114 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235ab64-a30c-4eeb-bda5-10f4361ddca4 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:02:16.260661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d235ab64-a30c-4eeb-bda5-10f4361ddca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:16.364854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235ab64-a30c-4eeb-bda5-10f4361ddca4 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:02:16.402113 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:16.439446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894ccf5-94ff-404e-87d9-34c23265b683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:02:16.440330 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894ccf5-94ff-404e-87d9-34c23265b683 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:16.440617 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894ccf5-94ff-404e-87d9-34c23265b683 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:16.440942 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894ccf5-94ff-404e-87d9-34c23265b683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:16.442614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a894ccf5-94ff-404e-87d9-34c23265b683 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:16.552510 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894ccf5-94ff-404e-87d9-34c23265b683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:02:16.553952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894ccf5-94ff-404e-87d9-34c23265b683 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:02:16.572821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 735/1464] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:02:18.597613 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508451e3-314f-4ff5-8c4f-8772d985127e None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:18.598187 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508451e3-314f-4ff5-8c4f-8772d985127e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:18.598187 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508451e3-314f-4ff5-8c4f-8772d985127e None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:18.599561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 12:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:02:18.604769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f89a0-649f-4e95-a9d8-72949b685357 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:18.605203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f89a0-649f-4e95-a9d8-72949b685357 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:18.605324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f89a0-649f-4e95-a9d8-72949b685357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:18.672041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-276f89a0-649f-4e95-a9d8-72949b685357 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:02:18.674115 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-276f89a0-649f-4e95-a9d8-72949b685357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:18.691781 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:18.774424 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 12:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:02:18.811420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508451e3-314f-4ff5-8c4f-8772d985127e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:02:18.812980 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-508451e3-314f-4ff5-8c4f-8772d985127e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:18.914055 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508451e3-314f-4ff5-8c4f-8772d985127e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:02:18.980226 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:18.988080 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705877a8-f878-4be3-8f4b-2c800340bba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:02:18.988725 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705877a8-f878-4be3-8f4b-2c800340bba9 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:18.989007 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705877a8-f878-4be3-8f4b-2c800340bba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:18.989281 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705877a8-f878-4be3-8f4b-2c800340bba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:18.991074 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-705877a8-f878-4be3-8f4b-2c800340bba9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:19.106714 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705877a8-f878-4be3-8f4b-2c800340bba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:02:19.108072 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705877a8-f878-4be3-8f4b-2c800340bba9 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:02:19.126053 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 731/1467] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:02:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:02:21.188503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eed3b9-b853-4979-8254-97b37a4a4745 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:21.189568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eed3b9-b853-4979-8254-97b37a4a4745 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:21.189568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eed3b9-b853-4979-8254-97b37a4a4745 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:21.190965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 12:02:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:02:21.197042 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eabfa6-a938-4007-9458-0c341b3ce2dd None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:21.197626 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eabfa6-a938-4007-9458-0c341b3ce2dd None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:21.197626 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eabfa6-a938-4007-9458-0c341b3ce2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:21.268878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-62eabfa6-a938-4007-9458-0c341b3ce2dd None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:02:21.270130 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-62eabfa6-a938-4007-9458-0c341b3ce2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:21.321142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:21.370821 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 12:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:02:21.407276 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eed3b9-b853-4979-8254-97b37a4a4745 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:02:21.408797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-00eed3b9-b853-4979-8254-97b37a4a4745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:21.521766 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eed3b9-b853-4979-8254-97b37a4a4745 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:02:21.569766 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:21.598868 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe496bf-2af7-40c0-a0cf-c94c0dfa5e70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:02:21.599525 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe496bf-2af7-40c0-a0cf-c94c0dfa5e70 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:21.599807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe496bf-2af7-40c0-a0cf-c94c0dfa5e70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:21.600087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe496bf-2af7-40c0-a0cf-c94c0dfa5e70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:21.601725 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0fe496bf-2af7-40c0-a0cf-c94c0dfa5e70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:21.718059 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe496bf-2af7-40c0-a0cf-c94c0dfa5e70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:02:21.719559 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe496bf-2af7-40c0-a0cf-c94c0dfa5e70 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:02:21.740577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 738/1470] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:02:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:02:31.368916 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=22 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:31.737679 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=66 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:41.548891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed412617-d377-4d3e-989e-5e8f64b19edc None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:41.549476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed412617-d377-4d3e-989e-5e8f64b19edc None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:41.549476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed412617-d377-4d3e-989e-5e8f64b19edc None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:41.550914 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 733/1471] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:02:41.556700 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657ccb8-3307-458b-97c9-3e01529edfd5 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:41.557250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657ccb8-3307-458b-97c9-3e01529edfd5 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:41.557250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657ccb8-3307-458b-97c9-3e01529edfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:41.632826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-5657ccb8-3307-458b-97c9-3e01529edfd5 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:02:41.634071 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5657ccb8-3307-458b-97c9-3e01529edfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:41.737654 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 739/1472] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:02:41.829985 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d4c48-9419-4584-8914-cbb726eaed93 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:41.830307 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d4c48-9419-4584-8914-cbb726eaed93 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:41.830566 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d4c48-9419-4584-8914-cbb726eaed93 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:41.832000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 734/1473] 10.222.0.79 () {54 vars in 962 bytes} [Thu Jul 14 12:02:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:02:41.837610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a40df-3faa-4fce-a302-d7431db7af63 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:41.837903 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a40df-3faa-4fce-a302-d7431db7af63 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:41.838177 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a40df-3faa-4fce-a302-d7431db7af63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:41.927787 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-1d4a40df-3faa-4fce-a302-d7431db7af63 None None] MFA Rules not processed for user `d6921990ec98492f8f4420f911208b84`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:02:41.929051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1d4a40df-3faa-4fce-a302-d7431db7af63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:41.954220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:42.014428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 740/1474] 10.222.0.79 () {58 vars in 1059 bytes} [Thu Jul 14 12:02:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:02:42.021775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d4c48-9419-4584-8914-cbb726eaed93 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:02:42.023376 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-bd3d4c48-9419-4584-8914-cbb726eaed93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:42.135483 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d4c48-9419-4584-8914-cbb726eaed93 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:02:42.208031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83d73a-7b29-4f7b-bc80-8737db3ba796 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6921990ec98492f8f4420f911208b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:02:42.208700 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83d73a-7b29-4f7b-bc80-8737db3ba796 service glance] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:42.208980 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83d73a-7b29-4f7b-bc80-8737db3ba796 service glance] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:42.209252 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83d73a-7b29-4f7b-bc80-8737db3ba796 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:42.210920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-8d83d73a-7b29-4f7b-bc80-8737db3ba796 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:42.270230 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:42.335573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83d73a-7b29-4f7b-bc80-8737db3ba796 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:02:42.337491 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83d73a-7b29-4f7b-bc80-8737db3ba796 service glance] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:02:42.358168 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 735/1475] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:02:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:02:44.550205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f7324-a971-4004-891e-f4919884a744 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:44.550847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f7324-a971-4004-891e-f4919884a744 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:44.550847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f7324-a971-4004-891e-f4919884a744 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:44.552233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 741/1476] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:02:44.557410 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dc818-8e4f-4fe5-9a4b-cac8600141bc None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:44.557829 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dc818-8e4f-4fe5-9a4b-cac8600141bc None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:44.557964 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dc818-8e4f-4fe5-9a4b-cac8600141bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:44.621055 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-a86dc818-8e4f-4fe5-9a4b-cac8600141bc None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:02:44.622262 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a86dc818-8e4f-4fe5-9a4b-cac8600141bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:44.716791 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 736/1477] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:02:44.740259 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f7324-a971-4004-891e-f4919884a744 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:02:44.741787 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-dd3f7324-a971-4004-891e-f4919884a744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:44.864511 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f7324-a971-4004-891e-f4919884a744 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:02:44.913202 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:44.960063 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73fa98-e96c-4b2a-8f11-92d1ddfbd728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:02:44.960727 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73fa98-e96c-4b2a-8f11-92d1ddfbd728 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:44.961012 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73fa98-e96c-4b2a-8f11-92d1ddfbd728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:44.961295 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73fa98-e96c-4b2a-8f11-92d1ddfbd728 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:44.962056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73fa98-e96c-4b2a-8f11-92d1ddfbd728 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:02:44.963823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: WARNING py.warnings [None req-fe73fa98-e96c-4b2a-8f11-92d1ddfbd728 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 12:02:44.963823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: warnings.warn(msg) Jul 14 12:02:44.963823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: Jul 14 12:02:44.964963 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73fa98-e96c-4b2a-8f11-92d1ddfbd728 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:02:44.984266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 742/1478] 10.222.0.79 () {56 vars in 1108 bytes} [Thu Jul 14 12:02:44 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:02:47.062595 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c879c57-b45d-49f3-9537-e7b851927214 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:47.063650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c879c57-b45d-49f3-9537-e7b851927214 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:47.063650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c879c57-b45d-49f3-9537-e7b851927214 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:47.065005 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 737/1479] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:02:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:02:47.070180 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cd061-697e-4eb4-b2bb-3b998a5e1a79 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:47.070674 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cd061-697e-4eb4-b2bb-3b998a5e1a79 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:47.070882 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cd061-697e-4eb4-b2bb-3b998a5e1a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:47.137478 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-0a1cd061-697e-4eb4-b2bb-3b998a5e1a79 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:02:47.138730 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0a1cd061-697e-4eb4-b2bb-3b998a5e1a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:47.243093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 743/1480] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:02:47.286864 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c879c57-b45d-49f3-9537-e7b851927214 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:02:47.288378 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-9c879c57-b45d-49f3-9537-e7b851927214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:47.299080 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:47.437595 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c879c57-b45d-49f3-9537-e7b851927214 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:02:47.523224 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:47.556248 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061de4c5-b8bf-4469-9930-2f95413825f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:02:47.556945 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061de4c5-b8bf-4469-9930-2f95413825f9 service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:47.557168 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061de4c5-b8bf-4469-9930-2f95413825f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:47.557440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061de4c5-b8bf-4469-9930-2f95413825f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:47.559097 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-061de4c5-b8bf-4469-9930-2f95413825f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:47.644375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061de4c5-b8bf-4469-9930-2f95413825f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:02:47.645949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061de4c5-b8bf-4469-9930-2f95413825f9 service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:02:47.664716 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 738/1481] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:02:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:02:49.885216 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07bbbe-c07c-42e3-b51b-cb6dc5874987 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:49.885776 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07bbbe-c07c-42e3-b51b-cb6dc5874987 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:49.885776 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07bbbe-c07c-42e3-b51b-cb6dc5874987 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:49.887214 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 744/1482] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:02:49.892356 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976f4c9-6bf9-4020-840f-a41207736d13 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:49.892819 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976f4c9-6bf9-4020-840f-a41207736d13 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:49.892940 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976f4c9-6bf9-4020-840f-a41207736d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:49.956653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-5976f4c9-6bf9-4020-840f-a41207736d13 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:02:49.957874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5976f4c9-6bf9-4020-840f-a41207736d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:50.003825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:50.053721 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 739/1483] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:02:50.089768 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07bbbe-c07c-42e3-b51b-cb6dc5874987 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:02:50.091375 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-fd07bbbe-c07c-42e3-b51b-cb6dc5874987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:50.115452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:50.197095 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07bbbe-c07c-42e3-b51b-cb6dc5874987 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:02:50.270327 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cecc14-0794-423d-83e5-8f85b8497934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:02:50.270921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cecc14-0794-423d-83e5-8f85b8497934 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:50.271209 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cecc14-0794-423d-83e5-8f85b8497934 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:50.271482 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cecc14-0794-423d-83e5-8f85b8497934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:50.273110 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-92cecc14-0794-423d-83e5-8f85b8497934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:50.345566 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:50.380414 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cecc14-0794-423d-83e5-8f85b8497934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:02:50.381850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cecc14-0794-423d-83e5-8f85b8497934 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:02:50.399965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 745/1484] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:02:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:02:52.506963 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92bdd6-45f0-409d-bdf6-22195546f072 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:52.507524 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92bdd6-45f0-409d-bdf6-22195546f072 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:52.507524 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92bdd6-45f0-409d-bdf6-22195546f072 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:52.508931 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 740/1485] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:02:52.514311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686f6af-4ead-4a6f-aeea-96869b951e67 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:52.514788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686f6af-4ead-4a6f-aeea-96869b951e67 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:52.514922 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686f6af-4ead-4a6f-aeea-96869b951e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:52.581816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-8686f6af-4ead-4a6f-aeea-96869b951e67 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:02:52.583078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8686f6af-4ead-4a6f-aeea-96869b951e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:52.683162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 746/1486] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:02:52.722345 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92bdd6-45f0-409d-bdf6-22195546f072 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:02:52.724116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-6d92bdd6-45f0-409d-bdf6-22195546f072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:52.845774 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92bdd6-45f0-409d-bdf6-22195546f072 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:02:52.922463 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:52.924693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e484d-d57d-4acb-b2a3-4f7b94ce2ec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:02:52.925599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e484d-d57d-4acb-b2a3-4f7b94ce2ec1 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:52.926305 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e484d-d57d-4acb-b2a3-4f7b94ce2ec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:52.926798 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e484d-d57d-4acb-b2a3-4f7b94ce2ec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:52.929029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-585e484d-d57d-4acb-b2a3-4f7b94ce2ec1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:53.046208 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e484d-d57d-4acb-b2a3-4f7b94ce2ec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:02:53.048175 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e484d-d57d-4acb-b2a3-4f7b94ce2ec1 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:02:53.068833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 741/1487] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:02:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:02:55.243620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40041cb0-9916-4d65-ab96-6ef31263341b None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:55.244229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40041cb0-9916-4d65-ab96-6ef31263341b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:55.244229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40041cb0-9916-4d65-ab96-6ef31263341b None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:55.245559 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 747/1488] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:02:55.250966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e58971-e166-462f-9f77-063dade33486 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:55.251424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e58971-e166-462f-9f77-063dade33486 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:55.251537 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e58971-e166-462f-9f77-063dade33486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:55.313834 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-52e58971-e166-462f-9f77-063dade33486 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:02:55.315057 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-52e58971-e166-462f-9f77-063dade33486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:55.365756 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:55.409466 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 742/1489] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:02:55.451128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40041cb0-9916-4d65-ab96-6ef31263341b None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:02:55.452793 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-40041cb0-9916-4d65-ab96-6ef31263341b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:55.490821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:55.557968 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40041cb0-9916-4d65-ab96-6ef31263341b None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:02:55.631041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4c99a-62f9-4499-bd54-f3ebcdb6bb30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:02:55.631684 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4c99a-62f9-4499-bd54-f3ebcdb6bb30 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:55.631972 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4c99a-62f9-4499-bd54-f3ebcdb6bb30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:55.632241 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4c99a-62f9-4499-bd54-f3ebcdb6bb30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:55.633862 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f8e4c99a-62f9-4499-bd54-f3ebcdb6bb30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:55.713216 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:55.742548 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e4c99a-62f9-4499-bd54-f3ebcdb6bb30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:02:55.743994 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e4c99a-62f9-4499-bd54-f3ebcdb6bb30 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:02:55.767534 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 748/1490] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:02:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:02:58.040396 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644274f-c68c-44fb-b044-396e4fb9e4a0 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:58.040938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644274f-c68c-44fb-b044-396e4fb9e4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:58.040938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644274f-c68c-44fb-b044-396e4fb9e4a0 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:58.042331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 743/1491] 10.222.0.79 () {54 vars in 926 bytes} [Thu Jul 14 12:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:02:58.048068 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6a52f-240e-46af-9b38-8202e8cddaa1 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:58.048495 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6a52f-240e-46af-9b38-8202e8cddaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:58.048633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6a52f-240e-46af-9b38-8202e8cddaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:58.113525 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e7e6a52f-240e-46af-9b38-8202e8cddaa1 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:02:58.114760 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e7e6a52f-240e-46af-9b38-8202e8cddaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:58.215196 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 749/1492] 10.222.0.79 () {58 vars in 1023 bytes} [Thu Jul 14 12:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:02:58.253702 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644274f-c68c-44fb-b044-396e4fb9e4a0 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:02:58.255280 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-3644274f-c68c-44fb-b044-396e4fb9e4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:58.356771 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644274f-c68c-44fb-b044-396e4fb9e4a0 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:02:58.428844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8f467-3c5e-4013-872b-80e973152dec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:02:58.429487 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8f467-3c5e-4013-872b-80e973152dec service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:02:58.429770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8f467-3c5e-4013-872b-80e973152dec service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:02:58.430051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8f467-3c5e-4013-872b-80e973152dec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:02:58.431763 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-49f8f467-3c5e-4013-872b-80e973152dec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:02:58.441445 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:02:58.543376 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8f467-3c5e-4013-872b-80e973152dec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:02:58.544819 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8f467-3c5e-4013-872b-80e973152dec service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:02:58.562882 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 744/1493] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:02:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:03:08.213378 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=82 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:03:08.560146 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=50 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:04:38.371434 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d2f5c-f0fe-4cc6-a26f-d320d763c428 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:04:38.372042 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d2f5c-f0fe-4cc6-a26f-d320d763c428 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:04:38.372042 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d2f5c-f0fe-4cc6-a26f-d320d763c428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:04:38.451383 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-8c8d2f5c-f0fe-4cc6-a26f-d320d763c428 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:04:38.452615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8c8d2f5c-f0fe-4cc6-a26f-d320d763c428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:04:38.553121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 750/1494] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:04:38.561783 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af351225-8611-4ea4-8fcb-365dda5cec86 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:04:38.562298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af351225-8611-4ea4-8fcb-365dda5cec86 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:04:38.562408 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af351225-8611-4ea4-8fcb-365dda5cec86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:04:38.635577 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-af351225-8611-4ea4-8fcb-365dda5cec86 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:04:38.636922 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-af351225-8611-4ea4-8fcb-365dda5cec86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:04:38.732994 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 745/1495] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:04:38.737675 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d2f5c-f0fe-4cc6-a26f-d320d763c428 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:04:38.738918 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8c8d2f5c-f0fe-4cc6-a26f-d320d763c428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:04:38.750581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d2f5c-f0fe-4cc6-a26f-d320d763c428 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:04:38.811809 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:04:38.847752 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be6f58-6a50-4265-a247-74393acbed47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:04:38.848340 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be6f58-6a50-4265-a247-74393acbed47 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:04:38.848622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be6f58-6a50-4265-a247-74393acbed47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:04:38.848894 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be6f58-6a50-4265-a247-74393acbed47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:04:38.849615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be6f58-6a50-4265-a247-74393acbed47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:04:38.850103 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be6f58-6a50-4265-a247-74393acbed47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:04:38.850960 dv-cinder-848900-3-smb devstack@keystone.service[80164]: WARNING py.warnings [None req-08be6f58-6a50-4265-a247-74393acbed47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 12:04:38.850960 dv-cinder-848900-3-smb devstack@keystone.service[80164]: warnings.warn(msg) Jul 14 12:04:38.850960 dv-cinder-848900-3-smb devstack@keystone.service[80164]: Jul 14 12:04:38.851893 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be6f58-6a50-4265-a247-74393acbed47 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:04:38.863067 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 751/1496] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:04:38.871545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af351225-8611-4ea4-8fcb-365dda5cec86 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:04:38.881436 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af351225-8611-4ea4-8fcb-365dda5cec86 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:04:38.942527 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:04:38.976921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c02c41-fe81-434a-a786-a93963d105fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:04:38.977579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c02c41-fe81-434a-a786-a93963d105fc admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:04:38.977863 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c02c41-fe81-434a-a786-a93963d105fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:04:38.978140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c02c41-fe81-434a-a786-a93963d105fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:04:38.978869 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c02c41-fe81-434a-a786-a93963d105fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:04:38.980600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: WARNING py.warnings [None req-38c02c41-fe81-434a-a786-a93963d105fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 12:04:38.980600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: warnings.warn(msg) Jul 14 12:04:38.980600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: Jul 14 12:04:38.981801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c02c41-fe81-434a-a786-a93963d105fc admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:04:39.036109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 746/1497] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:04:38 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:04:39.040827 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be6f58-6a50-4265-a247-74393acbed47 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:04:39.042369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-08be6f58-6a50-4265-a247-74393acbed47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:04:39.077616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be6f58-6a50-4265-a247-74393acbed47 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:04:39.169120 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f16685-6c2d-46e4-992b-588c6d549ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:04:39.169823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f16685-6c2d-46e4-992b-588c6d549ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:04:39.170102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f16685-6c2d-46e4-992b-588c6d549ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:04:39.170374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f16685-6c2d-46e4-992b-588c6d549ce3 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:04:39.171345 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f16685-6c2d-46e4-992b-588c6d549ce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:04:39.172341 dv-cinder-848900-3-smb devstack@keystone.service[80164]: WARNING py.warnings [None req-e5f16685-6c2d-46e4-992b-588c6d549ce3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 12:04:39.172341 dv-cinder-848900-3-smb devstack@keystone.service[80164]: warnings.warn(msg) Jul 14 12:04:39.172341 dv-cinder-848900-3-smb devstack@keystone.service[80164]: Jul 14 12:04:39.173539 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f16685-6c2d-46e4-992b-588c6d549ce3 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:04:39.215347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 752/1498] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:04:39 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:04:39.219433 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c02c41-fe81-434a-a786-a93963d105fc admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:04:39.221001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-38c02c41-fe81-434a-a786-a93963d105fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:04:39.282502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c02c41-fe81-434a-a786-a93963d105fc admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:04:39.363793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:04:39.375674 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4a13c-50e4-4ced-820d-0f584e5405af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:04:39.376342 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4a13c-50e4-4ced-820d-0f584e5405af admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:04:39.376621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4a13c-50e4-4ced-820d-0f584e5405af admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:04:39.376894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4a13c-50e4-4ced-820d-0f584e5405af admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:04:39.377615 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4a13c-50e4-4ced-820d-0f584e5405af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:04:39.378660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: WARNING py.warnings [None req-6bb4a13c-50e4-4ced-820d-0f584e5405af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 12:04:39.378660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: warnings.warn(msg) Jul 14 12:04:39.378660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: Jul 14 12:04:39.379547 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4a13c-50e4-4ced-820d-0f584e5405af admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:04:39.391643 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 747/1499] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:04:39.395871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f16685-6c2d-46e4-992b-588c6d549ce3 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:04:39.397389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e5f16685-6c2d-46e4-992b-588c6d549ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:04:39.408811 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f16685-6c2d-46e4-992b-588c6d549ce3 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:04:39.434151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:04:39.509226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272e3ef-b6a0-455c-866c-024699a6884b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:04:39.509810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272e3ef-b6a0-455c-866c-024699a6884b admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:04:39.510093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272e3ef-b6a0-455c-866c-024699a6884b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:04:39.510368 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272e3ef-b6a0-455c-866c-024699a6884b admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:04:39.511127 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272e3ef-b6a0-455c-866c-024699a6884b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:04:39.512129 dv-cinder-848900-3-smb devstack@keystone.service[80164]: WARNING py.warnings [None req-6272e3ef-b6a0-455c-866c-024699a6884b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 12:04:39.512129 dv-cinder-848900-3-smb devstack@keystone.service[80164]: warnings.warn(msg) Jul 14 12:04:39.512129 dv-cinder-848900-3-smb devstack@keystone.service[80164]: Jul 14 12:04:39.513014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272e3ef-b6a0-455c-866c-024699a6884b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:04:39.525932 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 753/1500] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:04:39.530970 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4a13c-50e4-4ced-820d-0f584e5405af admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:04:39.532476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-6bb4a13c-50e4-4ced-820d-0f584e5405af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:04:39.564998 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4a13c-50e4-4ced-820d-0f584e5405af admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:04:39.656234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3debe0-b578-48ef-857f-ccec4b8aceb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:04:39.657109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3debe0-b578-48ef-857f-ccec4b8aceb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:04:39.657393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3debe0-b578-48ef-857f-ccec4b8aceb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:04:39.657665 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3debe0-b578-48ef-857f-ccec4b8aceb4 admin admin] PATH_INFO: `/v3/projects/70126f0c7c714490bc43d9c8377854df/users/6505fe96ca2e441fbf65d0106598c6d8/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:04:39.679372 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3debe0-b578-48ef-857f-ccec4b8aceb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70126f0c7c714490bc43d9c8377854df, user_id=6505fe96ca2e441fbf65d0106598c6d8, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:04:39.680474 dv-cinder-848900-3-smb devstack@keystone.service[80165]: WARNING py.warnings [None req-8d3debe0-b578-48ef-857f-ccec4b8aceb4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 12:04:39.680474 dv-cinder-848900-3-smb devstack@keystone.service[80165]: warnings.warn(msg) Jul 14 12:04:39.680474 dv-cinder-848900-3-smb devstack@keystone.service[80165]: Jul 14 12:04:39.682405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3debe0-b578-48ef-857f-ccec4b8aceb4 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:04:39.707106 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 748/1501] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:04:39 2022] PUT /identity/v3/projects/70126f0c7c714490bc43d9c8377854df/users/6505fe96ca2e441fbf65d0106598c6d8/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:04:39.719369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f578481-950b-4c0c-ad22-cb4f1757ee7f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:04:39.719661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f578481-950b-4c0c-ad22-cb4f1757ee7f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:04:39.719972 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f578481-950b-4c0c-ad22-cb4f1757ee7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:04:39.778663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-5f578481-950b-4c0c-ad22-cb4f1757ee7f None None] MFA Rules not processed for user `6505fe96ca2e441fbf65d0106598c6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:04:39.779799 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5f578481-950b-4c0c-ad22-cb4f1757ee7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:04:39.859158 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 754/1502] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:04:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:04:39.872251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11468e5-5f71-49de-85b4-3fe00a0bd360 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:04:39.873051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11468e5-5f71-49de-85b4-3fe00a0bd360 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:04:39.873334 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11468e5-5f71-49de-85b4-3fe00a0bd360 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:04:39.874810 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 749/1503] 10.222.0.79 () {54 vars in 963 bytes} [Thu Jul 14 12:04:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:04:39.879717 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc3eb4-ea6c-400e-ab28-7affef3f9fff None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:04:39.880012 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc3eb4-ea6c-400e-ab28-7affef3f9fff None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:04:39.880304 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc3eb4-ea6c-400e-ab28-7affef3f9fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:04:39.909751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:04:39.955115 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e1bc3eb4-ea6c-400e-ab28-7affef3f9fff None None] MFA Rules not processed for user `7deede571e7d42408c2fb86665eccfe7`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:04:39.956335 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e1bc3eb4-ea6c-400e-ab28-7affef3f9fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:04:40.032881 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 755/1504] 10.222.0.79 () {58 vars in 1060 bytes} [Thu Jul 14 12:04:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:04:40.040476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11468e5-5f71-49de-85b4-3fe00a0bd360 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:04:40.041996 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a11468e5-5f71-49de-85b4-3fe00a0bd360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:04:40.091121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:04:40.144489 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11468e5-5f71-49de-85b4-3fe00a0bd360 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:04:40.217073 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead08180-9baf-49fa-b456-f5f582925204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:04:40.217851 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead08180-9baf-49fa-b456-f5f582925204 service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:04:40.218137 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead08180-9baf-49fa-b456-f5f582925204 service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:04:40.218412 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead08180-9baf-49fa-b456-f5f582925204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:04:40.220074 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ead08180-9baf-49fa-b456-f5f582925204 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:04:40.319599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead08180-9baf-49fa-b456-f5f582925204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:04:40.320955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead08180-9baf-49fa-b456-f5f582925204 service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:04:40.324448 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:04:40.338925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 750/1505] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:04:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:04:40.381163 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebddeb-6d11-4d83-8076-058ec5c451d2 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:04:40.381453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebddeb-6d11-4d83-8076-058ec5c451d2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:04:40.381731 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebddeb-6d11-4d83-8076-058ec5c451d2 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:04:40.383054 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 756/1506] 10.222.0.79 () {52 vars in 829 bytes} [Thu Jul 14 12:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:04:40.386646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead08180-9baf-49fa-b456-f5f582925204 service cinder] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:04:40.387857 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ead08180-9baf-49fa-b456-f5f582925204 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:04:40.486125 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead08180-9baf-49fa-b456-f5f582925204 service cinder] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:04:40.577210 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b626459-d2ed-4618-8659-05630957d0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:04:40.577997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b626459-d2ed-4618-8659-05630957d0a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:04:40.578275 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b626459-d2ed-4618-8659-05630957d0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:04:40.578573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b626459-d2ed-4618-8659-05630957d0a4 admin admin] PATH_INFO: `/v3/users/6505fe96ca2e441fbf65d0106598c6d8` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:04:40.590405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b626459-d2ed-4618-8659-05630957d0a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6505fe96ca2e441fbf65d0106598c6d8)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:04:40.591950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: WARNING py.warnings [None req-2b626459-d2ed-4618-8659-05630957d0a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 12:04:40.591950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: warnings.warn(msg) Jul 14 12:04:40.591950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: Jul 14 12:04:40.593145 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b626459-d2ed-4618-8659-05630957d0a4 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:04:40.602798 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:04:40.657020 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2b626459-d2ed-4618-8659-05630957d0a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6505fe96ca2e441fbf65d0106598c6d8'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:04:40.668014 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2b626459-d2ed-4618-8659-05630957d0a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6505fe96ca2e441fbf65d0106598c6d8'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:04:40.668449 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2b626459-d2ed-4618-8659-05630957d0a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6505fe96ca2e441fbf65d0106598c6d8'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:04:40.687306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2b626459-d2ed-4618-8659-05630957d0a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6505fe96ca2e441fbf65d0106598c6d8'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:04:40.687877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2b626459-d2ed-4618-8659-05630957d0a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6505fe96ca2e441fbf65d0106598c6d8'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:04:40.706745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 751/1507] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:04:40 2022] DELETE /identity/v3/users/6505fe96ca2e441fbf65d0106598c6d8 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:04:40.711188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b833d-0fa1-4fe8-84d5-de00c986f46a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:04:40.711667 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b833d-0fa1-4fe8-84d5-de00c986f46a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:04:40.711775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b833d-0fa1-4fe8-84d5-de00c986f46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:04:40.768240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e94b833d-0fa1-4fe8-84d5-de00c986f46a None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:04:40.769465 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e94b833d-0fa1-4fe8-84d5-de00c986f46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:04:40.843220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:04:40.856707 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 757/1508] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:04:40.866258 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b626459-d2ed-4618-8659-05630957d0a4 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:04:40.867529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-2b626459-d2ed-4618-8659-05630957d0a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:04:40.972421 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b626459-d2ed-4618-8659-05630957d0a4 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:04:41.025581 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:04:41.047252 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d1497-3552-45cd-be00-dd1175cde898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:04:41.047903 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d1497-3552-45cd-be00-dd1175cde898 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:04:41.048182 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d1497-3552-45cd-be00-dd1175cde898 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:04:41.048453 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d1497-3552-45cd-be00-dd1175cde898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:04:41.050105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-7d6d1497-3552-45cd-be00-dd1175cde898 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:04:41.157882 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d1497-3552-45cd-be00-dd1175cde898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:04:41.159298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d1497-3552-45cd-be00-dd1175cde898 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:04:41.177993 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 752/1509] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:04:41.528983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b833d-0fa1-4fe8-84d5-de00c986f46a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:04:41.530257 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e94b833d-0fa1-4fe8-84d5-de00c986f46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:04:41.542198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b833d-0fa1-4fe8-84d5-de00c986f46a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:04:41.637403 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bb243-9326-495a-af4b-6f9459538f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:04:41.638296 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bb243-9326-495a-af4b-6f9459538f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:04:41.638607 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bb243-9326-495a-af4b-6f9459538f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:04:41.638884 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bb243-9326-495a-af4b-6f9459538f16 admin admin] PATH_INFO: `/v3/projects/70126f0c7c714490bc43d9c8377854df` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:04:41.648646 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bb243-9326-495a-af4b-6f9459538f16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70126f0c7c714490bc43d9c8377854df)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:04:41.649663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: WARNING py.warnings [None req-1f1bb243-9326-495a-af4b-6f9459538f16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 12:04:41.649663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: warnings.warn(msg) Jul 14 12:04:41.649663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: Jul 14 12:04:41.650900 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bb243-9326-495a-af4b-6f9459538f16 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:04:41.709084 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1f1bb243-9326-495a-af4b-6f9459538f16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70126f0c7c714490bc43d9c8377854df', 'request_id': 'req-1f1bb243-9326-495a-af4b-6f9459538f16'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:04:41.721978 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1f1bb243-9326-495a-af4b-6f9459538f16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70126f0c7c714490bc43d9c8377854df', 'request_id': 'req-1f1bb243-9326-495a-af4b-6f9459538f16'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:04:41.728188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1f1bb243-9326-495a-af4b-6f9459538f16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70126f0c7c714490bc43d9c8377854df', 'request_id': 'req-1f1bb243-9326-495a-af4b-6f9459538f16'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:04:41.756361 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1f1bb243-9326-495a-af4b-6f9459538f16 admin admin] The token cache is being invalidate because project 70126f0c7c714490bc43d9c8377854df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:04:41.756655 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1f1bb243-9326-495a-af4b-6f9459538f16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:04:41.757199 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1f1bb243-9326-495a-af4b-6f9459538f16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:04:41.758587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 758/1510] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:04:41 2022] DELETE /identity/v3/projects/70126f0c7c714490bc43d9c8377854df => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:04:51.175764 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=62 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:04:51.754285 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:06:27.988210 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3a366-be48-4e5f-8867-41d1df9ff2a6 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:27.988839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3a366-be48-4e5f-8867-41d1df9ff2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:27.988839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3a366-be48-4e5f-8867-41d1df9ff2a6 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:27.990217 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 12:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:06:27.995128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ac08b-b6ea-45b2-923c-3e57393129ba None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:27.995537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ac08b-b6ea-45b2-923c-3e57393129ba None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:27.995640 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ac08b-b6ea-45b2-923c-3e57393129ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:28.075052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-da8ac08b-b6ea-45b2-923c-3e57393129ba None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:06:28.076278 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-da8ac08b-b6ea-45b2-923c-3e57393129ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:06:28.177861 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 12:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:06:28.329553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3a366-be48-4e5f-8867-41d1df9ff2a6 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:06:28.331693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-f5f3a366-be48-4e5f-8867-41d1df9ff2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:06:28.449340 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3a366-be48-4e5f-8867-41d1df9ff2a6 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:06:28.454839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbb9fa-7f53-4df2-89f4-b1c86f7e746a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:06:28.455489 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbb9fa-7f53-4df2-89f4-b1c86f7e746a service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:28.455777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbb9fa-7f53-4df2-89f4-b1c86f7e746a service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:28.456059 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbb9fa-7f53-4df2-89f4-b1c86f7e746a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:28.464911 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbb9fa-7f53-4df2-89f4-b1c86f7e746a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:06:28.467069 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbb9fa-7f53-4df2-89f4-b1c86f7e746a service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:06:28.477522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 754/1513] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:06:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:06:29.304869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2370e-facc-4d14-8af5-3be005cd4382 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:29.305555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2370e-facc-4d14-8af5-3be005cd4382 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:29.305555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2370e-facc-4d14-8af5-3be005cd4382 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:29.306840 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 12:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:06:29.312185 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c1927-ec8f-4f82-820b-3337f8558308 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:29.312624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c1927-ec8f-4f82-820b-3337f8558308 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:29.312731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c1927-ec8f-4f82-820b-3337f8558308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:29.330941 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-669c1927-ec8f-4f82-820b-3337f8558308 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:06:29.332139 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-669c1927-ec8f-4f82-820b-3337f8558308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:06:29.339790 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 12:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:06:29.500698 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2370e-facc-4d14-8af5-3be005cd4382 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:06:29.516196 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2370e-facc-4d14-8af5-3be005cd4382 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:06:29.522167 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16162758-a47c-4f1e-bf9d-f4902b49a1ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:06:29.522858 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16162758-a47c-4f1e-bf9d-f4902b49a1ad service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:29.523141 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16162758-a47c-4f1e-bf9d-f4902b49a1ad service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:29.523425 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16162758-a47c-4f1e-bf9d-f4902b49a1ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:29.532756 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16162758-a47c-4f1e-bf9d-f4902b49a1ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:06:29.534419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16162758-a47c-4f1e-bf9d-f4902b49a1ad service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:06:29.545642 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 761/1516] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:06:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:06:29.855647 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ba0e3-b25a-4cf8-aff1-6d0d95031fcc None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:29.855953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ba0e3-b25a-4cf8-aff1-6d0d95031fcc None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:29.856202 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ba0e3-b25a-4cf8-aff1-6d0d95031fcc None None] PATH_INFO: `/v3` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:29.858530 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 756/1517] 10.222.0.61 () {54 vars in 925 bytes} [Thu Jul 14 12:06:29 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:06:29.864456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10d547-ae9f-4827-9714-e732ab381ff3 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:29.864820 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10d547-ae9f-4827-9714-e732ab381ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:29.865171 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10d547-ae9f-4827-9714-e732ab381ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:29.924214 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-bc10d547-ae9f-4827-9714-e732ab381ff3 None None] MFA Rules not processed for user `d6070c6b901f4e2ebe621a3e42dd2d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:06:29.925496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-bc10d547-ae9f-4827-9714-e732ab381ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:06:29.942195 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:06:30.004695 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 762/1518] 10.222.0.61 () {58 vars in 1015 bytes} [Thu Jul 14 12:06:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:06:39.325696 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=56 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:06:40.001321 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=23 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:06:40.243433 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521bbed-95a9-4cbc-a725-3398c7b32f6b None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:40.243753 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521bbed-95a9-4cbc-a725-3398c7b32f6b None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:40.244041 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521bbed-95a9-4cbc-a725-3398c7b32f6b None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:40.245428 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 757/1519] 10.222.0.79 () {54 vars in 960 bytes} [Thu Jul 14 12:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:06:40.250753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d99ae-333e-4acf-9ce0-c242b231ad6b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:40.251054 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d99ae-333e-4acf-9ce0-c242b231ad6b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:40.251390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d99ae-333e-4acf-9ce0-c242b231ad6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:40.269782 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ff5d99ae-333e-4acf-9ce0-c242b231ad6b None None] MFA Rules not processed for user `d6070c6b901f4e2ebe621a3e42dd2d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:06:40.271117 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ff5d99ae-333e-4acf-9ce0-c242b231ad6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:06:40.280848 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 763/1520] 10.222.0.79 () {58 vars in 1057 bytes} [Thu Jul 14 12:06:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:06:40.288298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521bbed-95a9-4cbc-a725-3398c7b32f6b None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:06:40.302215 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521bbed-95a9-4cbc-a725-3398c7b32f6b None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:06:40.307288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92875da-6318-4c31-8aa2-0f86e5d6b53f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6070c6b901f4e2ebe621a3e42dd2d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:06:40.307922 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92875da-6318-4c31-8aa2-0f86e5d6b53f service placement] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:40.308240 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92875da-6318-4c31-8aa2-0f86e5d6b53f service placement] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:40.308525 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92875da-6318-4c31-8aa2-0f86e5d6b53f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:40.317278 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92875da-6318-4c31-8aa2-0f86e5d6b53f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:06:40.318902 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92875da-6318-4c31-8aa2-0f86e5d6b53f service placement] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:06:40.329404 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 758/1521] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:06:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:06:40.788863 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ae91d-7a60-4d03-8ead-3cc5dcff18ec None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:40.789152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ae91d-7a60-4d03-8ead-3cc5dcff18ec None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:40.789435 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ae91d-7a60-4d03-8ead-3cc5dcff18ec None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:40.790900 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 12:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:06:40.796872 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296b04f-5474-4b12-aae4-aa460f05a4f4 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:40.797163 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296b04f-5474-4b12-aae4-aa460f05a4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:40.797443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296b04f-5474-4b12-aae4-aa460f05a4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:40.814928 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-1296b04f-5474-4b12-aae4-aa460f05a4f4 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:06:40.816117 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-1296b04f-5474-4b12-aae4-aa460f05a4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:06:40.823794 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 12:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:06:40.984461 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ae91d-7a60-4d03-8ead-3cc5dcff18ec None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:06:40.999870 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ae91d-7a60-4d03-8ead-3cc5dcff18ec None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:06:41.005447 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a7c51-8fbc-481d-874c-0f8b8f123a0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:06:41.006097 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a7c51-8fbc-481d-874c-0f8b8f123a0c service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:41.006390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a7c51-8fbc-481d-874c-0f8b8f123a0c service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:41.006691 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a7c51-8fbc-481d-874c-0f8b8f123a0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:41.015659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a7c51-8fbc-481d-874c-0f8b8f123a0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:06:41.017235 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a7c51-8fbc-481d-874c-0f8b8f123a0c service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:06:41.027492 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 765/1524] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:06:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:06:41.856870 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1d7d3-848f-4d69-b93a-14c4e14b7bcc None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:41.857432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1d7d3-848f-4d69-b93a-14c4e14b7bcc None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:41.857432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1d7d3-848f-4d69-b93a-14c4e14b7bcc None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:41.858862 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 12:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:06:41.863747 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84f817-02c0-4a71-8349-a6d7e3ddd03c None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:41.864042 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84f817-02c0-4a71-8349-a6d7e3ddd03c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:41.864325 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84f817-02c0-4a71-8349-a6d7e3ddd03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:41.883089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-7e84f817-02c0-4a71-8349-a6d7e3ddd03c None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:06:41.884312 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7e84f817-02c0-4a71-8349-a6d7e3ddd03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:06:41.892855 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 12:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:06:42.045240 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1d7d3-848f-4d69-b93a-14c4e14b7bcc None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:06:42.059931 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1d7d3-848f-4d69-b93a-14c4e14b7bcc None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:06:42.065902 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8821e-f6b2-46f0-a966-5386e6fd2313 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:06:42.066563 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8821e-f6b2-46f0-a966-5386e6fd2313 service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:42.066852 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8821e-f6b2-46f0-a966-5386e6fd2313 service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:42.067132 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8821e-f6b2-46f0-a966-5386e6fd2313 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:42.075389 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8821e-f6b2-46f0-a966-5386e6fd2313 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:06:42.077619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8821e-f6b2-46f0-a966-5386e6fd2313 service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:06:42.087034 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 761/1527] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:06:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:06:46.096101 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925f852-52b8-490b-bb1a-59becdb06daf None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:46.096636 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925f852-52b8-490b-bb1a-59becdb06daf None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:46.096636 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925f852-52b8-490b-bb1a-59becdb06daf None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:46.097947 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 12:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:06:46.103482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291d4c2-33cc-4799-b629-2aafa9785e8f None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:46.103955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291d4c2-33cc-4799-b629-2aafa9785e8f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:46.104058 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291d4c2-33cc-4799-b629-2aafa9785e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:46.123735 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-6291d4c2-33cc-4799-b629-2aafa9785e8f None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:06:46.124981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-6291d4c2-33cc-4799-b629-2aafa9785e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:06:46.133414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 12:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:06:46.209034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925f852-52b8-490b-bb1a-59becdb06daf None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:06:46.210800 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4925f852-52b8-490b-bb1a-59becdb06daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:06:46.291222 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925f852-52b8-490b-bb1a-59becdb06daf None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:06:46.296036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf7543-6321-4eb2-b82d-2e0d45e80355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:06:46.296697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf7543-6321-4eb2-b82d-2e0d45e80355 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:46.296983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf7543-6321-4eb2-b82d-2e0d45e80355 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:46.297261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf7543-6321-4eb2-b82d-2e0d45e80355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:46.306648 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf7543-6321-4eb2-b82d-2e0d45e80355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:06:46.308076 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf7543-6321-4eb2-b82d-2e0d45e80355 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:06:46.317402 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 768/1530] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:06:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:06:48.322844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b3004-4f22-4756-b41d-5b51986cd9f0 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:48.323377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b3004-4f22-4756-b41d-5b51986cd9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:48.323509 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b3004-4f22-4756-b41d-5b51986cd9f0 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:48.324797 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 12:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:06:48.329919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12a64b-5408-4502-808a-78cb52218900 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:48.330332 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12a64b-5408-4502-808a-78cb52218900 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:48.330483 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12a64b-5408-4502-808a-78cb52218900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:48.348121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ab12a64b-5408-4502-808a-78cb52218900 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:06:48.349254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ab12a64b-5408-4502-808a-78cb52218900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:06:48.357459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 12:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:06:48.393257 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b3004-4f22-4756-b41d-5b51986cd9f0 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:06:48.403911 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b3004-4f22-4756-b41d-5b51986cd9f0 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:06:48.407411 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89041a-a9fe-4a01-b238-acdc24e71edb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:06:48.408051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89041a-a9fe-4a01-b238-acdc24e71edb service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:48.408335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89041a-a9fe-4a01-b238-acdc24e71edb service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:48.408613 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89041a-a9fe-4a01-b238-acdc24e71edb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:48.417417 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89041a-a9fe-4a01-b238-acdc24e71edb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:06:48.418913 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89041a-a9fe-4a01-b238-acdc24e71edb service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:06:48.429087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 764/1533] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:06:52.309143 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c9024-c7f3-4cbe-aba9-0ab4da727058 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:52.309705 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c9024-c7f3-4cbe-aba9-0ab4da727058 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:52.309705 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c9024-c7f3-4cbe-aba9-0ab4da727058 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:52.311669 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 12:06:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:06:52.316795 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3424fd-2189-4f32-9920-ae5668ae38a5 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:52.317236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3424fd-2189-4f32-9920-ae5668ae38a5 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:52.317345 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3424fd-2189-4f32-9920-ae5668ae38a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:52.335443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-7b3424fd-2189-4f32-9920-ae5668ae38a5 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:06:52.336636 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-7b3424fd-2189-4f32-9920-ae5668ae38a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:06:52.344419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 12:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:06:52.645283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c9024-c7f3-4cbe-aba9-0ab4da727058 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:06:52.647012 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-223c9024-c7f3-4cbe-aba9-0ab4da727058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:06:52.725459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c9024-c7f3-4cbe-aba9-0ab4da727058 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:06:52.729074 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852ee01-bb7c-4c77-bd24-7ba7ce90fad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:06:52.729734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852ee01-bb7c-4c77-bd24-7ba7ce90fad0 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:52.730021 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852ee01-bb7c-4c77-bd24-7ba7ce90fad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:52.730300 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852ee01-bb7c-4c77-bd24-7ba7ce90fad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:52.740455 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852ee01-bb7c-4c77-bd24-7ba7ce90fad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:06:52.742019 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852ee01-bb7c-4c77-bd24-7ba7ce90fad0 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:06:52.752201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 771/1536] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:06:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:06:54.792847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ec29c-648b-4d97-9bf9-5c888c5c7b0f None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:54.793389 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ec29c-648b-4d97-9bf9-5c888c5c7b0f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:54.793389 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ec29c-648b-4d97-9bf9-5c888c5c7b0f None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:54.795090 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 12:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:06:54.800188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138a4d3-1bf5-4a14-93c2-b11c8cd1e8a3 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:54.800624 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138a4d3-1bf5-4a14-93c2-b11c8cd1e8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:54.800732 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138a4d3-1bf5-4a14-93c2-b11c8cd1e8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:54.818938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-8138a4d3-1bf5-4a14-93c2-b11c8cd1e8a3 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:06:54.820172 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8138a4d3-1bf5-4a14-93c2-b11c8cd1e8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:06:54.828842 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 12:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:06:55.131600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ec29c-648b-4d97-9bf9-5c888c5c7b0f None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:06:55.133374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-d68ec29c-648b-4d97-9bf9-5c888c5c7b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:06:55.146775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ec29c-648b-4d97-9bf9-5c888c5c7b0f None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:06:55.150296 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4b113-9a41-48d7-98ff-0390c94d0daa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:06:55.150968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4b113-9a41-48d7-98ff-0390c94d0daa service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:06:55.151257 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4b113-9a41-48d7-98ff-0390c94d0daa service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:06:55.151561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4b113-9a41-48d7-98ff-0390c94d0daa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:06:55.161048 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4b113-9a41-48d7-98ff-0390c94d0daa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:06:55.162480 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4b113-9a41-48d7-98ff-0390c94d0daa service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:06:55.172219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 767/1539] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:06:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:07:04.813746 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=88 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:07:05.167871 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=33 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:29.035166 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2ec01-d6c8-42be-9110-ed6712efc809 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.035811 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2ec01-d6c8-42be-9110-ed6712efc809 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.035811 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2ec01-d6c8-42be-9110-ed6712efc809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.065025 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-c4f2ec01-d6c8-42be-9110-ed6712efc809 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:29.066264 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c4f2ec01-d6c8-42be-9110-ed6712efc809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:29.082044 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 773/1540] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:08:29.090967 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c8d5d-9c6a-4ab5-86a4-a09c34c6af1b None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.091565 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c8d5d-9c6a-4ab5-86a4-a09c34c6af1b None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.091565 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c8d5d-9c6a-4ab5-86a4-a09c34c6af1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.119762 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-cc5c8d5d-9c6a-4ab5-86a4-a09c34c6af1b None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:29.121235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-cc5c8d5d-9c6a-4ab5-86a4-a09c34c6af1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:29.137259 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 768/1541] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:29.142867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2ec01-d6c8-42be-9110-ed6712efc809 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:29.156554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2ec01-d6c8-42be-9110-ed6712efc809 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:29.166237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede9843-35bf-4dca-aecc-daacd73851ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:29.166973 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede9843-35bf-4dca-aecc-daacd73851ea admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.167258 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede9843-35bf-4dca-aecc-daacd73851ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.167539 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede9843-35bf-4dca-aecc-daacd73851ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.168560 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede9843-35bf-4dca-aecc-daacd73851ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:08:29.168871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede9843-35bf-4dca-aecc-daacd73851ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:29.170626 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede9843-35bf-4dca-aecc-daacd73851ea admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:29.192413 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 774/1542] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:08:29.200922 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c8d5d-9c6a-4ab5-86a4-a09c34c6af1b None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:29.210697 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c8d5d-9c6a-4ab5-86a4-a09c34c6af1b None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:29.222970 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579339ed-b9cb-46d5-9dc8-9e57190cdb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:29.223570 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579339ed-b9cb-46d5-9dc8-9e57190cdb26 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.223854 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579339ed-b9cb-46d5-9dc8-9e57190cdb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.224133 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579339ed-b9cb-46d5-9dc8-9e57190cdb26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.225010 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579339ed-b9cb-46d5-9dc8-9e57190cdb26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:29.227174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579339ed-b9cb-46d5-9dc8-9e57190cdb26 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:29.257680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19018b-f2bb-49b7-831d-a747d02a4732 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.258022 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19018b-f2bb-49b7-831d-a747d02a4732 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.258249 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19018b-f2bb-49b7-831d-a747d02a4732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.293067 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 769/1543] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:08:29 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:29.300294 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-fc19018b-f2bb-49b7-831d-a747d02a4732 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:29.301973 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-fc19018b-f2bb-49b7-831d-a747d02a4732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:29.307793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579339ed-b9cb-46d5-9dc8-9e57190cdb26 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:29.428448 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579339ed-b9cb-46d5-9dc8-9e57190cdb26 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:29.429509 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 775/1544] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:08:29.430802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4d8f5-0b05-4a4a-83bb-6e4f31604754 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.431094 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4d8f5-0b05-4a4a-83bb-6e4f31604754 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.431537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4d8f5-0b05-4a4a-83bb-6e4f31604754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.440728 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ca49d-87b2-4e67-9ed2-2f4234b4757d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:29.441417 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ca49d-87b2-4e67-9ed2-2f4234b4757d admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.441698 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ca49d-87b2-4e67-9ed2-2f4234b4757d admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.441973 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ca49d-87b2-4e67-9ed2-2f4234b4757d admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.442703 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ca49d-87b2-4e67-9ed2-2f4234b4757d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:29.443725 dv-cinder-848900-3-smb devstack@keystone.service[80165]: WARNING py.warnings [None req-cc3ca49d-87b2-4e67-9ed2-2f4234b4757d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 12:08:29.443725 dv-cinder-848900-3-smb devstack@keystone.service[80165]: warnings.warn(msg) Jul 14 12:08:29.443725 dv-cinder-848900-3-smb devstack@keystone.service[80165]: Jul 14 12:08:29.445119 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ca49d-87b2-4e67-9ed2-2f4234b4757d admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:29.465857 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-11d4d8f5-0b05-4a4a-83bb-6e4f31604754 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:29.469238 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-11d4d8f5-0b05-4a4a-83bb-6e4f31604754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:29.502536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 776/1545] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:29.502536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2145804-be94-4c93-a35f-ee9a46a27e74 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.502536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2145804-be94-4c93-a35f-ee9a46a27e74 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.502536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2145804-be94-4c93-a35f-ee9a46a27e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.529535 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 770/1546] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:08:29 2022] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:08:29.533007 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68cd81-aa12-46b5-a968-4945e5559f42 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.533341 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68cd81-aa12-46b5-a968-4945e5559f42 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.533622 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68cd81-aa12-46b5-a968-4945e5559f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.547746 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-d2145804-be94-4c93-a35f-ee9a46a27e74 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:29.548975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d2145804-be94-4c93-a35f-ee9a46a27e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:29.562591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 777/1547] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:29.564029 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5c18b-e1b3-4b67-9e56-a8f9dafd4013 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.564325 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5c18b-e1b3-4b67-9e56-a8f9dafd4013 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.564615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5c18b-e1b3-4b67-9e56-a8f9dafd4013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.571823 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-fe68cd81-aa12-46b5-a968-4945e5559f42 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:29.573128 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-fe68cd81-aa12-46b5-a968-4945e5559f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:29.581372 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 771/1548] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:29.582569 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee88cd-4155-4da0-9715-07896342be8c None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.582929 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee88cd-4155-4da0-9715-07896342be8c None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.583100 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-71c5c18b-e1b3-4b67-9e56-a8f9dafd4013 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:29.583409 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee88cd-4155-4da0-9715-07896342be8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.584371 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-71c5c18b-e1b3-4b67-9e56-a8f9dafd4013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:29.597777 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 778/1549] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:29.597777 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5c18b-e1b3-4b67-9e56-a8f9dafd4013 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:29.605276 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5c18b-e1b3-4b67-9e56-a8f9dafd4013 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:29.605735 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-61ee88cd-4155-4da0-9715-07896342be8c None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:29.606977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-61ee88cd-4155-4da0-9715-07896342be8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:29.610763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cdf21-cba9-4ef4-847e-2114f80d259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:29.611510 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cdf21-cba9-4ef4-847e-2114f80d259a admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.611875 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cdf21-cba9-4ef4-847e-2114f80d259a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.612230 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cdf21-cba9-4ef4-847e-2114f80d259a admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.613034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cdf21-cba9-4ef4-847e-2114f80d259a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:29.614747 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cdf21-cba9-4ef4-847e-2114f80d259a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:29.615826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 772/1550] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:29.623099 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62198908-9629-414a-9a9d-f25313b5edea None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.623099 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62198908-9629-414a-9a9d-f25313b5edea None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.623099 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62198908-9629-414a-9a9d-f25313b5edea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.632471 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 779/1551] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:29.634073 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6055400-01d5-44bd-bff0-0785e83fa227 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.634697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6055400-01d5-44bd-bff0-0785e83fa227 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.635100 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6055400-01d5-44bd-bff0-0785e83fa227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.635381 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-62198908-9629-414a-9a9d-f25313b5edea None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:29.636677 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-62198908-9629-414a-9a9d-f25313b5edea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:29.645002 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 773/1552] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:29.645687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62198908-9629-414a-9a9d-f25313b5edea None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:29.656490 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62198908-9629-414a-9a9d-f25313b5edea None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:29.657978 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a6055400-01d5-44bd-bff0-0785e83fa227 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:29.659223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a6055400-01d5-44bd-bff0-0785e83fa227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:29.661199 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb784c-56f8-4a93-a681-7a769e1dbe62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:29.661861 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb784c-56f8-4a93-a681-7a769e1dbe62 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.662151 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb784c-56f8-4a93-a681-7a769e1dbe62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.662459 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb784c-56f8-4a93-a681-7a769e1dbe62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.663214 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb784c-56f8-4a93-a681-7a769e1dbe62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:08:29.663531 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb784c-56f8-4a93-a681-7a769e1dbe62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:29.664543 dv-cinder-848900-3-smb devstack@keystone.service[80165]: WARNING py.warnings [None req-decb784c-56f8-4a93-a681-7a769e1dbe62 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 12:08:29.664543 dv-cinder-848900-3-smb devstack@keystone.service[80165]: warnings.warn(msg) Jul 14 12:08:29.664543 dv-cinder-848900-3-smb devstack@keystone.service[80165]: Jul 14 12:08:29.665466 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb784c-56f8-4a93-a681-7a769e1dbe62 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:29.667450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 780/1553] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:29.668917 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cfc64-0466-4b5e-b1eb-a36682d02fbb None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.669204 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cfc64-0466-4b5e-b1eb-a36682d02fbb None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.669488 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cfc64-0466-4b5e-b1eb-a36682d02fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.683019 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 774/1554] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:08:29.683019 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb784c-56f8-4a93-a681-7a769e1dbe62 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:29.689481 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-861cfc64-0466-4b5e-b1eb-a36682d02fbb None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:29.689669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb784c-56f8-4a93-a681-7a769e1dbe62 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:29.690726 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-861cfc64-0466-4b5e-b1eb-a36682d02fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:29.694664 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff1d89-c391-44ff-b379-10deba110944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:29.695370 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff1d89-c391-44ff-b379-10deba110944 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.695656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff1d89-c391-44ff-b379-10deba110944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.695933 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff1d89-c391-44ff-b379-10deba110944 admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.696646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff1d89-c391-44ff-b379-10deba110944 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:08:29.696955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff1d89-c391-44ff-b379-10deba110944 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:29.698636 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff1d89-c391-44ff-b379-10deba110944 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:29.698777 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 781/1555] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:29.704309 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01557b-426c-403e-8ed0-4dd75d4ea9fe None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.704873 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01557b-426c-403e-8ed0-4dd75d4ea9fe None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.705161 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01557b-426c-403e-8ed0-4dd75d4ea9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.719206 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 775/1556] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:08:29.719206 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff1d89-c391-44ff-b379-10deba110944 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:29.723418 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff1d89-c391-44ff-b379-10deba110944 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:29.728201 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33032a01-8847-43f2-8836-54918ce6f138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:29.728857 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33032a01-8847-43f2-8836-54918ce6f138 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.729138 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33032a01-8847-43f2-8836-54918ce6f138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.729413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33032a01-8847-43f2-8836-54918ce6f138 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.730130 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33032a01-8847-43f2-8836-54918ce6f138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:29.731749 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33032a01-8847-43f2-8836-54918ce6f138 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:29.732895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-cd01557b-426c-403e-8ed0-4dd75d4ea9fe None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:29.734232 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-cd01557b-426c-403e-8ed0-4dd75d4ea9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:29.746275 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 776/1557] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:29.746415 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 782/1558] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:29.746558 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b3db0-99fc-4f09-af0f-9d47c035e33e None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.746558 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b3db0-99fc-4f09-af0f-9d47c035e33e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.746738 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124905eb-4421-4eb7-87be-ca3ef4ad07d6 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.746832 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b3db0-99fc-4f09-af0f-9d47c035e33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.746930 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124905eb-4421-4eb7-87be-ca3ef4ad07d6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.746930 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124905eb-4421-4eb7-87be-ca3ef4ad07d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.762996 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-b36b3db0-99fc-4f09-af0f-9d47c035e33e None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:29.763573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-124905eb-4421-4eb7-87be-ca3ef4ad07d6 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:29.764214 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b36b3db0-99fc-4f09-af0f-9d47c035e33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:29.764740 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-124905eb-4421-4eb7-87be-ca3ef4ad07d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:29.773318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 783/1559] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:29.777238 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 777/1560] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:29.777404 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c211b-000b-4243-ba25-4177c16717dc None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.777404 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c211b-000b-4243-ba25-4177c16717dc None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.777404 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c211b-000b-4243-ba25-4177c16717dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.777656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b3db0-99fc-4f09-af0f-9d47c035e33e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:29.787311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b3db0-99fc-4f09-af0f-9d47c035e33e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:29.791885 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b1b8d-5275-4c6f-875b-6804bbd46fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:29.792556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b1b8d-5275-4c6f-875b-6804bbd46fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.792844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b1b8d-5275-4c6f-875b-6804bbd46fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.793374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b1b8d-5275-4c6f-875b-6804bbd46fb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.794063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b1b8d-5275-4c6f-875b-6804bbd46fb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:29.796008 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b1b8d-5275-4c6f-875b-6804bbd46fb4 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:29.799287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-127c211b-000b-4243-ba25-4177c16717dc None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:29.800495 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-127c211b-000b-4243-ba25-4177c16717dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:29.809292 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 784/1561] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:29.810161 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c211b-000b-4243-ba25-4177c16717dc None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:29.820234 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c211b-000b-4243-ba25-4177c16717dc None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:29.825225 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706da40e-5ce8-4b16-a1ea-774e0472040b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:29.825885 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706da40e-5ce8-4b16-a1ea-774e0472040b admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.826178 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706da40e-5ce8-4b16-a1ea-774e0472040b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.830019 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 778/1562] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:08:29 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:29.830129 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706da40e-5ce8-4b16-a1ea-774e0472040b admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.830129 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706da40e-5ce8-4b16-a1ea-774e0472040b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:08:29.830285 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b1b8d-5275-4c6f-875b-6804bbd46fb4 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:29.830364 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706da40e-5ce8-4b16-a1ea-774e0472040b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:29.830364 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706da40e-5ce8-4b16-a1ea-774e0472040b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:29.841697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 785/1563] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:08:29.842486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706da40e-5ce8-4b16-a1ea-774e0472040b admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:29.852772 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706da40e-5ce8-4b16-a1ea-774e0472040b admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:29.861583 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:29.895177 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b1b8d-5275-4c6f-875b-6804bbd46fb4 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:29.900032 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f9a30-9ce5-4256-b466-7082ba0344a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:29.900731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f9a30-9ce5-4256-b466-7082ba0344a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.901016 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f9a30-9ce5-4256-b466-7082ba0344a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.901296 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f9a30-9ce5-4256-b466-7082ba0344a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.901987 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f9a30-9ce5-4256-b466-7082ba0344a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:29.903955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f9a30-9ce5-4256-b466-7082ba0344a1 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:29.909319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb3b4c-4a9d-4358-b7d2-c092ef96e856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:29.910226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb3b4c-4a9d-4358-b7d2-c092ef96e856 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:29.910529 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb3b4c-4a9d-4358-b7d2-c092ef96e856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:29.910820 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb3b4c-4a9d-4358-b7d2-c092ef96e856 admin admin] PATH_INFO: `/v3/projects/3944df204ddb46cda58e3edbbb8237d1/users/651c540ef39e4c3ea316025e55b0208a/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:29.920520 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:29.928062 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb3b4c-4a9d-4358-b7d2-c092ef96e856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3944df204ddb46cda58e3edbbb8237d1, user_id=651c540ef39e4c3ea316025e55b0208a, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:29.929109 dv-cinder-848900-3-smb devstack@keystone.service[80164]: WARNING py.warnings [None req-bcbb3b4c-4a9d-4358-b7d2-c092ef96e856 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 12:08:29.929109 dv-cinder-848900-3-smb devstack@keystone.service[80164]: warnings.warn(msg) Jul 14 12:08:29.929109 dv-cinder-848900-3-smb devstack@keystone.service[80164]: Jul 14 12:08:29.931304 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb3b4c-4a9d-4358-b7d2-c092ef96e856 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:29.933921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 779/1564] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:08:29 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:29.935119 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f9a30-9ce5-4256-b466-7082ba0344a1 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:29.946365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 786/1565] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:29 2022] PUT /identity/v3/projects/3944df204ddb46cda58e3edbbb8237d1/users/651c540ef39e4c3ea316025e55b0208a/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:29.947685 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb3b4c-4a9d-4358-b7d2-c092ef96e856 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.016841 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f9a30-9ce5-4256-b466-7082ba0344a1 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.032882 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32d804-c7e0-4062-ac8a-fc829e2d5279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.033570 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32d804-c7e0-4062-ac8a-fc829e2d5279 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.033852 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32d804-c7e0-4062-ac8a-fc829e2d5279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.034122 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32d804-c7e0-4062-ac8a-fc829e2d5279 admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.034883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32d804-c7e0-4062-ac8a-fc829e2d5279 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:08:30.035246 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32d804-c7e0-4062-ac8a-fc829e2d5279 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.036832 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32d804-c7e0-4062-ac8a-fc829e2d5279 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.040486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb3b4c-4a9d-4358-b7d2-c092ef96e856 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.049184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666664c0-fe8a-45d8-a0ae-f7cad354a1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.049722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666664c0-fe8a-45d8-a0ae-f7cad354a1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.050006 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666664c0-fe8a-45d8-a0ae-f7cad354a1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.050284 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666664c0-fe8a-45d8-a0ae-f7cad354a1f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.051900 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666664c0-fe8a-45d8-a0ae-f7cad354a1f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:08:30.051900 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666664c0-fe8a-45d8-a0ae-f7cad354a1f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.053082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666664c0-fe8a-45d8-a0ae-f7cad354a1f5 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.062604 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 780/1566] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:08:30.062604 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206bcca-5e05-4f59-ba64-f6a9a2339e1c None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.062604 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206bcca-5e05-4f59-ba64-f6a9a2339e1c None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.062604 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206bcca-5e05-4f59-ba64-f6a9a2339e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.066129 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 787/1567] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:08:30.073392 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666664c0-fe8a-45d8-a0ae-f7cad354a1f5 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.083338 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666664c0-fe8a-45d8-a0ae-f7cad354a1f5 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.083989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-d206bcca-5e05-4f59-ba64-f6a9a2339e1c None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:30.085583 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-d206bcca-5e05-4f59-ba64-f6a9a2339e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:30.089056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bcbb1-58c3-4790-a896-9a116a4625d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.089857 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bcbb1-58c3-4790-a896-9a116a4625d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.090233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bcbb1-58c3-4790-a896-9a116a4625d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.090631 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bcbb1-58c3-4790-a896-9a116a4625d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.091460 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bcbb1-58c3-4790-a896-9a116a4625d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:08:30.091864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bcbb1-58c3-4790-a896-9a116a4625d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.093583 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bcbb1-58c3-4790-a896-9a116a4625d7 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.094050 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 781/1568] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:30.098387 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206bcca-5e05-4f59-ba64-f6a9a2339e1c None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.107387 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 788/1569] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:08:30.108181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bcbb1-58c3-4790-a896-9a116a4625d7 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.108446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206bcca-5e05-4f59-ba64-f6a9a2339e1c None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.113312 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a636bbd-eaa4-48ea-a371-220f0292e0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.114142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a636bbd-eaa4-48ea-a371-220f0292e0fe admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.114439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a636bbd-eaa4-48ea-a371-220f0292e0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.114752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a636bbd-eaa4-48ea-a371-220f0292e0fe admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.115447 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a636bbd-eaa4-48ea-a371-220f0292e0fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.117433 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a636bbd-eaa4-48ea-a371-220f0292e0fe admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.119071 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bcbb1-58c3-4790-a896-9a116a4625d7 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.123712 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349a39a-cfb9-490c-8d97-6e7036fec3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.125053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349a39a-cfb9-490c-8d97-6e7036fec3bc admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.125343 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349a39a-cfb9-490c-8d97-6e7036fec3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.125621 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349a39a-cfb9-490c-8d97-6e7036fec3bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.126307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349a39a-cfb9-490c-8d97-6e7036fec3bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.127391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: WARNING py.warnings [None req-5349a39a-cfb9-490c-8d97-6e7036fec3bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 12:08:30.127391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: warnings.warn(msg) Jul 14 12:08:30.127391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: Jul 14 12:08:30.128565 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349a39a-cfb9-490c-8d97-6e7036fec3bc admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.146352 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 782/1570] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:08:30 2022] POST /identity/v3/users => generated 283 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:30.147294 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a636bbd-eaa4-48ea-a371-220f0292e0fe admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.159428 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a636bbd-eaa4-48ea-a371-220f0292e0fe admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.163204 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 789/1571] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:08:30 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:30.163204 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ef04f-2a99-47e8-bb08-45890f4d29bf None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.163204 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ef04f-2a99-47e8-bb08-45890f4d29bf None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.163204 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ef04f-2a99-47e8-bb08-45890f4d29bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.183166 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-457ef04f-2a99-47e8-bb08-45890f4d29bf None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:30.184469 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-457ef04f-2a99-47e8-bb08-45890f4d29bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:30.223916 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cef0d9-a0d9-4b3d-b516-ac24d4d20b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.224604 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cef0d9-a0d9-4b3d-b516-ac24d4d20b62 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.224890 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cef0d9-a0d9-4b3d-b516-ac24d4d20b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.225176 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cef0d9-a0d9-4b3d-b516-ac24d4d20b62 admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.225884 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cef0d9-a0d9-4b3d-b516-ac24d4d20b62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.228025 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cef0d9-a0d9-4b3d-b516-ac24d4d20b62 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.253152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 790/1572] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:30.255221 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 783/1573] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:08:30 2022] POST /identity/v3/users => generated 282 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:30.255807 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cef0d9-a0d9-4b3d-b516-ac24d4d20b62 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.260270 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ef04f-2a99-47e8-bb08-45890f4d29bf None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.266429 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cef0d9-a0d9-4b3d-b516-ac24d4d20b62 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.271879 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ef04f-2a99-47e8-bb08-45890f4d29bf None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.272670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d6989-1810-4bda-963e-4a40e3dc8293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.273466 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d6989-1810-4bda-963e-4a40e3dc8293 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.273803 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d6989-1810-4bda-963e-4a40e3dc8293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.274131 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d6989-1810-4bda-963e-4a40e3dc8293 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.275039 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d6989-1810-4bda-963e-4a40e3dc8293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.276974 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ddab0-da77-4c95-9020-a06aa7a26444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.277122 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d6989-1810-4bda-963e-4a40e3dc8293 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.277703 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ddab0-da77-4c95-9020-a06aa7a26444 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.278067 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ddab0-da77-4c95-9020-a06aa7a26444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.278369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ddab0-da77-4c95-9020-a06aa7a26444 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.279092 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ddab0-da77-4c95-9020-a06aa7a26444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.281313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ddab0-da77-4c95-9020-a06aa7a26444 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.287210 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:30.306591 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 784/1574] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:08:30 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:30.307433 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d6989-1810-4bda-963e-4a40e3dc8293 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.314242 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 791/1575] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:08:30 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:30.314852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ddab0-da77-4c95-9020-a06aa7a26444 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.342687 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:30.375629 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d6989-1810-4bda-963e-4a40e3dc8293 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.378459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ddab0-da77-4c95-9020-a06aa7a26444 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.380373 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54324b70-3c81-4a1a-b8e1-9547bbb1910f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.381102 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54324b70-3c81-4a1a-b8e1-9547bbb1910f admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.381412 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54324b70-3c81-4a1a-b8e1-9547bbb1910f admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.381670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54324b70-3c81-4a1a-b8e1-9547bbb1910f admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.382401 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54324b70-3c81-4a1a-b8e1-9547bbb1910f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:08:30.382884 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54324b70-3c81-4a1a-b8e1-9547bbb1910f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.383308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e0467-cf48-4074-ae91-2115ac3ed8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.383975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e0467-cf48-4074-ae91-2115ac3ed8eb admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.384261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e0467-cf48-4074-ae91-2115ac3ed8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.384510 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54324b70-3c81-4a1a-b8e1-9547bbb1910f admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.384632 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e0467-cf48-4074-ae91-2115ac3ed8eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.385230 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e0467-cf48-4074-ae91-2115ac3ed8eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.387162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e0467-cf48-4074-ae91-2115ac3ed8eb admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.396987 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 785/1576] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:08:30.397669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54324b70-3c81-4a1a-b8e1-9547bbb1910f admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.409535 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54324b70-3c81-4a1a-b8e1-9547bbb1910f admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.414396 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f59fe1-5d4f-40ae-9229-4b005a568de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.415098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f59fe1-5d4f-40ae-9229-4b005a568de9 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.415253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 792/1577] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:08:30 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:30.415373 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f59fe1-5d4f-40ae-9229-4b005a568de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.415644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f59fe1-5d4f-40ae-9229-4b005a568de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.415972 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e0467-cf48-4074-ae91-2115ac3ed8eb admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.416375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f59fe1-5d4f-40ae-9229-4b005a568de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.417977 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f59fe1-5d4f-40ae-9229-4b005a568de9 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.432998 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 786/1578] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:30.432998 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f59fe1-5d4f-40ae-9229-4b005a568de9 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.443212 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f59fe1-5d4f-40ae-9229-4b005a568de9 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.479610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e0467-cf48-4074-ae91-2115ac3ed8eb admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.484796 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a68d6-6726-47e2-9f12-9a3bb87a2982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.485526 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a68d6-6726-47e2-9f12-9a3bb87a2982 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.485810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a68d6-6726-47e2-9f12-9a3bb87a2982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.486087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a68d6-6726-47e2-9f12-9a3bb87a2982 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.486867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a68d6-6726-47e2-9f12-9a3bb87a2982 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.488743 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a68d6-6726-47e2-9f12-9a3bb87a2982 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.501356 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7cc39-6649-421c-a3ee-89e3be66e664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.502003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7cc39-6649-421c-a3ee-89e3be66e664 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.502314 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7cc39-6649-421c-a3ee-89e3be66e664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.502608 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7cc39-6649-421c-a3ee-89e3be66e664 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.503322 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7cc39-6649-421c-a3ee-89e3be66e664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.504957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7cc39-6649-421c-a3ee-89e3be66e664 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.509031 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 793/1579] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:08:30 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:30.512810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a68d6-6726-47e2-9f12-9a3bb87a2982 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.518158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 787/1580] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:30.518158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7cc39-6649-421c-a3ee-89e3be66e664 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.528131 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7cc39-6649-421c-a3ee-89e3be66e664 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.532717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da275f2-3831-45e4-ac08-c62dc6470c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.533381 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da275f2-3831-45e4-ac08-c62dc6470c31 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.533734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da275f2-3831-45e4-ac08-c62dc6470c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.533952 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da275f2-3831-45e4-ac08-c62dc6470c31 admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.534680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da275f2-3831-45e4-ac08-c62dc6470c31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.536612 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da275f2-3831-45e4-ac08-c62dc6470c31 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.558102 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 788/1581] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:08:30 2022] POST /identity/v3/users => generated 288 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:30.558940 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da275f2-3831-45e4-ac08-c62dc6470c31 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.569188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a68d6-6726-47e2-9f12-9a3bb87a2982 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.569414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da275f2-3831-45e4-ac08-c62dc6470c31 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.573113 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee2090-a5a4-4cb2-89d0-ae2f0ba8079d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.573760 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee2090-a5a4-4cb2-89d0-ae2f0ba8079d service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.574042 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee2090-a5a4-4cb2-89d0-ae2f0ba8079d service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.574209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736a936-9b92-4b27-accc-f54e3ab68c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.574332 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee2090-a5a4-4cb2-89d0-ae2f0ba8079d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.574933 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736a936-9b92-4b27-accc-f54e3ab68c3a admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.575224 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736a936-9b92-4b27-accc-f54e3ab68c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.575561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736a936-9b92-4b27-accc-f54e3ab68c3a admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.576273 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736a936-9b92-4b27-accc-f54e3ab68c3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.578269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736a936-9b92-4b27-accc-f54e3ab68c3a admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.583464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee2090-a5a4-4cb2-89d0-ae2f0ba8079d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.584875 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee2090-a5a4-4cb2-89d0-ae2f0ba8079d service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.594921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 794/1582] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:30.595721 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee2090-a5a4-4cb2-89d0-ae2f0ba8079d service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.599759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 789/1583] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:08:30 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:30.600638 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736a936-9b92-4b27-accc-f54e3ab68c3a admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.607623 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee2090-a5a4-4cb2-89d0-ae2f0ba8079d service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.611458 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736a936-9b92-4b27-accc-f54e3ab68c3a admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.613003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4b74e-15b0-4116-8465-bd7138b4c1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.613728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4b74e-15b0-4116-8465-bd7138b4c1da admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.614089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4b74e-15b0-4116-8465-bd7138b4c1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.614487 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4b74e-15b0-4116-8465-bd7138b4c1da admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.615244 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4b74e-15b0-4116-8465-bd7138b4c1da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.616958 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edd593-e577-49c8-8dec-33a30c3fc06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.617246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4b74e-15b0-4116-8465-bd7138b4c1da admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.617757 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edd593-e577-49c8-8dec-33a30c3fc06a admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.618114 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edd593-e577-49c8-8dec-33a30c3fc06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.618465 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edd593-e577-49c8-8dec-33a30c3fc06a admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.619620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5edd593-e577-49c8-8dec-33a30c3fc06a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.622191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5edd593-e577-49c8-8dec-33a30c3fc06a admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.646070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 790/1584] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:08:30 2022] POST /identity/v3/users => generated 291 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:30.648717 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 795/1585] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:08:30 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:30.649816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4b74e-15b0-4116-8465-bd7138b4c1da admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.650615 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edd593-e577-49c8-8dec-33a30c3fc06a admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.661244 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edd593-e577-49c8-8dec-33a30c3fc06a admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.675528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:30.676635 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:30.731704 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4b74e-15b0-4116-8465-bd7138b4c1da admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.742395 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc7898-3006-47e1-9e79-5ea2b6f911a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.743162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc7898-3006-47e1-9e79-5ea2b6f911a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.743496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc7898-3006-47e1-9e79-5ea2b6f911a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.743756 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc7898-3006-47e1-9e79-5ea2b6f911a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.744502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc7898-3006-47e1-9e79-5ea2b6f911a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.746110 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc7898-3006-47e1-9e79-5ea2b6f911a8 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.747559 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429faa9-2580-4e27-8ad3-334dd899d67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.748201 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429faa9-2580-4e27-8ad3-334dd899d67f admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.748569 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429faa9-2580-4e27-8ad3-334dd899d67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.748849 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429faa9-2580-4e27-8ad3-334dd899d67f admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.750288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429faa9-2580-4e27-8ad3-334dd899d67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.751945 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429faa9-2580-4e27-8ad3-334dd899d67f admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.760269 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 796/1586] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:30.761282 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc7898-3006-47e1-9e79-5ea2b6f911a8 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.763841 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 791/1587] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:30.764850 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429faa9-2580-4e27-8ad3-334dd899d67f admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.772904 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc7898-3006-47e1-9e79-5ea2b6f911a8 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.780577 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429faa9-2580-4e27-8ad3-334dd899d67f admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.784827 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7c6da-0259-4dfd-8f57-d16c84d2e5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.785563 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7c6da-0259-4dfd-8f57-d16c84d2e5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.785855 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7c6da-0259-4dfd-8f57-d16c84d2e5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.786169 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7c6da-0259-4dfd-8f57-d16c84d2e5a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.786949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7c6da-0259-4dfd-8f57-d16c84d2e5a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.788598 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7c6da-0259-4dfd-8f57-d16c84d2e5a4 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.792457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df614ef-529b-42a9-9b4b-8b1609ea73df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.793437 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df614ef-529b-42a9-9b4b-8b1609ea73df admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.793808 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df614ef-529b-42a9-9b4b-8b1609ea73df admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.794096 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df614ef-529b-42a9-9b4b-8b1609ea73df admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.794910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df614ef-529b-42a9-9b4b-8b1609ea73df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.798847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df614ef-529b-42a9-9b4b-8b1609ea73df admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.804823 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 792/1588] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:30.807535 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7c6da-0259-4dfd-8f57-d16c84d2e5a4 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.811641 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 797/1589] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:30.813279 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df614ef-529b-42a9-9b4b-8b1609ea73df admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.820528 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7c6da-0259-4dfd-8f57-d16c84d2e5a4 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.826854 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b23c16-dc9d-4199-b4d3-1832778c7aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.827033 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df614ef-529b-42a9-9b4b-8b1609ea73df admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.828051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b23c16-dc9d-4199-b4d3-1832778c7aee admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.828684 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b23c16-dc9d-4199-b4d3-1832778c7aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.829227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b23c16-dc9d-4199-b4d3-1832778c7aee admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.830296 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b23c16-dc9d-4199-b4d3-1832778c7aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.831558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c53b5-d469-4d48-b3d3-00231c0ba1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.832248 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c53b5-d469-4d48-b3d3-00231c0ba1ed admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.832533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c53b5-d469-4d48-b3d3-00231c0ba1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.832826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c53b5-d469-4d48-b3d3-00231c0ba1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.833126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b23c16-dc9d-4199-b4d3-1832778c7aee admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.833721 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c53b5-d469-4d48-b3d3-00231c0ba1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.835361 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c53b5-d469-4d48-b3d3-00231c0ba1ed admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.847236 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 798/1590] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:30.848045 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 793/1591] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:30.848186 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c53b5-d469-4d48-b3d3-00231c0ba1ed admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.849201 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b23c16-dc9d-4199-b4d3-1832778c7aee admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.863142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c53b5-d469-4d48-b3d3-00231c0ba1ed admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.863897 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b23c16-dc9d-4199-b4d3-1832778c7aee admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.868081 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114544e-c011-43ef-b0c1-c8a1c447397a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.868826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d62014-8b95-42e9-a60a-b589af1b8234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.868979 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114544e-c011-43ef-b0c1-c8a1c447397a admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.869206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114544e-c011-43ef-b0c1-c8a1c447397a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.869582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114544e-c011-43ef-b0c1-c8a1c447397a admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.869768 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d62014-8b95-42e9-a60a-b589af1b8234 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.870057 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d62014-8b95-42e9-a60a-b589af1b8234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.870341 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d62014-8b95-42e9-a60a-b589af1b8234 admin admin] PATH_INFO: `/v3/projects/c40ec37e2942453f941acb2add042451/users/f7ba18e540024876ab02b81a90779fac/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.870814 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114544e-c011-43ef-b0c1-c8a1c447397a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.873215 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114544e-c011-43ef-b0c1-c8a1c447397a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.887727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d62014-8b95-42e9-a60a-b589af1b8234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c40ec37e2942453f941acb2add042451, user_id=f7ba18e540024876ab02b81a90779fac, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.890569 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d62014-8b95-42e9-a60a-b589af1b8234 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:30.902780 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 799/1592] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:08:30 2022] POST /identity/v3/users => generated 294 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:30.902780 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114544e-c011-43ef-b0c1-c8a1c447397a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.921991 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 794/1593] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:30 2022] PUT /identity/v3/projects/c40ec37e2942453f941acb2add042451/users/f7ba18e540024876ab02b81a90779fac/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:30.921991 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d62014-8b95-42e9-a60a-b589af1b8234 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:30.922302 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114544e-c011-43ef-b0c1-c8a1c447397a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:30.991043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077d271-8c75-42cf-bc64-5d6d24aeafff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:30.991744 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077d271-8c75-42cf-bc64-5d6d24aeafff admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:30.992047 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077d271-8c75-42cf-bc64-5d6d24aeafff admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:30.992298 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077d271-8c75-42cf-bc64-5d6d24aeafff admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:30.993216 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077d271-8c75-42cf-bc64-5d6d24aeafff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:30.995541 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077d271-8c75-42cf-bc64-5d6d24aeafff admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:31.009654 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 800/1594] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:31.011077 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077d271-8c75-42cf-bc64-5d6d24aeafff admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:31.014542 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d62014-8b95-42e9-a60a-b589af1b8234 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:31.021570 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619df4e-e28d-41ce-8dad-d434c30ed933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:31.022423 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619df4e-e28d-41ce-8dad-d434c30ed933 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:31.022606 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077d271-8c75-42cf-bc64-5d6d24aeafff admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:31.022924 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619df4e-e28d-41ce-8dad-d434c30ed933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:31.023310 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619df4e-e28d-41ce-8dad-d434c30ed933 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:31.024164 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619df4e-e28d-41ce-8dad-d434c30ed933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:31.026550 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619df4e-e28d-41ce-8dad-d434c30ed933 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:31.027330 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2aca03-759d-4d09-81b7-b3816651b453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:31.028991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aca03-759d-4d09-81b7-b3816651b453 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:31.029626 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aca03-759d-4d09-81b7-b3816651b453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:31.029971 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aca03-759d-4d09-81b7-b3816651b453 admin admin] PATH_INFO: `/v3/projects/65ba72075cbc43ea8ef36b08f0754d3a/users/9b8d5e796f5148a6af322d074f592214/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:31.042624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 795/1595] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:31.042624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619df4e-e28d-41ce-8dad-d434c30ed933 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:31.053020 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2aca03-759d-4d09-81b7-b3816651b453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65ba72075cbc43ea8ef36b08f0754d3a, user_id=9b8d5e796f5148a6af322d074f592214, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:31.056462 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2aca03-759d-4d09-81b7-b3816651b453 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:31.058164 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619df4e-e28d-41ce-8dad-d434c30ed933 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:31.064168 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f53e2-c003-4074-ac46-66b5cadc80a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:31.064954 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f53e2-c003-4074-ac46-66b5cadc80a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:31.065249 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f53e2-c003-4074-ac46-66b5cadc80a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:31.065596 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f53e2-c003-4074-ac46-66b5cadc80a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:31.066320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f53e2-c003-4074-ac46-66b5cadc80a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:31.068205 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f53e2-c003-4074-ac46-66b5cadc80a4 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:31.072093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 801/1596] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:31 2022] PUT /identity/v3/projects/65ba72075cbc43ea8ef36b08f0754d3a/users/9b8d5e796f5148a6af322d074f592214/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:31.079448 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2aca03-759d-4d09-81b7-b3816651b453 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:31.079961 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 796/1597] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:31.080825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f53e2-c003-4074-ac46-66b5cadc80a4 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:31.096283 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f53e2-c003-4074-ac46-66b5cadc80a4 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:31.141489 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:31.149185 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:31.160366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2aca03-759d-4d09-81b7-b3816651b453 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:31.161963 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40452c75-8547-46e9-b5c2-1560d7388b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:31.162670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40452c75-8547-46e9-b5c2-1560d7388b43 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:31.162953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40452c75-8547-46e9-b5c2-1560d7388b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:31.163225 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40452c75-8547-46e9-b5c2-1560d7388b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:31.163949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40452c75-8547-46e9-b5c2-1560d7388b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:31.165543 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40452c75-8547-46e9-b5c2-1560d7388b43 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:31.165665 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123d9be-cbc2-417a-9fc1-20748db0f74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:31.166315 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123d9be-cbc2-417a-9fc1-20748db0f74a admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:31.166637 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123d9be-cbc2-417a-9fc1-20748db0f74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:31.166919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123d9be-cbc2-417a-9fc1-20748db0f74a admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:31.167775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123d9be-cbc2-417a-9fc1-20748db0f74a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:31.170068 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123d9be-cbc2-417a-9fc1-20748db0f74a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:31.180141 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 797/1598] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:31.180141 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fbce6-fc0f-4113-be8b-b33c4d780a7c None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:31.180141 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fbce6-fc0f-4113-be8b-b33c4d780a7c None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:31.180141 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fbce6-fc0f-4113-be8b-b33c4d780a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:31.186628 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 802/1599] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:31.186628 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123d9be-cbc2-417a-9fc1-20748db0f74a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:31.197636 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123d9be-cbc2-417a-9fc1-20748db0f74a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:31.203231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663529d-7887-4d70-92bb-79f53b4eed5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:31.204153 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663529d-7887-4d70-92bb-79f53b4eed5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:31.204444 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663529d-7887-4d70-92bb-79f53b4eed5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:31.204778 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663529d-7887-4d70-92bb-79f53b4eed5a admin admin] PATH_INFO: `/v3/projects/b47b25a5f0184af3adbd6ee26f43e7ce/users/8445dcc0f7e942cf8a6a36c750653312/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:31.206304 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-730fbce6-fc0f-4113-be8b-b33c4d780a7c None None] MFA Rules not processed for user `f7ba18e540024876ab02b81a90779fac`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:31.207554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-730fbce6-fc0f-4113-be8b-b33c4d780a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:31.221199 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663529d-7887-4d70-92bb-79f53b4eed5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b47b25a5f0184af3adbd6ee26f43e7ce, user_id=8445dcc0f7e942cf8a6a36c750653312, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:31.224138 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663529d-7887-4d70-92bb-79f53b4eed5a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:31.241283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 803/1600] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:31 2022] PUT /identity/v3/projects/b47b25a5f0184af3adbd6ee26f43e7ce/users/8445dcc0f7e942cf8a6a36c750653312/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:31.242334 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663529d-7887-4d70-92bb-79f53b4eed5a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:31.282591 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 798/1601] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:31.282591 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fbce6-fc0f-4113-be8b-b33c4d780a7c None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:31.297325 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fbce6-fc0f-4113-be8b-b33c4d780a7c None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:31.325681 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663529d-7887-4d70-92bb-79f53b4eed5a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:31.333847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8772dc-78b7-41c0-b229-c50cc282987c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:31.337463 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8772dc-78b7-41c0-b229-c50cc282987c admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:31.337463 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8772dc-78b7-41c0-b229-c50cc282987c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:31.337463 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8772dc-78b7-41c0-b229-c50cc282987c admin admin] PATH_INFO: `/v3/projects/6b53cf85732640b385b68268acb9a321/users/6bd225ba6b1547e2ae8778a07cd0ee5f/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:31.357387 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8772dc-78b7-41c0-b229-c50cc282987c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b53cf85732640b385b68268acb9a321, user_id=6bd225ba6b1547e2ae8778a07cd0ee5f, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:31.363707 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8772dc-78b7-41c0-b229-c50cc282987c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:31.373389 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8474b-b1d6-42e8-a7fe-c538cc088328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:31.374539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8474b-b1d6-42e8-a7fe-c538cc088328 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:31.374933 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8474b-b1d6-42e8-a7fe-c538cc088328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:31.375584 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8474b-b1d6-42e8-a7fe-c538cc088328 admin admin] PATH_INFO: `/v3/projects/7727d3d90ad240dc92914918f3d0af3f/users/5eb3da4d1e5e4a67830767d040e15a8d/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:31.382591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 804/1602] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:31 2022] PUT /identity/v3/projects/6b53cf85732640b385b68268acb9a321/users/6bd225ba6b1547e2ae8778a07cd0ee5f/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:31.385444 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d5b59-078d-44a1-a695-fa1036689b81 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:31.385979 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d5b59-078d-44a1-a695-fa1036689b81 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:31.386725 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d5b59-078d-44a1-a695-fa1036689b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:31.393613 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8474b-b1d6-42e8-a7fe-c538cc088328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7727d3d90ad240dc92914918f3d0af3f, user_id=5eb3da4d1e5e4a67830767d040e15a8d, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:31.397806 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8474b-b1d6-42e8-a7fe-c538cc088328 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:31.417602 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 799/1603] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:31 2022] PUT /identity/v3/projects/7727d3d90ad240dc92914918f3d0af3f/users/5eb3da4d1e5e4a67830767d040e15a8d/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:31.418645 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8474b-b1d6-42e8-a7fe-c538cc088328 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:31.423381 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6f5d5b59-078d-44a1-a695-fa1036689b81 None None] MFA Rules not processed for user `9b8d5e796f5148a6af322d074f592214`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:31.424964 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6f5d5b59-078d-44a1-a695-fa1036689b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:31.508843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8474b-b1d6-42e8-a7fe-c538cc088328 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:31.509820 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 805/1604] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:31 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:31.510909 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d5b59-078d-44a1-a695-fa1036689b81 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:31.517630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919bbea-7bc5-498d-8883-e41549305603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:31.518742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919bbea-7bc5-498d-8883-e41549305603 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:31.519209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919bbea-7bc5-498d-8883-e41549305603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:31.519943 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919bbea-7bc5-498d-8883-e41549305603 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:31.521642 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919bbea-7bc5-498d-8883-e41549305603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:31.524030 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919bbea-7bc5-498d-8883-e41549305603 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:31.525825 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:31.526004 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d5b59-078d-44a1-a695-fa1036689b81 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:31.534036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef004a-ac57-4d63-9400-71ad702d02a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:31.535624 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef004a-ac57-4d63-9400-71ad702d02a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:31.536039 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef004a-ac57-4d63-9400-71ad702d02a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:31.536725 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef004a-ac57-4d63-9400-71ad702d02a6 admin admin] PATH_INFO: `/v3/projects/26ee7083248c437e9424879453ed4334/users/6f2882cc891447a69481d67a4021b360/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:31.546959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 800/1605] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:31.548618 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0877f0-b295-427b-a04b-e13e0892c937 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:31.549233 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0877f0-b295-427b-a04b-e13e0892c937 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:31.549681 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0877f0-b295-427b-a04b-e13e0892c937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:31.560328 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef004a-ac57-4d63-9400-71ad702d02a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ee7083248c437e9424879453ed4334, user_id=6f2882cc891447a69481d67a4021b360, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:31.563796 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef004a-ac57-4d63-9400-71ad702d02a6 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:31.579309 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-ef0877f0-b295-427b-a04b-e13e0892c937 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:31.580891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ef0877f0-b295-427b-a04b-e13e0892c937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:31.581333 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 806/1606] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:31 2022] PUT /identity/v3/projects/26ee7083248c437e9424879453ed4334/users/6f2882cc891447a69481d67a4021b360/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:31.582337 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef004a-ac57-4d63-9400-71ad702d02a6 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:31.607861 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:31.675847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 801/1607] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:31.680867 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f1c40-7f79-4953-8b4d-3b2d04d59b06 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:31.681169 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f1c40-7f79-4953-8b4d-3b2d04d59b06 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:31.681457 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f1c40-7f79-4953-8b4d-3b2d04d59b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:31.685979 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef004a-ac57-4d63-9400-71ad702d02a6 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:31.692672 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed1859-af77-448f-b8c6-1f75a63c5550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:31.693630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed1859-af77-448f-b8c6-1f75a63c5550 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:31.694207 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed1859-af77-448f-b8c6-1f75a63c5550 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:31.695544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed1859-af77-448f-b8c6-1f75a63c5550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:31.712185 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-f26f1c40-7f79-4953-8b4d-3b2d04d59b06 None None] MFA Rules not processed for user `6bd225ba6b1547e2ae8778a07cd0ee5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:31.713430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-f26f1c40-7f79-4953-8b4d-3b2d04d59b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:31.784459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed1859-af77-448f-b8c6-1f75a63c5550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:31.786452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed1859-af77-448f-b8c6-1f75a63c5550 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:31.812822 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 807/1608] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:31.813071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 802/1609] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:31.813891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f1c40-7f79-4953-8b4d-3b2d04d59b06 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:31.814844 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48c1cb-35df-448d-93f6-764ca7c6bd2d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:31.817090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48c1cb-35df-448d-93f6-764ca7c6bd2d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:31.818418 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48c1cb-35df-448d-93f6-764ca7c6bd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:31.843803 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f1c40-7f79-4953-8b4d-3b2d04d59b06 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:31.858400 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ac630-4621-4aa9-b506-3fbc7cda0db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:31.859429 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ac630-4621-4aa9-b506-3fbc7cda0db9 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:31.859815 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ac630-4621-4aa9-b506-3fbc7cda0db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:31.860181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ac630-4621-4aa9-b506-3fbc7cda0db9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:31.861809 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ac630-4621-4aa9-b506-3fbc7cda0db9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:31.865022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ac630-4621-4aa9-b506-3fbc7cda0db9 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:31.865742 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-5d48c1cb-35df-448d-93f6-764ca7c6bd2d None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:31.867125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5d48c1cb-35df-448d-93f6-764ca7c6bd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:31.889748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 808/1610] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:31.889748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48c1cb-35df-448d-93f6-764ca7c6bd2d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:31.903938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48c1cb-35df-448d-93f6-764ca7c6bd2d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:31.917352 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 803/1611] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:08:31 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:31.918442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e223b-5c37-422a-84ff-2ec158fbb553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:31.919944 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5b9f4-0572-42fa-9a96-a66c7ed71dfe None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:31.920954 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e223b-5c37-422a-84ff-2ec158fbb553 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:31.921855 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5b9f4-0572-42fa-9a96-a66c7ed71dfe None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:31.922212 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e223b-5c37-422a-84ff-2ec158fbb553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:31.922587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e223b-5c37-422a-84ff-2ec158fbb553 admin admin] PATH_INFO: `/v3/projects/6e4f0562e3df456eb8709580315c84b1/users/5f89347016394f69bde41b3632e94c2d/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:31.922924 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5b9f4-0572-42fa-9a96-a66c7ed71dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:31.962931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e223b-5c37-422a-84ff-2ec158fbb553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4f0562e3df456eb8709580315c84b1, user_id=5f89347016394f69bde41b3632e94c2d, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:31.967360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e223b-5c37-422a-84ff-2ec158fbb553 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:31.986058 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-69d5b9f4-0572-42fa-9a96-a66c7ed71dfe None None] MFA Rules not processed for user `6f2882cc891447a69481d67a4021b360`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:31.987200 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-69d5b9f4-0572-42fa-9a96-a66c7ed71dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:31.996810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 809/1612] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:31 2022] PUT /identity/v3/projects/6e4f0562e3df456eb8709580315c84b1/users/5f89347016394f69bde41b3632e94c2d/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:31.998766 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e223b-5c37-422a-84ff-2ec158fbb553 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:32.000768 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b43e223b-5c37-422a-84ff-2ec158fbb553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:32.118047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:32.134480 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 804/1613] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:32.135699 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e223b-5c37-422a-84ff-2ec158fbb553 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:32.136883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a3c5c-2e43-4701-bae4-17226e21b18e None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:32.137426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a3c5c-2e43-4701-bae4-17226e21b18e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:32.138035 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a3c5c-2e43-4701-bae4-17226e21b18e None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:32.140266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 805/1614] 10.222.0.79 () {54 vars in 961 bytes} [Thu Jul 14 12:08:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:08:32.141243 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a3c5c-2e43-4701-bae4-17226e21b18e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:32.143254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e4330-7bfd-485a-b8f5-e5a75765d604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:32.145516 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e4330-7bfd-485a-b8f5-e5a75765d604 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:32.145809 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e4330-7bfd-485a-b8f5-e5a75765d604 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:32.146097 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e4330-7bfd-485a-b8f5-e5a75765d604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:32.157042 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a3c5c-2e43-4701-bae4-17226e21b18e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:32.163251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501a795-1872-4ad3-99b2-5acdc12bf091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:32.164140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501a795-1872-4ad3-99b2-5acdc12bf091 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:32.164587 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501a795-1872-4ad3-99b2-5acdc12bf091 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:32.165022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501a795-1872-4ad3-99b2-5acdc12bf091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:32.247423 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:32.262473 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501a795-1872-4ad3-99b2-5acdc12bf091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:32.264215 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501a795-1872-4ad3-99b2-5acdc12bf091 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:32.268753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e4330-7bfd-485a-b8f5-e5a75765d604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:32.270633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e4330-7bfd-485a-b8f5-e5a75765d604 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:32.278553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 806/1615] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:32.279762 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501a795-1872-4ad3-99b2-5acdc12bf091 service neutron] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:32.295243 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501a795-1872-4ad3-99b2-5acdc12bf091 service neutron] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:32.301125 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee4c2e-d64b-4f78-aabb-46edae4773ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:32.302690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee4c2e-d64b-4f78-aabb-46edae4773ee admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:32.303157 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee4c2e-d64b-4f78-aabb-46edae4773ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:32.303598 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee4c2e-d64b-4f78-aabb-46edae4773ee admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:32.304451 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee4c2e-d64b-4f78-aabb-46edae4773ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:32.306837 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee4c2e-d64b-4f78-aabb-46edae4773ee admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:32.314200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 810/1616] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:32.317991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ea8d0-2545-4f0e-bc09-48d879033873 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:32.320681 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ea8d0-2545-4f0e-bc09-48d879033873 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:32.321763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ea8d0-2545-4f0e-bc09-48d879033873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:32.345744 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-b72ea8d0-2545-4f0e-bc09-48d879033873 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:32.347652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b72ea8d0-2545-4f0e-bc09-48d879033873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:32.360318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 811/1617] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:32.360318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ea8d0-2545-4f0e-bc09-48d879033873 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:32.360629 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 807/1618] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:08:32 2022] POST /identity/v3/users => generated 289 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:32.364097 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b8fce-57a6-4669-ac20-e29f2d6875ab None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:32.366955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b8fce-57a6-4669-ac20-e29f2d6875ab None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:32.367251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b8fce-57a6-4669-ac20-e29f2d6875ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:32.388389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ea8d0-2545-4f0e-bc09-48d879033873 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:32.403975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a7071-676c-4c07-bf2f-ac586b7e6d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:32.404674 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a7071-676c-4c07-bf2f-ac586b7e6d9c admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:32.404945 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a7071-676c-4c07-bf2f-ac586b7e6d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:32.405236 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a7071-676c-4c07-bf2f-ac586b7e6d9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:32.406590 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a7071-676c-4c07-bf2f-ac586b7e6d9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:32.411870 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a7071-676c-4c07-bf2f-ac586b7e6d9c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:32.466691 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-112b8fce-57a6-4669-ac20-e29f2d6875ab None None] MFA Rules not processed for user `e41a4d3a822c403fad048764a0edf209`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:32.467955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-112b8fce-57a6-4669-ac20-e29f2d6875ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:32.494776 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 812/1619] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:08:32 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:32.494989 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a7071-676c-4c07-bf2f-ac586b7e6d9c admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:32.661999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 808/1620] 10.222.0.79 () {58 vars in 1058 bytes} [Thu Jul 14 12:08:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:32.665561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b8fce-57a6-4669-ac20-e29f2d6875ab None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:32.688762 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b8fce-57a6-4669-ac20-e29f2d6875ab None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:32.708514 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a7071-676c-4c07-bf2f-ac586b7e6d9c admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:32.741767 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5067f64-9902-428e-bfa4-76d32be4ab37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:32.742619 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5067f64-9902-428e-bfa4-76d32be4ab37 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:32.742824 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5067f64-9902-428e-bfa4-76d32be4ab37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:32.743633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5067f64-9902-428e-bfa4-76d32be4ab37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:32.744412 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5067f64-9902-428e-bfa4-76d32be4ab37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:32.746056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5067f64-9902-428e-bfa4-76d32be4ab37 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:32.767306 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 813/1621] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:32.768501 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5067f64-9902-428e-bfa4-76d32be4ab37 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:32.781193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5067f64-9902-428e-bfa4-76d32be4ab37 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:32.791096 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f77b97-92ee-40b4-b1fd-1eb05496e71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:32.791981 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f77b97-92ee-40b4-b1fd-1eb05496e71d admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:32.792280 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f77b97-92ee-40b4-b1fd-1eb05496e71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:32.792594 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f77b97-92ee-40b4-b1fd-1eb05496e71d admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:32.806161 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f77b97-92ee-40b4-b1fd-1eb05496e71d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:32.817557 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f77b97-92ee-40b4-b1fd-1eb05496e71d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:32.824568 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:32.831628 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ec4eb-8f0b-4e66-b7b1-eadec59e9485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:32.832675 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ec4eb-8f0b-4e66-b7b1-eadec59e9485 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:32.832976 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ec4eb-8f0b-4e66-b7b1-eadec59e9485 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:32.834140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ec4eb-8f0b-4e66-b7b1-eadec59e9485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:32.851832 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ec4eb-8f0b-4e66-b7b1-eadec59e9485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:32.853744 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ec4eb-8f0b-4e66-b7b1-eadec59e9485 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:32.870369 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 809/1622] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:32.871497 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ec4eb-8f0b-4e66-b7b1-eadec59e9485 service neutron] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:32.876326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 814/1623] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:08:32 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:32.879722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f77b97-92ee-40b4-b1fd-1eb05496e71d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:32.921240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f77b97-92ee-40b4-b1fd-1eb05496e71d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:32.933787 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bf1c7-8c8a-44a7-b82f-25fa11446c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:32.934352 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bf1c7-8c8a-44a7-b82f-25fa11446c1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:32.934672 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bf1c7-8c8a-44a7-b82f-25fa11446c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:32.934956 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bf1c7-8c8a-44a7-b82f-25fa11446c1d admin admin] PATH_INFO: `/v3/projects/55bd92ae77a74f99bcf2c4f4e7618910/users/e30811e409a6487683bb0cc678e443ec/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:32.993032 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bf1c7-8c8a-44a7-b82f-25fa11446c1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=55bd92ae77a74f99bcf2c4f4e7618910, user_id=e30811e409a6487683bb0cc678e443ec, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:32.996246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bf1c7-8c8a-44a7-b82f-25fa11446c1d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:33.022562 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 815/1624] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:32 2022] PUT /identity/v3/projects/55bd92ae77a74f99bcf2c4f4e7618910/users/e30811e409a6487683bb0cc678e443ec/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:33.023732 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bf1c7-8c8a-44a7-b82f-25fa11446c1d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:33.032552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ec4eb-8f0b-4e66-b7b1-eadec59e9485 service neutron] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:33.172703 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2f898-46ae-47a3-bcd2-cb466df81138 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:33.173359 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2f898-46ae-47a3-bcd2-cb466df81138 service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:33.173359 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2f898-46ae-47a3-bcd2-cb466df81138 service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:33.173579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2f898-46ae-47a3-bcd2-cb466df81138 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:33.175788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bf1c7-8c8a-44a7-b82f-25fa11446c1d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:33.187619 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265ec64-0a00-4c6a-9a7c-d316c064be90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:33.188617 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265ec64-0a00-4c6a-9a7c-d316c064be90 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:33.190203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265ec64-0a00-4c6a-9a7c-d316c064be90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:33.191173 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265ec64-0a00-4c6a-9a7c-d316c064be90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:33.192176 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f265ec64-0a00-4c6a-9a7c-d316c064be90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:33.194571 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f265ec64-0a00-4c6a-9a7c-d316c064be90 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:33.217830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 816/1625] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:33.218891 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265ec64-0a00-4c6a-9a7c-d316c064be90 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:33.231545 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:33.239997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265ec64-0a00-4c6a-9a7c-d316c064be90 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:33.247184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9884e4-88a7-4f46-9347-417762848d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:33.248104 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9884e4-88a7-4f46-9347-417762848d49 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:33.248593 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9884e4-88a7-4f46-9347-417762848d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:33.249094 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9884e4-88a7-4f46-9347-417762848d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:33.250966 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9884e4-88a7-4f46-9347-417762848d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:33.253566 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9884e4-88a7-4f46-9347-417762848d49 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:33.273318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 817/1626] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:33.273318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9884e4-88a7-4f46-9347-417762848d49 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:33.295479 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9884e4-88a7-4f46-9347-417762848d49 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:33.300497 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2f898-46ae-47a3-bcd2-cb466df81138 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:33.301062 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20caa9-ed83-4983-beaf-07eacdf3d801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:33.302118 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20caa9-ed83-4983-beaf-07eacdf3d801 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:33.302706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20caa9-ed83-4983-beaf-07eacdf3d801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:33.302993 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20caa9-ed83-4983-beaf-07eacdf3d801 admin admin] PATH_INFO: `/v3/projects/d54ab549155145178d545b9afa50c715/users/8e1d504ceb9e42dcae2cb6fa7ee1629c/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:33.303294 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2f898-46ae-47a3-bcd2-cb466df81138 service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:33.329438 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 810/1627] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:33.330363 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2f898-46ae-47a3-bcd2-cb466df81138 service nova] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:33.336667 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20caa9-ed83-4983-beaf-07eacdf3d801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54ab549155145178d545b9afa50c715, user_id=8e1d504ceb9e42dcae2cb6fa7ee1629c, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:33.341839 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20caa9-ed83-4983-beaf-07eacdf3d801 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:33.356228 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2f898-46ae-47a3-bcd2-cb466df81138 service nova] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:33.372436 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 818/1628] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:33 2022] PUT /identity/v3/projects/d54ab549155145178d545b9afa50c715/users/8e1d504ceb9e42dcae2cb6fa7ee1629c/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:33.373676 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20caa9-ed83-4983-beaf-07eacdf3d801 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:33.392173 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:33.456200 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25a52f-cc69-4360-a96f-0969b6e0401c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:33.457213 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25a52f-cc69-4360-a96f-0969b6e0401c admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:33.457605 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25a52f-cc69-4360-a96f-0969b6e0401c admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:33.457987 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25a52f-cc69-4360-a96f-0969b6e0401c admin admin] PATH_INFO: `/v3/projects/55bd92ae77a74f99bcf2c4f4e7618910/users/e30811e409a6487683bb0cc678e443ec/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:33.466030 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25a52f-cc69-4360-a96f-0969b6e0401c admin admin] RBAC: Authorizing `identity:create_grant(project_id=55bd92ae77a74f99bcf2c4f4e7618910, user_id=e30811e409a6487683bb0cc678e443ec, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:33.470787 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25a52f-cc69-4360-a96f-0969b6e0401c admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:33.471240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20caa9-ed83-4983-beaf-07eacdf3d801 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:33.476827 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb444e8-ca25-41f0-84f5-5ca304efcaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:33.477787 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb444e8-ca25-41f0-84f5-5ca304efcaca admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:33.478391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb444e8-ca25-41f0-84f5-5ca304efcaca admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:33.478986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb444e8-ca25-41f0-84f5-5ca304efcaca admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:33.480125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb444e8-ca25-41f0-84f5-5ca304efcaca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:33.481975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb444e8-ca25-41f0-84f5-5ca304efcaca admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:33.487248 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 811/1629] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:33 2022] PUT /identity/v3/projects/55bd92ae77a74f99bcf2c4f4e7618910/users/e30811e409a6487683bb0cc678e443ec/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:33.498324 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23ef2b-997d-4753-9cf5-50de8ff47bfb None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:33.498579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23ef2b-997d-4753-9cf5-50de8ff47bfb None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:33.499234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23ef2b-997d-4753-9cf5-50de8ff47bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:33.500148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 819/1630] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:33.501224 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb444e8-ca25-41f0-84f5-5ca304efcaca admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:33.512772 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb444e8-ca25-41f0-84f5-5ca304efcaca admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:33.539009 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-be23ef2b-997d-4753-9cf5-50de8ff47bfb None None] MFA Rules not processed for user `e30811e409a6487683bb0cc678e443ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:33.540546 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-be23ef2b-997d-4753-9cf5-50de8ff47bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:33.583062 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bee17-38f0-4363-8c5d-0f6e7b8ad1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:33.584392 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bee17-38f0-4363-8c5d-0f6e7b8ad1f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:33.584832 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bee17-38f0-4363-8c5d-0f6e7b8ad1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:33.585263 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bee17-38f0-4363-8c5d-0f6e7b8ad1f7 admin admin] PATH_INFO: `/v3/projects/d54ab549155145178d545b9afa50c715/users/8e1d504ceb9e42dcae2cb6fa7ee1629c/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:33.587701 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bee17-38f0-4363-8c5d-0f6e7b8ad1f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54ab549155145178d545b9afa50c715, user_id=8e1d504ceb9e42dcae2cb6fa7ee1629c, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:33.591037 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bee17-38f0-4363-8c5d-0f6e7b8ad1f7 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:33.615167 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 820/1631] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:33 2022] PUT /identity/v3/projects/d54ab549155145178d545b9afa50c715/users/8e1d504ceb9e42dcae2cb6fa7ee1629c/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:33.617611 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf59c2e-fbc9-4e43-b3af-fa01a488e7e1 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:33.618076 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf59c2e-fbc9-4e43-b3af-fa01a488e7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:33.618589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf59c2e-fbc9-4e43-b3af-fa01a488e7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:33.652093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 812/1632] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:33.658316 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-7cf59c2e-fbc9-4e43-b3af-fa01a488e7e1 None None] MFA Rules not processed for user `8e1d504ceb9e42dcae2cb6fa7ee1629c`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:33.659678 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7cf59c2e-fbc9-4e43-b3af-fa01a488e7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:33.660847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23ef2b-997d-4753-9cf5-50de8ff47bfb None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:33.735132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:33.765899 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23ef2b-997d-4753-9cf5-50de8ff47bfb None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:33.780694 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 821/1633] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:33.788198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf59c2e-fbc9-4e43-b3af-fa01a488e7e1 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:33.859664 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e82d98-96f8-4ae3-be31-dca8c452db10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:33.860485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e82d98-96f8-4ae3-be31-dca8c452db10 service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:33.860855 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e82d98-96f8-4ae3-be31-dca8c452db10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:33.861543 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e82d98-96f8-4ae3-be31-dca8c452db10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:33.881924 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:33.973237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf59c2e-fbc9-4e43-b3af-fa01a488e7e1 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:33.978069 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c45809-64a2-4929-b893-ce3fdd6786f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:33.978781 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c45809-64a2-4929-b893-ce3fdd6786f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:33.979069 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c45809-64a2-4929-b893-ce3fdd6786f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:33.979374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c45809-64a2-4929-b893-ce3fdd6786f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:34.006399 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c45809-64a2-4929-b893-ce3fdd6786f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:34.007936 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c45809-64a2-4929-b893-ce3fdd6786f6 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:34.029352 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 822/1634] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:34.040266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e82d98-96f8-4ae3-be31-dca8c452db10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:34.046230 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e82d98-96f8-4ae3-be31-dca8c452db10 service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:34.092505 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 813/1635] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:34.489147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cacef5-fadc-4c86-8233-c8602785675b None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:34.489762 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cacef5-fadc-4c86-8233-c8602785675b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:34.489762 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cacef5-fadc-4c86-8233-c8602785675b None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:34.491144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 823/1636] 10.222.0.79 () {54 vars in 912 bytes} [Thu Jul 14 12:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:08:34.495496 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e82d98-96f8-4ae3-be31-dca8c452db10 service cinder] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:34.501406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defc262-9ede-4085-bd6c-21e70504d3a5 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:34.501702 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defc262-9ede-4085-bd6c-21e70504d3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:34.501982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defc262-9ede-4085-bd6c-21e70504d3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:34.511642 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e82d98-96f8-4ae3-be31-dca8c452db10 service cinder] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:34.535202 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7358e1-40e9-479d-844d-887c0ab2bf6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:34.535885 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7358e1-40e9-479d-844d-887c0ab2bf6f service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:34.536172 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7358e1-40e9-479d-844d-887c0ab2bf6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:34.536457 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7358e1-40e9-479d-844d-887c0ab2bf6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:34.561619 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-2defc262-9ede-4085-bd6c-21e70504d3a5 None None] MFA Rules not processed for user `e41a4d3a822c403fad048764a0edf209`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:34.572734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2defc262-9ede-4085-bd6c-21e70504d3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:34.801253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 824/1637] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Jul 14 12:08:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:34.802167 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2defc262-9ede-4085-bd6c-21e70504d3a5 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:34.816107 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2defc262-9ede-4085-bd6c-21e70504d3a5 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:34.820973 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7358e1-40e9-479d-844d-887c0ab2bf6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:34.825676 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7358e1-40e9-479d-844d-887c0ab2bf6f service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:34.831650 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82af73-9816-4097-a8bf-d72dfa98a41d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:34.832344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82af73-9816-4097-a8bf-d72dfa98a41d service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:34.832644 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82af73-9816-4097-a8bf-d72dfa98a41d service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:34.832891 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82af73-9816-4097-a8bf-d72dfa98a41d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:34.871715 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 814/1638] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:34.883576 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf004c-6bab-4236-a6e2-014bc5cefc4f None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:34.884938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf004c-6bab-4236-a6e2-014bc5cefc4f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:34.886729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf004c-6bab-4236-a6e2-014bc5cefc4f None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:34.893482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 815/1639] 10.222.0.79 () {54 vars in 961 bytes} [Thu Jul 14 12:08:34 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:08:34.897480 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a12de2-e2dc-4e54-adb7-31d258f02423 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:34.901918 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a12de2-e2dc-4e54-adb7-31d258f02423 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:34.902878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a12de2-e2dc-4e54-adb7-31d258f02423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:34.970925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-62a12de2-e2dc-4e54-adb7-31d258f02423 None None] MFA Rules not processed for user `e41a4d3a822c403fad048764a0edf209`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:34.975209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-62a12de2-e2dc-4e54-adb7-31d258f02423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:34.997810 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 816/1640] 10.222.0.79 () {58 vars in 1058 bytes} [Thu Jul 14 12:08:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:35.005387 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6026d-d3ad-481e-96ac-05ab9b0cf262 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:35.005819 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6026d-d3ad-481e-96ac-05ab9b0cf262 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:35.007111 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6026d-d3ad-481e-96ac-05ab9b0cf262 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:35.008041 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 817/1641] 10.222.0.79 () {54 vars in 912 bytes} [Thu Jul 14 12:08:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:08:35.016077 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82af73-9816-4097-a8bf-d72dfa98a41d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:35.016795 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459319f-a115-4b40-b86f-6fa6e650a8f2 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:35.017187 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459319f-a115-4b40-b86f-6fa6e650a8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:35.017730 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82af73-9816-4097-a8bf-d72dfa98a41d service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:35.017852 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459319f-a115-4b40-b86f-6fa6e650a8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:35.044043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 825/1642] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:34 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:35.071290 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-8459319f-a115-4b40-b86f-6fa6e650a8f2 None None] MFA Rules not processed for user `e41a4d3a822c403fad048764a0edf209`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:35.074412 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-8459319f-a115-4b40-b86f-6fa6e650a8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:35.111202 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 818/1643] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Jul 14 12:08:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:08:35.197352 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82af73-9816-4097-a8bf-d72dfa98a41d service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:35.210075 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82af73-9816-4097-a8bf-d72dfa98a41d service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:35.226483 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40906b9-d985-4fb2-ac70-f9d8c155ba58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:35.227419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40906b9-d985-4fb2-ac70-f9d8c155ba58 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:35.227870 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40906b9-d985-4fb2-ac70-f9d8c155ba58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:35.228309 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40906b9-d985-4fb2-ac70-f9d8c155ba58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:35.254686 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40906b9-d985-4fb2-ac70-f9d8c155ba58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:35.256545 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40906b9-d985-4fb2-ac70-f9d8c155ba58 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:35.284890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 826/1644] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:35.420694 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459319f-a115-4b40-b86f-6fa6e650a8f2 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:35.443599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459319f-a115-4b40-b86f-6fa6e650a8f2 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:35.453901 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1c63d-4643-4ba9-9bd7-63b6fec69760 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:35.455644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1c63d-4643-4ba9-9bd7-63b6fec69760 service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:35.455943 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1c63d-4643-4ba9-9bd7-63b6fec69760 service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:35.456230 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1c63d-4643-4ba9-9bd7-63b6fec69760 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:35.481814 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1c63d-4643-4ba9-9bd7-63b6fec69760 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:35.483451 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1c63d-4643-4ba9-9bd7-63b6fec69760 service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:35.502619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 819/1645] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:36.699941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40906b9-d985-4fb2-ac70-f9d8c155ba58 service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:36.708321 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:36.893810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40906b9-d985-4fb2-ac70-f9d8c155ba58 service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:36.910340 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557de143-caa7-440b-87f4-6d8ce460da58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:36.916986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557de143-caa7-440b-87f4-6d8ce460da58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:36.917393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557de143-caa7-440b-87f4-6d8ce460da58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:36.917693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557de143-caa7-440b-87f4-6d8ce460da58 admin admin] PATH_INFO: `/v3/users/6bd225ba6b1547e2ae8778a07cd0ee5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:36.924005 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557de143-caa7-440b-87f4-6d8ce460da58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bd225ba6b1547e2ae8778a07cd0ee5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:36.924854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: WARNING py.warnings [None req-557de143-caa7-440b-87f4-6d8ce460da58 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 12:08:36.924854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: warnings.warn(msg) Jul 14 12:08:36.924854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: Jul 14 12:08:36.933960 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557de143-caa7-440b-87f4-6d8ce460da58 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:37.107709 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-557de143-caa7-440b-87f4-6d8ce460da58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bd225ba6b1547e2ae8778a07cd0ee5f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:37.131824 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-557de143-caa7-440b-87f4-6d8ce460da58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bd225ba6b1547e2ae8778a07cd0ee5f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:37.166219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-557de143-caa7-440b-87f4-6d8ce460da58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bd225ba6b1547e2ae8778a07cd0ee5f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:37.217824 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-557de143-caa7-440b-87f4-6d8ce460da58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bd225ba6b1547e2ae8778a07cd0ee5f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:37.219260 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-557de143-caa7-440b-87f4-6d8ce460da58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bd225ba6b1547e2ae8778a07cd0ee5f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:37.245955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 827/1646] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:08:36 2022] DELETE /identity/v3/users/6bd225ba6b1547e2ae8778a07cd0ee5f => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:37.248803 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d48340-0de2-4bed-ad6c-ad4832317a91 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:37.249305 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d48340-0de2-4bed-ad6c-ad4832317a91 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:37.249390 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d48340-0de2-4bed-ad6c-ad4832317a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:37.282534 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-39d48340-0de2-4bed-ad6c-ad4832317a91 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:37.284471 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-39d48340-0de2-4bed-ad6c-ad4832317a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:37.385900 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 820/1647] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:37.399026 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557de143-caa7-440b-87f4-6d8ce460da58 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:37.400639 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-557de143-caa7-440b-87f4-6d8ce460da58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:37.547798 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557de143-caa7-440b-87f4-6d8ce460da58 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:37.565399 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593dfc7-8fd3-46de-8b92-c1cc560229d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:37.566214 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593dfc7-8fd3-46de-8b92-c1cc560229d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:37.568890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593dfc7-8fd3-46de-8b92-c1cc560229d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:37.568890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593dfc7-8fd3-46de-8b92-c1cc560229d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:37.589594 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593dfc7-8fd3-46de-8b92-c1cc560229d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:37.593243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593dfc7-8fd3-46de-8b92-c1cc560229d0 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:37.612971 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 828/1648] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:40.390385 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d48340-0de2-4bed-ad6c-ad4832317a91 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:40.392445 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-39d48340-0de2-4bed-ad6c-ad4832317a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:40.439018 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d48340-0de2-4bed-ad6c-ad4832317a91 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:40.467288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903baf2a-a575-4361-bcb3-53a4f2905bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:40.468754 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903baf2a-a575-4361-bcb3-53a4f2905bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:40.469047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903baf2a-a575-4361-bcb3-53a4f2905bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:40.469330 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903baf2a-a575-4361-bcb3-53a4f2905bfe admin admin] PATH_INFO: `/v3/projects/6b53cf85732640b385b68268acb9a321` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:40.472115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903baf2a-a575-4361-bcb3-53a4f2905bfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b53cf85732640b385b68268acb9a321)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:40.473211 dv-cinder-848900-3-smb devstack@keystone.service[80165]: WARNING py.warnings [None req-903baf2a-a575-4361-bcb3-53a4f2905bfe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 12:08:40.473211 dv-cinder-848900-3-smb devstack@keystone.service[80165]: warnings.warn(msg) Jul 14 12:08:40.473211 dv-cinder-848900-3-smb devstack@keystone.service[80165]: Jul 14 12:08:40.474462 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903baf2a-a575-4361-bcb3-53a4f2905bfe admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:40.571616 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:40.723791 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-903baf2a-a575-4361-bcb3-53a4f2905bfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b53cf85732640b385b68268acb9a321', 'request_id': 'req-903baf2a-a575-4361-bcb3-53a4f2905bfe'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:40.774749 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-903baf2a-a575-4361-bcb3-53a4f2905bfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b53cf85732640b385b68268acb9a321', 'request_id': 'req-903baf2a-a575-4361-bcb3-53a4f2905bfe'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:40.802830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-903baf2a-a575-4361-bcb3-53a4f2905bfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b53cf85732640b385b68268acb9a321', 'request_id': 'req-903baf2a-a575-4361-bcb3-53a4f2905bfe'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:40.840140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-903baf2a-a575-4361-bcb3-53a4f2905bfe admin admin] The token cache is being invalidate because project 6b53cf85732640b385b68268acb9a321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:08:40.840481 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-903baf2a-a575-4361-bcb3-53a4f2905bfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:40.841988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-903baf2a-a575-4361-bcb3-53a4f2905bfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:40.845046 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 821/1649] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:08:40 2022] DELETE /identity/v3/projects/6b53cf85732640b385b68268acb9a321 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:40.850273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971c8f2-a517-4a99-895d-9c958efbb749 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:40.851232 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971c8f2-a517-4a99-895d-9c958efbb749 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:40.851689 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971c8f2-a517-4a99-895d-9c958efbb749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:40.934736 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-7971c8f2-a517-4a99-895d-9c958efbb749 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:40.937545 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7971c8f2-a517-4a99-895d-9c958efbb749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:41.026389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:41.197481 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808491e6-8803-4ef9-a9ca-e400cccc6f71 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:41.198025 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808491e6-8803-4ef9-a9ca-e400cccc6f71 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:41.198665 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808491e6-8803-4ef9-a9ca-e400cccc6f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:41.203193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 829/1650] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:41.225972 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-808491e6-8803-4ef9-a9ca-e400cccc6f71 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:41.227779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-808491e6-8803-4ef9-a9ca-e400cccc6f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:41.247875 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971c8f2-a517-4a99-895d-9c958efbb749 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:41.255668 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 822/1651] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:41.265128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971c8f2-a517-4a99-895d-9c958efbb749 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:41.289689 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a80ffc-d750-496b-ac1d-7e6a7d673a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:41.290702 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a80ffc-d750-496b-ac1d-7e6a7d673a8a admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:41.291198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a80ffc-d750-496b-ac1d-7e6a7d673a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:41.291752 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a80ffc-d750-496b-ac1d-7e6a7d673a8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:41.292864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a80ffc-d750-496b-ac1d-7e6a7d673a8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:08:41.293637 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a80ffc-d750-496b-ac1d-7e6a7d673a8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:41.303075 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a80ffc-d750-496b-ac1d-7e6a7d673a8a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:41.329877 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 830/1652] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:08:41.334645 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808491e6-8803-4ef9-a9ca-e400cccc6f71 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:41.356732 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808491e6-8803-4ef9-a9ca-e400cccc6f71 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:41.376455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65f576-8145-4d50-99dd-a9874ddb34c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:41.377378 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65f576-8145-4d50-99dd-a9874ddb34c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:41.377671 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65f576-8145-4d50-99dd-a9874ddb34c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:41.378001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65f576-8145-4d50-99dd-a9874ddb34c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:41.378734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65f576-8145-4d50-99dd-a9874ddb34c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:41.380859 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65f576-8145-4d50-99dd-a9874ddb34c2 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:41.431171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 823/1653] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:08:41 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:41.432199 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a80ffc-d750-496b-ac1d-7e6a7d673a8a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:41.448726 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a80ffc-d750-496b-ac1d-7e6a7d673a8a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:41.567777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4eab5-2537-4b21-b391-b1db1fc149d4 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:41.568162 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4eab5-2537-4b21-b391-b1db1fc149d4 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:41.568621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4eab5-2537-4b21-b391-b1db1fc149d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:41.679094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-0bc4eab5-2537-4b21-b391-b1db1fc149d4 None None] MFA Rules not processed for user `651c540ef39e4c3ea316025e55b0208a`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:41.686677 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-0bc4eab5-2537-4b21-b391-b1db1fc149d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:41.688680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e973b-4881-46ad-9962-99070f6bf63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:41.689660 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e973b-4881-46ad-9962-99070f6bf63d admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:41.690863 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e973b-4881-46ad-9962-99070f6bf63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:41.692458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e973b-4881-46ad-9962-99070f6bf63d admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:41.694126 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e973b-4881-46ad-9962-99070f6bf63d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:41.701547 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e973b-4881-46ad-9962-99070f6bf63d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:41.763224 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 831/1654] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:08:41 2022] POST /identity/v3/users => generated 283 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:41.767834 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e973b-4881-46ad-9962-99070f6bf63d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:41.794213 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e973b-4881-46ad-9962-99070f6bf63d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:41.806166 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5ae94-c7cc-4402-a339-7ec6a66b71fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:41.807314 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5ae94-c7cc-4402-a339-7ec6a66b71fb admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:41.807714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5ae94-c7cc-4402-a339-7ec6a66b71fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:41.808166 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5ae94-c7cc-4402-a339-7ec6a66b71fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:41.809081 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5ae94-c7cc-4402-a339-7ec6a66b71fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:41.812719 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5ae94-c7cc-4402-a339-7ec6a66b71fb admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:41.852105 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 832/1655] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:41.855790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5ae94-c7cc-4402-a339-7ec6a66b71fb admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:41.887602 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5ae94-c7cc-4402-a339-7ec6a66b71fb admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:41.904962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bb4f4-56b1-4471-b5b9-351f88c2053e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:41.907105 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bb4f4-56b1-4471-b5b9-351f88c2053e admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:41.907105 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bb4f4-56b1-4471-b5b9-351f88c2053e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:41.907326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bb4f4-56b1-4471-b5b9-351f88c2053e admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:41.908287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3bb4f4-56b1-4471-b5b9-351f88c2053e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:41.914105 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3bb4f4-56b1-4471-b5b9-351f88c2053e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:41.953280 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 833/1656] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:41.957221 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bb4f4-56b1-4471-b5b9-351f88c2053e admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:41.974914 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bb4f4-56b1-4471-b5b9-351f88c2053e admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:42.000292 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a1f67-c370-4b00-ab25-a835f5d40b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:42.002791 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a1f67-c370-4b00-ab25-a835f5d40b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:42.003250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a1f67-c370-4b00-ab25-a835f5d40b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:42.003676 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a1f67-c370-4b00-ab25-a835f5d40b52 admin admin] PATH_INFO: `/v3/projects/0317538dbbbd49d2850d316b01f4374e/users/139644c1510642148d9fe44b89ad6d55/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:42.009380 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 824/1657] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:42.016469 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4eab5-2537-4b21-b391-b1db1fc149d4 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:42.021754 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-0bc4eab5-2537-4b21-b391-b1db1fc149d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:42.051306 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a1f67-c370-4b00-ab25-a835f5d40b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0317538dbbbd49d2850d316b01f4374e, user_id=139644c1510642148d9fe44b89ad6d55, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:42.057144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a1f67-c370-4b00-ab25-a835f5d40b52 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:42.092556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 834/1658] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:41 2022] PUT /identity/v3/projects/0317538dbbbd49d2850d316b01f4374e/users/139644c1510642148d9fe44b89ad6d55/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:08:42.103986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e1303-bc14-4a9c-a649-a94f71b53b5c None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:42.104521 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e1303-bc14-4a9c-a649-a94f71b53b5c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:42.104984 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e1303-bc14-4a9c-a649-a94f71b53b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:42.173360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-4a8e1303-bc14-4a9c-a649-a94f71b53b5c None None] MFA Rules not processed for user `139644c1510642148d9fe44b89ad6d55`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:42.175122 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4a8e1303-bc14-4a9c-a649-a94f71b53b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:42.202634 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4eab5-2537-4b21-b391-b1db1fc149d4 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:42.207289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:42.294024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39eb32-c858-44a8-be3c-5c982ccefb65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:42.295045 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39eb32-c858-44a8-be3c-5c982ccefb65 service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:42.295524 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39eb32-c858-44a8-be3c-5c982ccefb65 service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:42.296993 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39eb32-c858-44a8-be3c-5c982ccefb65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:42.299127 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:42.365743 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 835/1659] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:08:42.371535 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e1303-bc14-4a9c-a649-a94f71b53b5c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:42.388981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39eb32-c858-44a8-be3c-5c982ccefb65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:42.390986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39eb32-c858-44a8-be3c-5c982ccefb65 service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:42.402442 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 825/1660] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:08:42.686725 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e1303-bc14-4a9c-a649-a94f71b53b5c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:42.703968 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c14598-fef1-4fae-ad63-c60505ec3b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:42.704782 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c14598-fef1-4fae-ad63-c60505ec3b11 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:42.705077 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c14598-fef1-4fae-ad63-c60505ec3b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:42.705361 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c14598-fef1-4fae-ad63-c60505ec3b11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:42.706531 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c14598-fef1-4fae-ad63-c60505ec3b11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:42.709976 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c14598-fef1-4fae-ad63-c60505ec3b11 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:42.781861 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 836/1661] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:08:42 2022] POST /identity/v3/projects => generated 363 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:42.787460 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39eb32-c858-44a8-be3c-5c982ccefb65 service nova] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:42.829094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39eb32-c858-44a8-be3c-5c982ccefb65 service nova] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:43.035945 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2720684-0257-4eec-bdb9-c5dfdcd12a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:43.036951 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2720684-0257-4eec-bdb9-c5dfdcd12a5b admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:43.037409 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2720684-0257-4eec-bdb9-c5dfdcd12a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:43.037849 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2720684-0257-4eec-bdb9-c5dfdcd12a5b admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:43.038782 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2720684-0257-4eec-bdb9-c5dfdcd12a5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:43.041904 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2720684-0257-4eec-bdb9-c5dfdcd12a5b admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:43.075279 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 826/1662] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:08:42 2022] POST /identity/v3/users => generated 288 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:08:43.081416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c14598-fef1-4fae-ad63-c60505ec3b11 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:43.099613 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c14598-fef1-4fae-ad63-c60505ec3b11 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:43.107013 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3c96c-5782-472c-b054-d2ea9ec340e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:43.109380 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3c96c-5782-472c-b054-d2ea9ec340e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:43.109990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3c96c-5782-472c-b054-d2ea9ec340e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:43.111513 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3c96c-5782-472c-b054-d2ea9ec340e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:43.112557 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3c96c-5782-472c-b054-d2ea9ec340e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:43.114970 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3c96c-5782-472c-b054-d2ea9ec340e0 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:43.135258 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 837/1663] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:43.139574 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2720684-0257-4eec-bdb9-c5dfdcd12a5b admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:43.158830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2720684-0257-4eec-bdb9-c5dfdcd12a5b admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:43.176139 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c7109-b26e-4025-a9b6-b87905319d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:43.178344 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c7109-b26e-4025-a9b6-b87905319d74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:43.181398 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c7109-b26e-4025-a9b6-b87905319d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:43.181877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c7109-b26e-4025-a9b6-b87905319d74 admin admin] PATH_INFO: `/v3/projects/33883de78e4244b09ffc17debe3cbd6d/users/56f5f70e324c4e21951e30f5fbd4074a/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:43.228401 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c7109-b26e-4025-a9b6-b87905319d74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33883de78e4244b09ffc17debe3cbd6d, user_id=56f5f70e324c4e21951e30f5fbd4074a, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:43.231220 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c7109-b26e-4025-a9b6-b87905319d74 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:43.278287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 827/1664] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:43 2022] PUT /identity/v3/projects/33883de78e4244b09ffc17debe3cbd6d/users/56f5f70e324c4e21951e30f5fbd4074a/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:43.283069 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3c96c-5782-472c-b054-d2ea9ec340e0 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:43.299325 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3c96c-5782-472c-b054-d2ea9ec340e0 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:43.464430 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cb5aa-f00e-4606-a456-8f5cf1b12f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:43.465536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cb5aa-f00e-4606-a456-8f5cf1b12f64 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:43.466047 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cb5aa-f00e-4606-a456-8f5cf1b12f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:43.466896 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cb5aa-f00e-4606-a456-8f5cf1b12f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:43.469862 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3cb5aa-f00e-4606-a456-8f5cf1b12f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:43.472886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3cb5aa-f00e-4606-a456-8f5cf1b12f64 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:43.493881 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c7109-b26e-4025-a9b6-b87905319d74 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:43.504595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 838/1665] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:43.509354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c7109-b26e-4025-a9b6-b87905319d74 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:43.518205 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f4e28-bfc5-4adf-a4a7-23bdd8bca43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:43.519906 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f4e28-bfc5-4adf-a4a7-23bdd8bca43b admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:43.520524 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f4e28-bfc5-4adf-a4a7-23bdd8bca43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:43.521113 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f4e28-bfc5-4adf-a4a7-23bdd8bca43b admin admin] PATH_INFO: `/v3/projects/33883de78e4244b09ffc17debe3cbd6d/users/56f5f70e324c4e21951e30f5fbd4074a/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:43.524632 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f4e28-bfc5-4adf-a4a7-23bdd8bca43b admin admin] RBAC: Authorizing `identity:create_grant(project_id=33883de78e4244b09ffc17debe3cbd6d, user_id=56f5f70e324c4e21951e30f5fbd4074a, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:43.528581 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f4e28-bfc5-4adf-a4a7-23bdd8bca43b admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:43.534190 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:43.558971 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 828/1666] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:43 2022] PUT /identity/v3/projects/33883de78e4244b09ffc17debe3cbd6d/users/56f5f70e324c4e21951e30f5fbd4074a/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:43.563730 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03447b-5d5a-447a-b5ca-cb2368fdf11a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:43.564256 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03447b-5d5a-447a-b5ca-cb2368fdf11a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:43.564660 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03447b-5d5a-447a-b5ca-cb2368fdf11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:43.607198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-4b03447b-5d5a-447a-b5ca-cb2368fdf11a None None] MFA Rules not processed for user `56f5f70e324c4e21951e30f5fbd4074a`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:43.609547 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4b03447b-5d5a-447a-b5ca-cb2368fdf11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:43.753695 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:43.832874 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 839/1667] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:43 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:43.868505 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f4e28-bfc5-4adf-a4a7-23bdd8bca43b admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:43.870320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-d12f4e28-bfc5-4adf-a4a7-23bdd8bca43b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:44.061112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f4e28-bfc5-4adf-a4a7-23bdd8bca43b admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:44.095896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6d6bb-f7fa-46f5-9bda-e092ed731f1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:44.097110 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6d6bb-f7fa-46f5-9bda-e092ed731f1b service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:44.097653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6d6bb-f7fa-46f5-9bda-e092ed731f1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:44.098182 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6d6bb-f7fa-46f5-9bda-e092ed731f1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:44.127339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6d6bb-f7fa-46f5-9bda-e092ed731f1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:44.129122 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6d6bb-f7fa-46f5-9bda-e092ed731f1b service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:44.178888 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 829/1668] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:43 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:44.444149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03447b-5d5a-447a-b5ca-cb2368fdf11a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:44.445746 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4b03447b-5d5a-447a-b5ca-cb2368fdf11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:44.779214 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03447b-5d5a-447a-b5ca-cb2368fdf11a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:44.793782 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438c909-e912-40e2-aeb6-e1be0aff6f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:44.794787 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438c909-e912-40e2-aeb6-e1be0aff6f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:44.795101 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438c909-e912-40e2-aeb6-e1be0aff6f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:44.795355 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438c909-e912-40e2-aeb6-e1be0aff6f56 admin admin] PATH_INFO: `/v3/users/9b8d5e796f5148a6af322d074f592214` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:44.797974 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438c909-e912-40e2-aeb6-e1be0aff6f56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b8d5e796f5148a6af322d074f592214)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:44.804844 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438c909-e912-40e2-aeb6-e1be0aff6f56 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:44.986791 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6438c909-e912-40e2-aeb6-e1be0aff6f56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b8d5e796f5148a6af322d074f592214'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:44.992227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6d6bb-f7fa-46f5-9bda-e092ed731f1b service cinder] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:44.994845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-afe6d6bb-f7fa-46f5-9bda-e092ed731f1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:45.024146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6438c909-e912-40e2-aeb6-e1be0aff6f56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b8d5e796f5148a6af322d074f592214'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:45.057011 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6d6bb-f7fa-46f5-9bda-e092ed731f1b service cinder] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:45.071562 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6438c909-e912-40e2-aeb6-e1be0aff6f56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b8d5e796f5148a6af322d074f592214'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:45.108105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033efaf3-1fc7-4b16-8e75-3d828ecc2db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:45.110990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033efaf3-1fc7-4b16-8e75-3d828ecc2db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:45.111759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033efaf3-1fc7-4b16-8e75-3d828ecc2db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:45.115560 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033efaf3-1fc7-4b16-8e75-3d828ecc2db1 admin admin] PATH_INFO: `/v3/users/6f2882cc891447a69481d67a4021b360` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:45.127309 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033efaf3-1fc7-4b16-8e75-3d828ecc2db1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f2882cc891447a69481d67a4021b360)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:45.137293 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033efaf3-1fc7-4b16-8e75-3d828ecc2db1 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:45.171112 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6438c909-e912-40e2-aeb6-e1be0aff6f56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b8d5e796f5148a6af322d074f592214'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:45.173370 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6438c909-e912-40e2-aeb6-e1be0aff6f56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b8d5e796f5148a6af322d074f592214'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:45.198641 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 840/1669] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:08:44 2022] DELETE /identity/v3/users/9b8d5e796f5148a6af322d074f592214 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:45.203929 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18deb25f-5705-492c-8940-c4a161427706 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:45.207653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18deb25f-5705-492c-8940-c4a161427706 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:45.211021 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18deb25f-5705-492c-8940-c4a161427706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:45.273180 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-18deb25f-5705-492c-8940-c4a161427706 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:45.274902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-18deb25f-5705-492c-8940-c4a161427706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:45.301044 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-033efaf3-1fc7-4b16-8e75-3d828ecc2db1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f2882cc891447a69481d67a4021b360'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:45.323448 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-033efaf3-1fc7-4b16-8e75-3d828ecc2db1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f2882cc891447a69481d67a4021b360'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:45.324724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-033efaf3-1fc7-4b16-8e75-3d828ecc2db1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f2882cc891447a69481d67a4021b360'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:45.361366 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-033efaf3-1fc7-4b16-8e75-3d828ecc2db1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f2882cc891447a69481d67a4021b360'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:45.363015 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-033efaf3-1fc7-4b16-8e75-3d828ecc2db1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f2882cc891447a69481d67a4021b360'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:45.414387 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 830/1670] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:08:44 2022] DELETE /identity/v3/users/6f2882cc891447a69481d67a4021b360 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:08:45.416202 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033efaf3-1fc7-4b16-8e75-3d828ecc2db1 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:45.419567 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-033efaf3-1fc7-4b16-8e75-3d828ecc2db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:45.485744 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 841/1671] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:45.487780 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18deb25f-5705-492c-8940-c4a161427706 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:45.498202 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-18deb25f-5705-492c-8940-c4a161427706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:45.519496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:45.543611 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18deb25f-5705-492c-8940-c4a161427706 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:45.636569 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033efaf3-1fc7-4b16-8e75-3d828ecc2db1 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:45.655062 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c01ef-a41e-4a12-90a7-197a70971320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:45.655785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c01ef-a41e-4a12-90a7-197a70971320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:45.656074 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c01ef-a41e-4a12-90a7-197a70971320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:45.656360 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c01ef-a41e-4a12-90a7-197a70971320 admin admin] PATH_INFO: `/v3/users/139644c1510642148d9fe44b89ad6d55` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:45.660303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c01ef-a41e-4a12-90a7-197a70971320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=139644c1510642148d9fe44b89ad6d55)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:45.662487 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c01ef-a41e-4a12-90a7-197a70971320 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:45.703083 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:45.721277 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3fff1-0952-456d-b283-42a92a75d758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:45.726907 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3fff1-0952-456d-b283-42a92a75d758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:45.727369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3fff1-0952-456d-b283-42a92a75d758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:45.727865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3fff1-0952-456d-b283-42a92a75d758 admin admin] PATH_INFO: `/v3/users/f7ba18e540024876ab02b81a90779fac` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:45.737397 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3fff1-0952-456d-b283-42a92a75d758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7ba18e540024876ab02b81a90779fac)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:45.755069 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3fff1-0952-456d-b283-42a92a75d758 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:45.838463 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-525c01ef-a41e-4a12-90a7-197a70971320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '139644c1510642148d9fe44b89ad6d55'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:45.862712 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-525c01ef-a41e-4a12-90a7-197a70971320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '139644c1510642148d9fe44b89ad6d55'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:45.864799 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-525c01ef-a41e-4a12-90a7-197a70971320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '139644c1510642148d9fe44b89ad6d55'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:45.916292 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-525c01ef-a41e-4a12-90a7-197a70971320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '139644c1510642148d9fe44b89ad6d55'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:45.918773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-525c01ef-a41e-4a12-90a7-197a70971320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '139644c1510642148d9fe44b89ad6d55'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:45.927416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-53e3fff1-0952-456d-b283-42a92a75d758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7ba18e540024876ab02b81a90779fac'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:45.949877 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-53e3fff1-0952-456d-b283-42a92a75d758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7ba18e540024876ab02b81a90779fac'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:45.968527 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 831/1672] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:08:45 2022] DELETE /identity/v3/users/139644c1510642148d9fe44b89ad6d55 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:45.970054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c8be8-a08e-4de8-aea9-651f762b0953 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:45.970355 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c8be8-a08e-4de8-aea9-651f762b0953 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:45.970670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c8be8-a08e-4de8-aea9-651f762b0953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:45.975537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-53e3fff1-0952-456d-b283-42a92a75d758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7ba18e540024876ab02b81a90779fac'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:46.021782 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-53e3fff1-0952-456d-b283-42a92a75d758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7ba18e540024876ab02b81a90779fac'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:46.024149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-53e3fff1-0952-456d-b283-42a92a75d758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7ba18e540024876ab02b81a90779fac'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:46.030661 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-044c8be8-a08e-4de8-aea9-651f762b0953 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:46.035437 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-044c8be8-a08e-4de8-aea9-651f762b0953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:46.037492 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 842/1673] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:08:45 2022] DELETE /identity/v3/users/f7ba18e540024876ab02b81a90779fac => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:46.038203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3fff1-0952-456d-b283-42a92a75d758 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:46.045498 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-53e3fff1-0952-456d-b283-42a92a75d758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:46.191007 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 832/1674] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:46.192750 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7aa469-1b69-40e8-a128-962cbf9bf376 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:46.193309 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7aa469-1b69-40e8-a128-962cbf9bf376 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:46.193801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7aa469-1b69-40e8-a128-962cbf9bf376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:46.209381 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3fff1-0952-456d-b283-42a92a75d758 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:46.215103 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-4e7aa469-1b69-40e8-a128-962cbf9bf376 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:46.225509 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd3695-a15e-441d-b72e-67f5351e98a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:46.226038 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd3695-a15e-441d-b72e-67f5351e98a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:46.226375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-4e7aa469-1b69-40e8-a128-962cbf9bf376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:46.226544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd3695-a15e-441d-b72e-67f5351e98a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:46.226629 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd3695-a15e-441d-b72e-67f5351e98a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:46.234316 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0afd3695-a15e-441d-b72e-67f5351e98a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:46.246655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 833/1675] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:46.248678 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62a5d0-fdc3-4d10-87d6-2160c437e2d2 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:46.249003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62a5d0-fdc3-4d10-87d6-2160c437e2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:46.250085 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62a5d0-fdc3-4d10-87d6-2160c437e2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:46.272105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-2d62a5d0-fdc3-4d10-87d6-2160c437e2d2 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:46.273362 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-2d62a5d0-fdc3-4d10-87d6-2160c437e2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:46.280341 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd3695-a15e-441d-b72e-67f5351e98a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:46.282948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd3695-a15e-441d-b72e-67f5351e98a3 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:46.321413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 834/1676] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:46.324406 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62a5d0-fdc3-4d10-87d6-2160c437e2d2 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:46.324554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 843/1677] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:46.326903 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-2d62a5d0-fdc3-4d10-87d6-2160c437e2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:46.334129 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd3695-a15e-441d-b72e-67f5351e98a3 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:46.336751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0afd3695-a15e-441d-b72e-67f5351e98a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:46.356706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd3695-a15e-441d-b72e-67f5351e98a3 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:46.372609 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62a5d0-fdc3-4d10-87d6-2160c437e2d2 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:46.375529 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c52f51-d8be-4b2d-b06c-3767e8244ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:46.376373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c52f51-d8be-4b2d-b06c-3767e8244ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:46.376668 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c52f51-d8be-4b2d-b06c-3767e8244ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:46.376955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c52f51-d8be-4b2d-b06c-3767e8244ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:46.396036 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275497f-fce9-456c-b5e2-a886d1a668cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:46.398435 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c52f51-d8be-4b2d-b06c-3767e8244ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:46.399932 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c52f51-d8be-4b2d-b06c-3767e8244ed3 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:46.400782 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275497f-fce9-456c-b5e2-a886d1a668cd service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:46.402162 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275497f-fce9-456c-b5e2-a886d1a668cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:46.403033 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275497f-fce9-456c-b5e2-a886d1a668cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:46.437189 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275497f-fce9-456c-b5e2-a886d1a668cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:46.439237 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275497f-fce9-456c-b5e2-a886d1a668cd service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:46.446439 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 844/1678] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:46.447417 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c52f51-d8be-4b2d-b06c-3767e8244ed3 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:46.473787 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 835/1679] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:46.478611 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c52f51-d8be-4b2d-b06c-3767e8244ed3 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:46.488334 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea40ad-9ade-4a0d-b652-25ab7ac9c12f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:46.488997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea40ad-9ade-4a0d-b652-25ab7ac9c12f service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:46.489292 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea40ad-9ade-4a0d-b652-25ab7ac9c12f service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:46.489572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea40ad-9ade-4a0d-b652-25ab7ac9c12f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:46.529601 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea40ad-9ade-4a0d-b652-25ab7ac9c12f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:46.532554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea40ad-9ade-4a0d-b652-25ab7ac9c12f service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:46.563100 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:46.577616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 845/1680] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:47.282551 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4b296-63bf-4c72-b179-5432b48768c9 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:47.283804 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4b296-63bf-4c72-b179-5432b48768c9 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:47.284236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4b296-63bf-4c72-b179-5432b48768c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:47.349799 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-fbf4b296-63bf-4c72-b179-5432b48768c9 None None] MFA Rules not processed for user `5f89347016394f69bde41b3632e94c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:47.351822 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-fbf4b296-63bf-4c72-b179-5432b48768c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:47.491978 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:47.537044 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 836/1681] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:47.558734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea40ad-9ade-4a0d-b652-25ab7ac9c12f service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:47.560318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d8ea40ad-9ade-4a0d-b652-25ab7ac9c12f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:47.717489 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea40ad-9ade-4a0d-b652-25ab7ac9c12f service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:47.725209 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6af15b-b1ec-4808-9592-b5ad8bec97e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:47.726144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6af15b-b1ec-4808-9592-b5ad8bec97e9 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:47.726440 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6af15b-b1ec-4808-9592-b5ad8bec97e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:47.727174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6af15b-b1ec-4808-9592-b5ad8bec97e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:47.745500 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6af15b-b1ec-4808-9592-b5ad8bec97e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:47.758074 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6af15b-b1ec-4808-9592-b5ad8bec97e9 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:47.774464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 846/1682] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:47.860501 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f2300-1a97-4271-afd8-8d2388b85c12 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:47.860900 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f2300-1a97-4271-afd8-8d2388b85c12 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:47.861285 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f2300-1a97-4271-afd8-8d2388b85c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:47.936674 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-8a3f2300-1a97-4271-afd8-8d2388b85c12 None None] MFA Rules not processed for user `5eb3da4d1e5e4a67830767d040e15a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:47.940591 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-8a3f2300-1a97-4271-afd8-8d2388b85c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:47.954461 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6af15b-b1ec-4808-9592-b5ad8bec97e9 service nova] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:47.955990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-fb6af15b-b1ec-4808-9592-b5ad8bec97e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:47.985710 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6af15b-b1ec-4808-9592-b5ad8bec97e9 service nova] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:48.005539 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d20ed6-8ca2-4f28-803b-bc26166e7b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:48.010249 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d20ed6-8ca2-4f28-803b-bc26166e7b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:48.010744 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d20ed6-8ca2-4f28-803b-bc26166e7b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:48.011059 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d20ed6-8ca2-4f28-803b-bc26166e7b04 admin admin] PATH_INFO: `/v3/projects/26ee7083248c437e9424879453ed4334` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:48.017350 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d20ed6-8ca2-4f28-803b-bc26166e7b04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26ee7083248c437e9424879453ed4334)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:48.027886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d20ed6-8ca2-4f28-803b-bc26166e7b04 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:48.136976 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 837/1683] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:48.154958 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f2300-1a97-4271-afd8-8d2388b85c12 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:48.157512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-8a3f2300-1a97-4271-afd8-8d2388b85c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:48.181819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-28d20ed6-8ca2-4f28-803b-bc26166e7b04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26ee7083248c437e9424879453ed4334', 'request_id': 'req-28d20ed6-8ca2-4f28-803b-bc26166e7b04'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:48.185511 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f2300-1a97-4271-afd8-8d2388b85c12 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:48.225818 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-28d20ed6-8ca2-4f28-803b-bc26166e7b04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26ee7083248c437e9424879453ed4334', 'request_id': 'req-28d20ed6-8ca2-4f28-803b-bc26166e7b04'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:48.256288 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-28d20ed6-8ca2-4f28-803b-bc26166e7b04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26ee7083248c437e9424879453ed4334', 'request_id': 'req-28d20ed6-8ca2-4f28-803b-bc26166e7b04'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:48.289080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-28d20ed6-8ca2-4f28-803b-bc26166e7b04 admin admin] The token cache is being invalidate because project 26ee7083248c437e9424879453ed4334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:08:48.289918 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-28d20ed6-8ca2-4f28-803b-bc26166e7b04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:48.290824 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-28d20ed6-8ca2-4f28-803b-bc26166e7b04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:48.293342 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 847/1684] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:08:47 2022] DELETE /identity/v3/projects/26ee7083248c437e9424879453ed4334 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:48.294402 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d20ed6-8ca2-4f28-803b-bc26166e7b04 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:48.297978 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-28d20ed6-8ca2-4f28-803b-bc26166e7b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:48.407147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddb5cd-0359-42b8-bd18-870c9443a0dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:48.408180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddb5cd-0359-42b8-bd18-870c9443a0dd service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:48.408581 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddb5cd-0359-42b8-bd18-870c9443a0dd service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:48.408894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddb5cd-0359-42b8-bd18-870c9443a0dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:48.411252 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-8dddb5cd-0359-42b8-bd18-870c9443a0dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:48.453213 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d20ed6-8ca2-4f28-803b-bc26166e7b04 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:48.470184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c1b5c-a8ea-4a93-8290-2a31bb309022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:48.470958 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c1b5c-a8ea-4a93-8290-2a31bb309022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:48.471252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c1b5c-a8ea-4a93-8290-2a31bb309022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:48.471867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c1b5c-a8ea-4a93-8290-2a31bb309022 admin admin] PATH_INFO: `/v3/projects/c40ec37e2942453f941acb2add042451` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:48.477011 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c1b5c-a8ea-4a93-8290-2a31bb309022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c40ec37e2942453f941acb2add042451)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:48.479266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c1b5c-a8ea-4a93-8290-2a31bb309022 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:48.498369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:48.585344 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddb5cd-0359-42b8-bd18-870c9443a0dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:48.590629 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddb5cd-0359-42b8-bd18-870c9443a0dd service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:48.591865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-010c1b5c-a8ea-4a93-8290-2a31bb309022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c40ec37e2942453f941acb2add042451', 'request_id': 'req-010c1b5c-a8ea-4a93-8290-2a31bb309022'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:48.607552 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-010c1b5c-a8ea-4a93-8290-2a31bb309022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c40ec37e2942453f941acb2add042451', 'request_id': 'req-010c1b5c-a8ea-4a93-8290-2a31bb309022'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:48.614802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-010c1b5c-a8ea-4a93-8290-2a31bb309022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c40ec37e2942453f941acb2add042451', 'request_id': 'req-010c1b5c-a8ea-4a93-8290-2a31bb309022'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:48.619229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 838/1685] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:48.621804 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddb5cd-0359-42b8-bd18-870c9443a0dd service nova] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:48.627183 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-8dddb5cd-0359-42b8-bd18-870c9443a0dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:48.638119 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-010c1b5c-a8ea-4a93-8290-2a31bb309022 admin admin] The token cache is being invalidate because project c40ec37e2942453f941acb2add042451 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:08:48.638119 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-010c1b5c-a8ea-4a93-8290-2a31bb309022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:48.643027 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-010c1b5c-a8ea-4a93-8290-2a31bb309022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:48.644820 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 848/1686] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:08:48 2022] DELETE /identity/v3/projects/c40ec37e2942453f941acb2add042451 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:48.649229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c1b5c-a8ea-4a93-8290-2a31bb309022 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:48.657592 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-010c1b5c-a8ea-4a93-8290-2a31bb309022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:48.668419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddb5cd-0359-42b8-bd18-870c9443a0dd service nova] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:48.724019 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:48.808832 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c1b5c-a8ea-4a93-8290-2a31bb309022 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:48.832111 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e6382-7d22-492a-bc10-663c7ea52bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:48.833531 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e6382-7d22-492a-bc10-663c7ea52bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:48.833951 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e6382-7d22-492a-bc10-663c7ea52bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:48.834327 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e6382-7d22-492a-bc10-663c7ea52bcb admin admin] PATH_INFO: `/v3/projects/0317538dbbbd49d2850d316b01f4374e` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:48.836522 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e6382-7d22-492a-bc10-663c7ea52bcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0317538dbbbd49d2850d316b01f4374e)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:48.838821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e6382-7d22-492a-bc10-663c7ea52bcb admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:48.841437 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bf28d-0197-4c30-9f15-230c6854685f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:48.844027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bf28d-0197-4c30-9f15-230c6854685f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:48.845529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bf28d-0197-4c30-9f15-230c6854685f admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:48.845887 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bf28d-0197-4c30-9f15-230c6854685f admin admin] PATH_INFO: `/v3/users/8e1d504ceb9e42dcae2cb6fa7ee1629c` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:48.849357 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122bf28d-0197-4c30-9f15-230c6854685f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e1d504ceb9e42dcae2cb6fa7ee1629c)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:48.856682 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122bf28d-0197-4c30-9f15-230c6854685f admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:48.989764 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4f6e6382-7d22-492a-bc10-663c7ea52bcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0317538dbbbd49d2850d316b01f4374e', 'request_id': 'req-4f6e6382-7d22-492a-bc10-663c7ea52bcb'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:49.000107 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-122bf28d-0197-4c30-9f15-230c6854685f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e1d504ceb9e42dcae2cb6fa7ee1629c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:49.011277 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4f6e6382-7d22-492a-bc10-663c7ea52bcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0317538dbbbd49d2850d316b01f4374e', 'request_id': 'req-4f6e6382-7d22-492a-bc10-663c7ea52bcb'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:49.021812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-122bf28d-0197-4c30-9f15-230c6854685f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e1d504ceb9e42dcae2cb6fa7ee1629c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:49.022525 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-122bf28d-0197-4c30-9f15-230c6854685f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e1d504ceb9e42dcae2cb6fa7ee1629c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:49.025631 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4f6e6382-7d22-492a-bc10-663c7ea52bcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0317538dbbbd49d2850d316b01f4374e', 'request_id': 'req-4f6e6382-7d22-492a-bc10-663c7ea52bcb'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:49.053359 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-122bf28d-0197-4c30-9f15-230c6854685f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e1d504ceb9e42dcae2cb6fa7ee1629c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:49.056938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-122bf28d-0197-4c30-9f15-230c6854685f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e1d504ceb9e42dcae2cb6fa7ee1629c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:49.059294 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4f6e6382-7d22-492a-bc10-663c7ea52bcb admin admin] The token cache is being invalidate because project 0317538dbbbd49d2850d316b01f4374e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:08:49.060305 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4f6e6382-7d22-492a-bc10-663c7ea52bcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:49.062381 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4f6e6382-7d22-492a-bc10-663c7ea52bcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:49.068587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 849/1687] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:08:48 2022] DELETE /identity/v3/projects/0317538dbbbd49d2850d316b01f4374e => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:49.070400 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb55555-e1ff-46bc-b10c-bd0f32280f08 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:49.070777 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb55555-e1ff-46bc-b10c-bd0f32280f08 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:49.071704 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb55555-e1ff-46bc-b10c-bd0f32280f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:49.091292 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 839/1688] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:08:48 2022] DELETE /identity/v3/users/8e1d504ceb9e42dcae2cb6fa7ee1629c => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:49.092246 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bf28d-0197-4c30-9f15-230c6854685f admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:49.099326 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-122bf28d-0197-4c30-9f15-230c6854685f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:49.130324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ffb55555-e1ff-46bc-b10c-bd0f32280f08 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:49.131845 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ffb55555-e1ff-46bc-b10c-bd0f32280f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:49.185801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:49.293447 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 850/1689] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:49.294812 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb55555-e1ff-46bc-b10c-bd0f32280f08 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:49.297666 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ffb55555-e1ff-46bc-b10c-bd0f32280f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:49.298299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bf28d-0197-4c30-9f15-230c6854685f admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:49.313066 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4357a-50cf-422c-bf00-73b96cf32a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:49.313705 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb55555-e1ff-46bc-b10c-bd0f32280f08 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:49.314017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4357a-50cf-422c-bf00-73b96cf32a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:49.314308 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4357a-50cf-422c-bf00-73b96cf32a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:49.316782 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4357a-50cf-422c-bf00-73b96cf32a7d admin admin] PATH_INFO: `/v3/users/56f5f70e324c4e21951e30f5fbd4074a` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:49.322784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4357a-50cf-422c-bf00-73b96cf32a7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=56f5f70e324c4e21951e30f5fbd4074a)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:49.323427 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4357a-50cf-422c-bf00-73b96cf32a7d admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:49.337312 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00ed54-395a-4ac2-a5f8-2c2f93ad7fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:49.346945 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00ed54-395a-4ac2-a5f8-2c2f93ad7fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:49.347478 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00ed54-395a-4ac2-a5f8-2c2f93ad7fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:49.347961 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00ed54-395a-4ac2-a5f8-2c2f93ad7fa3 admin admin] PATH_INFO: `/v3/projects/65ba72075cbc43ea8ef36b08f0754d3a` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:49.352110 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00ed54-395a-4ac2-a5f8-2c2f93ad7fa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65ba72075cbc43ea8ef36b08f0754d3a)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:49.365995 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00ed54-395a-4ac2-a5f8-2c2f93ad7fa3 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:49.433133 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:49.447815 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-8aa4357a-50cf-422c-bf00-73b96cf32a7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56f5f70e324c4e21951e30f5fbd4074a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:49.467375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-8aa4357a-50cf-422c-bf00-73b96cf32a7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56f5f70e324c4e21951e30f5fbd4074a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:49.482098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-8aa4357a-50cf-422c-bf00-73b96cf32a7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56f5f70e324c4e21951e30f5fbd4074a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:49.523215 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-8aa4357a-50cf-422c-bf00-73b96cf32a7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56f5f70e324c4e21951e30f5fbd4074a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:49.524051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-8aa4357a-50cf-422c-bf00-73b96cf32a7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56f5f70e324c4e21951e30f5fbd4074a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:49.530223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7b00ed54-395a-4ac2-a5f8-2c2f93ad7fa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65ba72075cbc43ea8ef36b08f0754d3a', 'request_id': 'req-7b00ed54-395a-4ac2-a5f8-2c2f93ad7fa3'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:49.553813 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7b00ed54-395a-4ac2-a5f8-2c2f93ad7fa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65ba72075cbc43ea8ef36b08f0754d3a', 'request_id': 'req-7b00ed54-395a-4ac2-a5f8-2c2f93ad7fa3'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:49.562142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 840/1690] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:08:49 2022] DELETE /identity/v3/users/56f5f70e324c4e21951e30f5fbd4074a => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:49.562142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8736fc-69bf-479d-a730-32de7976142e None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:49.562431 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8736fc-69bf-479d-a730-32de7976142e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:49.562734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8736fc-69bf-479d-a730-32de7976142e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:49.567811 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7b00ed54-395a-4ac2-a5f8-2c2f93ad7fa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65ba72075cbc43ea8ef36b08f0754d3a', 'request_id': 'req-7b00ed54-395a-4ac2-a5f8-2c2f93ad7fa3'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:49.596026 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7b00ed54-395a-4ac2-a5f8-2c2f93ad7fa3 admin admin] The token cache is being invalidate because project 65ba72075cbc43ea8ef36b08f0754d3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:08:49.596603 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7b00ed54-395a-4ac2-a5f8-2c2f93ad7fa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:49.597872 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7b00ed54-395a-4ac2-a5f8-2c2f93ad7fa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:49.598771 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-7a8736fc-69bf-479d-a730-32de7976142e None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:49.600968 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 851/1691] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:08:49 2022] DELETE /identity/v3/projects/65ba72075cbc43ea8ef36b08f0754d3a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:49.601532 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-7a8736fc-69bf-479d-a730-32de7976142e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:49.606310 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00ed54-395a-4ac2-a5f8-2c2f93ad7fa3 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:49.609966 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7b00ed54-395a-4ac2-a5f8-2c2f93ad7fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:49.762051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00ed54-395a-4ac2-a5f8-2c2f93ad7fa3 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:49.838485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 841/1692] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:49.844699 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8736fc-69bf-479d-a730-32de7976142e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:49.855342 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:49.865688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d9138-7e21-4445-a455-b7e6727612fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:49.866866 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d9138-7e21-4445-a455-b7e6727612fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:49.867154 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d9138-7e21-4445-a455-b7e6727612fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:49.867414 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d9138-7e21-4445-a455-b7e6727612fe admin admin] PATH_INFO: `/v3/users/e30811e409a6487683bb0cc678e443ec` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:49.869232 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d9138-7e21-4445-a455-b7e6727612fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=e30811e409a6487683bb0cc678e443ec)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:49.871364 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d9138-7e21-4445-a455-b7e6727612fe admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:49.884604 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8736fc-69bf-479d-a730-32de7976142e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:49.896806 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe353b-ef44-4363-8d29-9875eb44b9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:49.899203 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe353b-ef44-4363-8d29-9875eb44b9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:49.910787 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe353b-ef44-4363-8d29-9875eb44b9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:49.911246 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe353b-ef44-4363-8d29-9875eb44b9a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:49.912792 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe353b-ef44-4363-8d29-9875eb44b9a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:08:49.918677 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe353b-ef44-4363-8d29-9875eb44b9a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:49.920541 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe353b-ef44-4363-8d29-9875eb44b9a7 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:49.945808 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 842/1693] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:08:49.950199 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe353b-ef44-4363-8d29-9875eb44b9a7 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:49.980102 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe353b-ef44-4363-8d29-9875eb44b9a7 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:49.999962 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27faabce-52a2-4f77-9586-e4d69f58d910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:50.000784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27faabce-52a2-4f77-9586-e4d69f58d910 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:50.001217 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27faabce-52a2-4f77-9586-e4d69f58d910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:50.001718 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27faabce-52a2-4f77-9586-e4d69f58d910 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:50.002478 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27faabce-52a2-4f77-9586-e4d69f58d910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:50.003746 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c94d9138-7e21-4445-a455-b7e6727612fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e30811e409a6487683bb0cc678e443ec'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:50.009016 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27faabce-52a2-4f77-9586-e4d69f58d910 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:50.024963 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c94d9138-7e21-4445-a455-b7e6727612fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e30811e409a6487683bb0cc678e443ec'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:50.057996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c94d9138-7e21-4445-a455-b7e6727612fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e30811e409a6487683bb0cc678e443ec'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:50.080211 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 843/1694] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:08:49 2022] POST /identity/v3/projects => generated 405 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:50.080211 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f9b11-54a6-4a3c-8c33-f32db573fad2 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:50.080211 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f9b11-54a6-4a3c-8c33-f32db573fad2 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:50.082045 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f9b11-54a6-4a3c-8c33-f32db573fad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:50.096048 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c94d9138-7e21-4445-a455-b7e6727612fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e30811e409a6487683bb0cc678e443ec'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:50.096813 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c94d9138-7e21-4445-a455-b7e6727612fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e30811e409a6487683bb0cc678e443ec'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:50.129136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 852/1695] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:08:49 2022] DELETE /identity/v3/users/e30811e409a6487683bb0cc678e443ec => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:50.130636 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d9138-7e21-4445-a455-b7e6727612fe admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:50.133202 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c94d9138-7e21-4445-a455-b7e6727612fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:50.133705 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-cf9f9b11-54a6-4a3c-8c33-f32db573fad2 None None] MFA Rules not processed for user `651c540ef39e4c3ea316025e55b0208a`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:50.138432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-cf9f9b11-54a6-4a3c-8c33-f32db573fad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:50.288618 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 844/1696] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:50.307443 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d9138-7e21-4445-a455-b7e6727612fe admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:50.325429 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515329dc-56bf-4338-beef-f7e2aaab81c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:50.326327 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515329dc-56bf-4338-beef-f7e2aaab81c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:50.326654 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515329dc-56bf-4338-beef-f7e2aaab81c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:50.327011 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515329dc-56bf-4338-beef-f7e2aaab81c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:50.328801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515329dc-56bf-4338-beef-f7e2aaab81c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:50.335029 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515329dc-56bf-4338-beef-f7e2aaab81c2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:50.435487 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 853/1697] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:08:50 2022] POST /identity/v3/users => generated 303 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:50.438071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f9b11-54a6-4a3c-8c33-f32db573fad2 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:50.462070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f9b11-54a6-4a3c-8c33-f32db573fad2 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:50.485693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef4d82-0de7-4dbe-8f8c-d2d716768d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:50.486408 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef4d82-0de7-4dbe-8f8c-d2d716768d59 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:50.486789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef4d82-0de7-4dbe-8f8c-d2d716768d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:50.487104 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef4d82-0de7-4dbe-8f8c-d2d716768d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:50.487745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef4d82-0de7-4dbe-8f8c-d2d716768d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:50.489420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef4d82-0de7-4dbe-8f8c-d2d716768d59 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:50.551094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 845/1698] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:50.557083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515329dc-56bf-4338-beef-f7e2aaab81c2 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:50.574161 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515329dc-56bf-4338-beef-f7e2aaab81c2 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:50.594148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741b94f-8944-4948-b80d-f6ffbd60f9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:50.594894 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741b94f-8944-4948-b80d-f6ffbd60f9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:50.595220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741b94f-8944-4948-b80d-f6ffbd60f9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:50.595546 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741b94f-8944-4948-b80d-f6ffbd60f9a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:50.596307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741b94f-8944-4948-b80d-f6ffbd60f9a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:50.598100 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741b94f-8944-4948-b80d-f6ffbd60f9a8 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:50.622052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 854/1699] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:50.624015 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef4d82-0de7-4dbe-8f8c-d2d716768d59 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:50.644945 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef4d82-0de7-4dbe-8f8c-d2d716768d59 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:50.669764 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8c24a-1ac4-4afd-bf69-7d23be20ef62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:50.671484 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8c24a-1ac4-4afd-bf69-7d23be20ef62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:50.671780 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8c24a-1ac4-4afd-bf69-7d23be20ef62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:50.672069 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8c24a-1ac4-4afd-bf69-7d23be20ef62 admin admin] PATH_INFO: `/v3/projects/76a36dd094284d0bb9c131ffbbd9540d/users/3bbfece64cb94565b1a733ae486a4635/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:50.706908 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8c24a-1ac4-4afd-bf69-7d23be20ef62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76a36dd094284d0bb9c131ffbbd9540d, user_id=3bbfece64cb94565b1a733ae486a4635, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:50.714704 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8c24a-1ac4-4afd-bf69-7d23be20ef62 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:50.733337 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:50.759372 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 846/1700] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:50 2022] PUT /identity/v3/projects/76a36dd094284d0bb9c131ffbbd9540d/users/3bbfece64cb94565b1a733ae486a4635/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:50.762022 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8753a-1b31-4bd4-a179-a1b6d322481e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:50.762350 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8753a-1b31-4bd4-a179-a1b6d322481e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:50.762693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8753a-1b31-4bd4-a179-a1b6d322481e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:50.807681 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f5c8753a-1b31-4bd4-a179-a1b6d322481e None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:50.813261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f5c8753a-1b31-4bd4-a179-a1b6d322481e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:50.988695 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:51.020339 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 855/1701] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:51.155385 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8c24a-1ac4-4afd-bf69-7d23be20ef62 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:51.157399 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-f3c8c24a-1ac4-4afd-bf69-7d23be20ef62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:51.321676 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8c24a-1ac4-4afd-bf69-7d23be20ef62 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:51.336380 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592b709-0c02-44c2-99e0-ec8284a35c65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:51.337071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592b709-0c02-44c2-99e0-ec8284a35c65 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:51.337426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592b709-0c02-44c2-99e0-ec8284a35c65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:51.337644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592b709-0c02-44c2-99e0-ec8284a35c65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:51.367816 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592b709-0c02-44c2-99e0-ec8284a35c65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:51.371979 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592b709-0c02-44c2-99e0-ec8284a35c65 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:51.400219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 847/1702] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:51.777675 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a06fa-05a8-4984-ad4c-a8fefa8743a4 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:51.778188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a06fa-05a8-4984-ad4c-a8fefa8743a4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:51.778188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a06fa-05a8-4984-ad4c-a8fefa8743a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:51.851534 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d02ea-e192-4a8c-8566-50cc6d4f6b4d None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:51.852479 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d02ea-e192-4a8c-8566-50cc6d4f6b4d None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:51.852986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d02ea-e192-4a8c-8566-50cc6d4f6b4d None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:51.856508 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 848/1703] 10.222.0.79 () {54 vars in 912 bytes} [Thu Jul 14 12:08:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:08:51.861911 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98fc12-a172-4460-b3df-352988dd90c9 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:51.862930 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98fc12-a172-4460-b3df-352988dd90c9 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:51.863703 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98fc12-a172-4460-b3df-352988dd90c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:51.867808 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-890a06fa-05a8-4984-ad4c-a8fefa8743a4 None None] MFA Rules not processed for user `8445dcc0f7e942cf8a6a36c750653312`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:51.874613 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-890a06fa-05a8-4984-ad4c-a8fefa8743a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:52.074091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-1a98fc12-a172-4460-b3df-352988dd90c9 None None] MFA Rules not processed for user `2fedd4e015384379bf41c2e01ecc0a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:52.076661 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-1a98fc12-a172-4460-b3df-352988dd90c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:52.087986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 849/1704] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Jul 14 12:08:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:08:52.089069 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98fc12-a172-4460-b3df-352988dd90c9 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:52.091140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-1a98fc12-a172-4460-b3df-352988dd90c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:52.140923 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98fc12-a172-4460-b3df-352988dd90c9 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:52.153827 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc338b-e6ae-48cb-9b27-9ef394da5a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:52.155677 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc338b-e6ae-48cb-9b27-9ef394da5a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:52.155828 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc338b-e6ae-48cb-9b27-9ef394da5a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:52.156109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc338b-e6ae-48cb-9b27-9ef394da5a79 admin admin] PATH_INFO: `/v3/projects/33883de78e4244b09ffc17debe3cbd6d` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:52.160729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc338b-e6ae-48cb-9b27-9ef394da5a79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33883de78e4244b09ffc17debe3cbd6d)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:52.166066 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc338b-e6ae-48cb-9b27-9ef394da5a79 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:52.201617 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 856/1705] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:52.201617 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a06fa-05a8-4984-ad4c-a8fefa8743a4 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:52.225559 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a06fa-05a8-4984-ad4c-a8fefa8743a4 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:52.234943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e3d0c-2363-462f-853c-946aa7076a88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:52.236638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e3d0c-2363-462f-853c-946aa7076a88 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:52.237419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e3d0c-2363-462f-853c-946aa7076a88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:52.237715 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e3d0c-2363-462f-853c-946aa7076a88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:52.280656 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e3d0c-2363-462f-853c-946aa7076a88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:52.282193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e3d0c-2363-462f-853c-946aa7076a88 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:52.311097 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 857/1706] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:52.315624 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ff916-ea7d-4341-9660-1f398981b830 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:52.316373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ff916-ea7d-4341-9660-1f398981b830 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:52.316657 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ff916-ea7d-4341-9660-1f398981b830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:52.325111 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-bacc338b-e6ae-48cb-9b27-9ef394da5a79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33883de78e4244b09ffc17debe3cbd6d', 'request_id': 'req-bacc338b-e6ae-48cb-9b27-9ef394da5a79'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:52.347174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-bacc338b-e6ae-48cb-9b27-9ef394da5a79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33883de78e4244b09ffc17debe3cbd6d', 'request_id': 'req-bacc338b-e6ae-48cb-9b27-9ef394da5a79'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:52.367338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-bacc338b-e6ae-48cb-9b27-9ef394da5a79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33883de78e4244b09ffc17debe3cbd6d', 'request_id': 'req-bacc338b-e6ae-48cb-9b27-9ef394da5a79'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:52.370532 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e52ff916-ea7d-4341-9660-1f398981b830 None None] MFA Rules not processed for user `8445dcc0f7e942cf8a6a36c750653312`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:52.372708 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e52ff916-ea7d-4341-9660-1f398981b830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:52.396608 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-bacc338b-e6ae-48cb-9b27-9ef394da5a79 admin admin] The token cache is being invalidate because project 33883de78e4244b09ffc17debe3cbd6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:08:52.398256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-bacc338b-e6ae-48cb-9b27-9ef394da5a79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:52.399095 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-bacc338b-e6ae-48cb-9b27-9ef394da5a79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:52.407208 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 850/1707] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:08:52 2022] DELETE /identity/v3/projects/33883de78e4244b09ffc17debe3cbd6d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:52.408941 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d8863-0559-4c11-8f94-434b3ac9d659 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:52.410397 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d8863-0559-4c11-8f94-434b3ac9d659 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:52.410789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d8863-0559-4c11-8f94-434b3ac9d659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:52.454079 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-0e7d8863-0559-4c11-8f94-434b3ac9d659 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:52.456400 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-0e7d8863-0559-4c11-8f94-434b3ac9d659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:52.525454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 858/1708] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:52.525454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ff916-ea7d-4341-9660-1f398981b830 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:52.534685 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e52ff916-ea7d-4341-9660-1f398981b830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:52.593544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:52.643542 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 851/1709] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:52.645076 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d8863-0559-4c11-8f94-434b3ac9d659 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:52.655986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-0e7d8863-0559-4c11-8f94-434b3ac9d659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:52.657003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ff916-ea7d-4341-9660-1f398981b830 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:52.670012 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624d469-8628-46c0-ae75-bbad4e9b4f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:52.675144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624d469-8628-46c0-ae75-bbad4e9b4f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:52.676670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624d469-8628-46c0-ae75-bbad4e9b4f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:52.678582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624d469-8628-46c0-ae75-bbad4e9b4f28 admin admin] PATH_INFO: `/v3/projects/d54ab549155145178d545b9afa50c715` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:52.681020 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624d469-8628-46c0-ae75-bbad4e9b4f28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d54ab549155145178d545b9afa50c715)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:52.685206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624d469-8628-46c0-ae75-bbad4e9b4f28 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:52.740486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:52.784022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d8863-0559-4c11-8f94-434b3ac9d659 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:52.794271 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0624d469-8628-46c0-ae75-bbad4e9b4f28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd54ab549155145178d545b9afa50c715', 'request_id': 'req-0624d469-8628-46c0-ae75-bbad4e9b4f28'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:52.807452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0624d469-8628-46c0-ae75-bbad4e9b4f28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd54ab549155145178d545b9afa50c715', 'request_id': 'req-0624d469-8628-46c0-ae75-bbad4e9b4f28'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:52.821952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0624d469-8628-46c0-ae75-bbad4e9b4f28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd54ab549155145178d545b9afa50c715', 'request_id': 'req-0624d469-8628-46c0-ae75-bbad4e9b4f28'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:52.843927 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0624d469-8628-46c0-ae75-bbad4e9b4f28 admin admin] The token cache is being invalidate because project d54ab549155145178d545b9afa50c715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:08:52.844762 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0624d469-8628-46c0-ae75-bbad4e9b4f28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:52.846096 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0624d469-8628-46c0-ae75-bbad4e9b4f28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:52.851079 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 859/1710] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:08:52 2022] DELETE /identity/v3/projects/d54ab549155145178d545b9afa50c715 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:52.860699 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e411e91-851f-4efa-8076-e02cbdc72f86 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:52.861154 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e411e91-851f-4efa-8076-e02cbdc72f86 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:52.861628 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e411e91-851f-4efa-8076-e02cbdc72f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:52.872254 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d09da-ba71-42a8-9568-b535042cef82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:52.872839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d09da-ba71-42a8-9568-b535042cef82 service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:52.872839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d09da-ba71-42a8-9568-b535042cef82 service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:52.873168 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d09da-ba71-42a8-9568-b535042cef82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:52.877340 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5d0d09da-ba71-42a8-9568-b535042cef82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:52.908102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-1e411e91-851f-4efa-8076-e02cbdc72f86 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:52.918306 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1e411e91-851f-4efa-8076-e02cbdc72f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:52.964033 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d09da-ba71-42a8-9568-b535042cef82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:52.965786 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d09da-ba71-42a8-9568-b535042cef82 service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:52.987932 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 852/1711] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:52.988789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d09da-ba71-42a8-9568-b535042cef82 service nova] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:52.992100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5d0d09da-ba71-42a8-9568-b535042cef82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:53.057298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:53.109334 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d09da-ba71-42a8-9568-b535042cef82 service nova] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:53.113250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 860/1712] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:53.115192 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8b703-99cd-4cf3-80b4-d2b7c7cf2f63 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:53.115568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8b703-99cd-4cf3-80b4-d2b7c7cf2f63 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:53.116149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8b703-99cd-4cf3-80b4-d2b7c7cf2f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:53.116269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ebda2-65e2-4e78-923c-dc7ffc8d2061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:53.125263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ebda2-65e2-4e78-923c-dc7ffc8d2061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:53.125922 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ebda2-65e2-4e78-923c-dc7ffc8d2061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:53.126365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ebda2-65e2-4e78-923c-dc7ffc8d2061 admin admin] PATH_INFO: `/v3/projects/55bd92ae77a74f99bcf2c4f4e7618910` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:53.128908 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ebda2-65e2-4e78-923c-dc7ffc8d2061 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55bd92ae77a74f99bcf2c4f4e7618910)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:53.131661 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ebda2-65e2-4e78-923c-dc7ffc8d2061 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:53.158662 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-aab8b703-99cd-4cf3-80b4-d2b7c7cf2f63 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:53.160187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-aab8b703-99cd-4cf3-80b4-d2b7c7cf2f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:53.184955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 861/1713] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:53.196332 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8b703-99cd-4cf3-80b4-d2b7c7cf2f63 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:53.211769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8b703-99cd-4cf3-80b4-d2b7c7cf2f63 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:53.275177 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-bb4ebda2-65e2-4e78-923c-dc7ffc8d2061 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55bd92ae77a74f99bcf2c4f4e7618910', 'request_id': 'req-bb4ebda2-65e2-4e78-923c-dc7ffc8d2061'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:53.286139 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-bb4ebda2-65e2-4e78-923c-dc7ffc8d2061 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55bd92ae77a74f99bcf2c4f4e7618910', 'request_id': 'req-bb4ebda2-65e2-4e78-923c-dc7ffc8d2061'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:53.303172 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-bb4ebda2-65e2-4e78-923c-dc7ffc8d2061 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55bd92ae77a74f99bcf2c4f4e7618910', 'request_id': 'req-bb4ebda2-65e2-4e78-923c-dc7ffc8d2061'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:53.356092 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-bb4ebda2-65e2-4e78-923c-dc7ffc8d2061 admin admin] The token cache is being invalidate because project 55bd92ae77a74f99bcf2c4f4e7618910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:08:53.356685 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-bb4ebda2-65e2-4e78-923c-dc7ffc8d2061 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:53.367128 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-bb4ebda2-65e2-4e78-923c-dc7ffc8d2061 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:08:53.369058 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 853/1714] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:08:52 2022] DELETE /identity/v3/projects/55bd92ae77a74f99bcf2c4f4e7618910 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:53.370186 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fc3e6-43de-4c54-88bb-0aa1a63cb55c None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:53.370474 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fc3e6-43de-4c54-88bb-0aa1a63cb55c None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:53.370774 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fc3e6-43de-4c54-88bb-0aa1a63cb55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:53.395430 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95124688-3b9d-4b1e-8598-db87db6503de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:53.396419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95124688-3b9d-4b1e-8598-db87db6503de admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:53.396863 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95124688-3b9d-4b1e-8598-db87db6503de admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:53.397291 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95124688-3b9d-4b1e-8598-db87db6503de admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:53.398176 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95124688-3b9d-4b1e-8598-db87db6503de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:08:53.398691 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95124688-3b9d-4b1e-8598-db87db6503de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:53.401138 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95124688-3b9d-4b1e-8598-db87db6503de admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:53.412310 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-7e0fc3e6-43de-4c54-88bb-0aa1a63cb55c None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:53.413558 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-7e0fc3e6-43de-4c54-88bb-0aa1a63cb55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:53.417530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 862/1715] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:08:53.419697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768fae9-01fb-409c-ae44-8520b501f95f None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:53.420168 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768fae9-01fb-409c-ae44-8520b501f95f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:53.420646 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768fae9-01fb-409c-ae44-8520b501f95f None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:53.422538 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 863/1716] 10.222.0.79 () {54 vars in 960 bytes} [Thu Jul 14 12:08:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:08:53.423985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac253a18-7d92-4d0a-b05c-9a3fcd029928 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:53.424436 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac253a18-7d92-4d0a-b05c-9a3fcd029928 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:53.424857 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac253a18-7d92-4d0a-b05c-9a3fcd029928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:53.430272 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 854/1717] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:53.431370 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fc3e6-43de-4c54-88bb-0aa1a63cb55c None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:53.435319 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-7e0fc3e6-43de-4c54-88bb-0aa1a63cb55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:53.464486 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fc3e6-43de-4c54-88bb-0aa1a63cb55c None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:53.470308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ac253a18-7d92-4d0a-b05c-9a3fcd029928 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:53.473334 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ac253a18-7d92-4d0a-b05c-9a3fcd029928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:53.477812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6362e4c-c0fe-4cf6-bd0f-daa3375b60f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:53.478913 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6362e4c-c0fe-4cf6-bd0f-daa3375b60f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:53.479440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6362e4c-c0fe-4cf6-bd0f-daa3375b60f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:53.479875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6362e4c-c0fe-4cf6-bd0f-daa3375b60f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:53.480813 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6362e4c-c0fe-4cf6-bd0f-daa3375b60f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:53.484690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6362e4c-c0fe-4cf6-bd0f-daa3375b60f0 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:53.495472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 864/1718] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:53.500070 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a2cf5-b8ed-4c7b-9157-db68098b5470 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:53.500610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a2cf5-b8ed-4c7b-9157-db68098b5470 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:53.503125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a2cf5-b8ed-4c7b-9157-db68098b5470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:53.544972 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 855/1719] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:08:53 2022] POST /identity/v3/projects => generated 357 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:53.546963 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6362e4c-c0fe-4cf6-bd0f-daa3375b60f0 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:53.555684 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-db1a2cf5-b8ed-4c7b-9157-db68098b5470 None None] MFA Rules not processed for user `d6070c6b901f4e2ebe621a3e42dd2d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:53.561125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-db1a2cf5-b8ed-4c7b-9157-db68098b5470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:53.631888 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:53.638939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6362e4c-c0fe-4cf6-bd0f-daa3375b60f0 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:53.647039 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433686c-3858-48a0-b6c9-c218e1101db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:53.648019 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433686c-3858-48a0-b6c9-c218e1101db0 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:53.648686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433686c-3858-48a0-b6c9-c218e1101db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:53.649127 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433686c-3858-48a0-b6c9-c218e1101db0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:53.650051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433686c-3858-48a0-b6c9-c218e1101db0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:08:53.650593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433686c-3858-48a0-b6c9-c218e1101db0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:53.652930 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433686c-3858-48a0-b6c9-c218e1101db0 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:53.667638 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 856/1720] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:08:53.669553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fbcd4-5d69-4eb2-b611-c101f9aad964 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:53.670086 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fbcd4-5d69-4eb2-b611-c101f9aad964 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:53.670527 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fbcd4-5d69-4eb2-b611-c101f9aad964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:53.699918 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-974fbcd4-5d69-4eb2-b611-c101f9aad964 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:53.706228 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-974fbcd4-5d69-4eb2-b611-c101f9aad964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:53.722373 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 857/1721] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:53.724104 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fbcd4-5d69-4eb2-b611-c101f9aad964 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:53.738304 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fbcd4-5d69-4eb2-b611-c101f9aad964 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:53.745697 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2589f48-3941-4872-9031-49a75d11de1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:53.746776 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2589f48-3941-4872-9031-49a75d11de1c admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:53.747412 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2589f48-3941-4872-9031-49a75d11de1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:53.748069 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2589f48-3941-4872-9031-49a75d11de1c admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:53.749610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2589f48-3941-4872-9031-49a75d11de1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:53.753020 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2589f48-3941-4872-9031-49a75d11de1c admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:53.754479 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 865/1722] 10.222.0.79 () {58 vars in 1057 bytes} [Thu Jul 14 12:08:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:53.755908 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33df61-5d0c-4ab0-a60a-d9e0b5b448cc None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:53.756196 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33df61-5d0c-4ab0-a60a-d9e0b5b448cc None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:53.756477 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33df61-5d0c-4ab0-a60a-d9e0b5b448cc None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:53.758007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 866/1723] 10.222.0.79 () {54 vars in 912 bytes} [Thu Jul 14 12:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:08:53.760267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33df61-5d0c-4ab0-a60a-d9e0b5b448cc None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:53.786465 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 858/1724] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:08:53 2022] POST /identity/v3/users => generated 279 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:53.787752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2589f48-3941-4872-9031-49a75d11de1c admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:53.791263 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33df61-5d0c-4ab0-a60a-d9e0b5b448cc None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:53.797206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80dc4f-4d8d-45de-81d3-8b34aff979b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:53.797956 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80dc4f-4d8d-45de-81d3-8b34aff979b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:53.798239 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80dc4f-4d8d-45de-81d3-8b34aff979b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:53.798664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80dc4f-4d8d-45de-81d3-8b34aff979b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:53.799604 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80dc4f-4d8d-45de-81d3-8b34aff979b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:53.803319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80dc4f-4d8d-45de-81d3-8b34aff979b2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:53.815632 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2589f48-3941-4872-9031-49a75d11de1c admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:53.828104 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725dbe8-fc53-4390-8adb-ba84b172e2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:53.829097 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725dbe8-fc53-4390-8adb-ba84b172e2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:53.829552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725dbe8-fc53-4390-8adb-ba84b172e2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:53.830203 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725dbe8-fc53-4390-8adb-ba84b172e2e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:53.831166 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725dbe8-fc53-4390-8adb-ba84b172e2e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:08:53.831637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725dbe8-fc53-4390-8adb-ba84b172e2e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:53.833539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725dbe8-fc53-4390-8adb-ba84b172e2e8 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:53.835772 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:53.852394 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 859/1725] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:08:53.854002 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ecbbe-51e3-484b-87be-f4df84943b53 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:53.854297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ecbbe-51e3-484b-87be-f4df84943b53 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:53.854639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ecbbe-51e3-484b-87be-f4df84943b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:53.869979 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 867/1726] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:08:53 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:53.871356 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80dc4f-4d8d-45de-81d3-8b34aff979b2 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:53.880072 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-820ecbbe-51e3-484b-87be-f4df84943b53 None None] MFA Rules not processed for user `2fedd4e015384379bf41c2e01ecc0a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:53.882067 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-820ecbbe-51e3-484b-87be-f4df84943b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:53.954463 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 860/1727] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Jul 14 12:08:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:53.955920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ecbbe-51e3-484b-87be-f4df84943b53 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:54.030370 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80dc4f-4d8d-45de-81d3-8b34aff979b2 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:54.047014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deabcb3-9f59-474e-9ac1-a90557f4c242 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6070c6b901f4e2ebe621a3e42dd2d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:54.048417 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deabcb3-9f59-474e-9ac1-a90557f4c242 service placement] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:54.048711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deabcb3-9f59-474e-9ac1-a90557f4c242 service placement] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:54.050802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deabcb3-9f59-474e-9ac1-a90557f4c242 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:54.060659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1deabcb3-9f59-474e-9ac1-a90557f4c242 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:54.072836 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ecbbe-51e3-484b-87be-f4df84943b53 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:54.084909 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a67b7-3b51-47bf-b8dd-201defb02ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:54.086487 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a67b7-3b51-47bf-b8dd-201defb02ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:54.087487 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a67b7-3b51-47bf-b8dd-201defb02ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:54.088212 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a67b7-3b51-47bf-b8dd-201defb02ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:54.089222 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deabcb3-9f59-474e-9ac1-a90557f4c242 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:54.091151 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a67b7-3b51-47bf-b8dd-201defb02ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:54.095637 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deabcb3-9f59-474e-9ac1-a90557f4c242 service placement] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:54.100046 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a67b7-3b51-47bf-b8dd-201defb02ba8 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:54.119779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 868/1728] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:54.121372 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deabcb3-9f59-474e-9ac1-a90557f4c242 service placement] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:54.129516 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 861/1729] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:54.131734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a67b7-3b51-47bf-b8dd-201defb02ba8 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:54.135694 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deabcb3-9f59-474e-9ac1-a90557f4c242 service placement] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:54.141260 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690f118-7552-4a23-8eac-c388ca879e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:54.142120 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690f118-7552-4a23-8eac-c388ca879e52 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:54.142478 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690f118-7552-4a23-8eac-c388ca879e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:54.142876 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690f118-7552-4a23-8eac-c388ca879e52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:54.143764 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690f118-7552-4a23-8eac-c388ca879e52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:54.146593 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690f118-7552-4a23-8eac-c388ca879e52 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:54.156454 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a67b7-3b51-47bf-b8dd-201defb02ba8 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:54.169314 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81748d-c63c-4d54-b7bf-8dd5b835fc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:54.172378 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81748d-c63c-4d54-b7bf-8dd5b835fc26 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:54.173005 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81748d-c63c-4d54-b7bf-8dd5b835fc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:54.173807 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81748d-c63c-4d54-b7bf-8dd5b835fc26 admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:54.175465 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81748d-c63c-4d54-b7bf-8dd5b835fc26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:54.179256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81748d-c63c-4d54-b7bf-8dd5b835fc26 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:54.187886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 869/1730] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:08:54 2022] POST /identity/v3/projects => generated 407 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:54.189236 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690f118-7552-4a23-8eac-c388ca879e52 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:54.202241 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2690f118-7552-4a23-8eac-c388ca879e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:54.225342 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 862/1731] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:08:54 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:54.229592 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81748d-c63c-4d54-b7bf-8dd5b835fc26 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:54.263893 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81748d-c63c-4d54-b7bf-8dd5b835fc26 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:54.383226 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99876d-b1d1-4469-8a60-0a9ee2d7b53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:54.384019 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99876d-b1d1-4469-8a60-0a9ee2d7b53f admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:54.384328 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99876d-b1d1-4469-8a60-0a9ee2d7b53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:54.385092 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99876d-b1d1-4469-8a60-0a9ee2d7b53f admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:54.386398 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99876d-b1d1-4469-8a60-0a9ee2d7b53f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:54.388070 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690f118-7552-4a23-8eac-c388ca879e52 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:54.388265 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99876d-b1d1-4469-8a60-0a9ee2d7b53f admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:54.404492 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 863/1732] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:54.407245 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99876d-b1d1-4469-8a60-0a9ee2d7b53f admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:54.417297 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1815a-fe89-47c0-9ee2-d2b080870385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:54.417297 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1815a-fe89-47c0-9ee2-d2b080870385 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:54.417297 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1815a-fe89-47c0-9ee2-d2b080870385 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:54.417297 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1815a-fe89-47c0-9ee2-d2b080870385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:54.431357 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99876d-b1d1-4469-8a60-0a9ee2d7b53f admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:54.448274 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497aa46-106d-46ab-9aae-369b1dc98c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:54.449036 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497aa46-106d-46ab-9aae-369b1dc98c3b admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:54.449217 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497aa46-106d-46ab-9aae-369b1dc98c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:54.449613 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497aa46-106d-46ab-9aae-369b1dc98c3b admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:54.450283 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497aa46-106d-46ab-9aae-369b1dc98c3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:54.453062 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497aa46-106d-46ab-9aae-369b1dc98c3b admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:54.457976 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1815a-fe89-47c0-9ee2-d2b080870385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:54.463625 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1815a-fe89-47c0-9ee2-d2b080870385 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:54.480465 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:54.487839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 864/1733] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:08:54 2022] POST /identity/v3/users => generated 304 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:54.488945 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497aa46-106d-46ab-9aae-369b1dc98c3b admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:54.492751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 870/1734] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:54.494323 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1815a-fe89-47c0-9ee2-d2b080870385 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:54.505874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497aa46-106d-46ab-9aae-369b1dc98c3b admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:54.517875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f053c35-7434-4bfa-a45e-ec326715b4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:54.520477 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f053c35-7434-4bfa-a45e-ec326715b4df admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:54.521095 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f053c35-7434-4bfa-a45e-ec326715b4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:54.522145 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f053c35-7434-4bfa-a45e-ec326715b4df admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:54.524770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f053c35-7434-4bfa-a45e-ec326715b4df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:54.526267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1815a-fe89-47c0-9ee2-d2b080870385 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:54.526554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f053c35-7434-4bfa-a45e-ec326715b4df admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:54.545281 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6a462-870f-4721-b496-69ce4b1860f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:54.546796 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6a462-870f-4721-b496-69ce4b1860f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:54.546796 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6a462-870f-4721-b496-69ce4b1860f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:54.547164 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6a462-870f-4721-b496-69ce4b1860f3 admin admin] PATH_INFO: `/v3/projects/526afcda4c094008befd4e021c33c9ba/users/8bc50d564f3b4c48a71363ad5a9ad87c/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:54.568736 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 865/1735] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:54.570901 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d71dbd-460e-4a6b-a81d-656f3aab6ea2 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:54.574127 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d71dbd-460e-4a6b-a81d-656f3aab6ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:54.574749 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d71dbd-460e-4a6b-a81d-656f3aab6ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:54.617257 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-a3d71dbd-460e-4a6b-a81d-656f3aab6ea2 None None] MFA Rules not processed for user `5f89347016394f69bde41b3632e94c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:54.618818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a3d71dbd-460e-4a6b-a81d-656f3aab6ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:54.631456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:54.643836 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6a462-870f-4721-b496-69ce4b1860f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=526afcda4c094008befd4e021c33c9ba, user_id=8bc50d564f3b4c48a71363ad5a9ad87c, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:54.651964 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6a462-870f-4721-b496-69ce4b1860f3 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:54.723818 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 871/1736] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:54 2022] PUT /identity/v3/projects/526afcda4c094008befd4e021c33c9ba/users/8bc50d564f3b4c48a71363ad5a9ad87c/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:54.751443 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56c086-8678-4940-a390-e0b2f1392909 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:54.751735 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56c086-8678-4940-a390-e0b2f1392909 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:54.752015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56c086-8678-4940-a390-e0b2f1392909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:54.799521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 866/1737] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:54.805419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d71dbd-460e-4a6b-a81d-656f3aab6ea2 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:54.830194 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-4b56c086-8678-4940-a390-e0b2f1392909 None None] MFA Rules not processed for user `3bbfece64cb94565b1a733ae486a4635`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:54.831447 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4b56c086-8678-4940-a390-e0b2f1392909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:54.833547 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d71dbd-460e-4a6b-a81d-656f3aab6ea2 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:55.043782 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d07e6-97d0-4d2f-9887-d7a6a210413d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:55.055696 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d07e6-97d0-4d2f-9887-d7a6a210413d admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:55.056110 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d07e6-97d0-4d2f-9887-d7a6a210413d admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:55.056331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d07e6-97d0-4d2f-9887-d7a6a210413d admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:55.057142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d07e6-97d0-4d2f-9887-d7a6a210413d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:55.058907 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d07e6-97d0-4d2f-9887-d7a6a210413d admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:55.082416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 872/1738] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:54 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:55.082416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56c086-8678-4940-a390-e0b2f1392909 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:55.090787 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 867/1739] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:55.093236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeff348-cba7-4f7a-828a-ac1a8a89bb98 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:55.093530 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeff348-cba7-4f7a-828a-ac1a8a89bb98 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:55.093812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeff348-cba7-4f7a-828a-ac1a8a89bb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:55.107765 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56c086-8678-4940-a390-e0b2f1392909 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:55.121661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e6eb8-c5f2-4764-a7a8-70d1ceb9f56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:55.125552 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e6eb8-c5f2-4764-a7a8-70d1ceb9f56d admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:55.125971 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e6eb8-c5f2-4764-a7a8-70d1ceb9f56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:55.126151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e6eb8-c5f2-4764-a7a8-70d1ceb9f56d admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:55.127927 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e6eb8-c5f2-4764-a7a8-70d1ceb9f56d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:55.128922 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e6eb8-c5f2-4764-a7a8-70d1ceb9f56d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:55.168712 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-ebeff348-cba7-4f7a-828a-ac1a8a89bb98 None None] MFA Rules not processed for user `8bc50d564f3b4c48a71363ad5a9ad87c`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:55.170000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ebeff348-cba7-4f7a-828a-ac1a8a89bb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:55.188759 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 873/1740] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:55.190324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e6eb8-c5f2-4764-a7a8-70d1ceb9f56d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:55.220445 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-862e6eb8-c5f2-4764-a7a8-70d1ceb9f56d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:55.270010 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e6eb8-c5f2-4764-a7a8-70d1ceb9f56d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:55.281923 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146ca2c-bcb3-4f6c-b606-67c9ff8e565d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:55.283983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146ca2c-bcb3-4f6c-b606-67c9ff8e565d admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:55.283983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146ca2c-bcb3-4f6c-b606-67c9ff8e565d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:55.284345 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146ca2c-bcb3-4f6c-b606-67c9ff8e565d admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:55.286129 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146ca2c-bcb3-4f6c-b606-67c9ff8e565d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:55.289504 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146ca2c-bcb3-4f6c-b606-67c9ff8e565d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:55.386919 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 868/1741] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:55 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:55.386919 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeff348-cba7-4f7a-828a-ac1a8a89bb98 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:55.407537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 874/1742] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:08:55 2022] POST /identity/v3/projects => generated 403 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:55.408919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146ca2c-bcb3-4f6c-b606-67c9ff8e565d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:55.410801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeff348-cba7-4f7a-828a-ac1a8a89bb98 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:55.458013 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:55.595528 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d3590-57b5-4878-9931-321c01f885c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:55.596595 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d3590-57b5-4878-9931-321c01f885c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:55.596895 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d3590-57b5-4878-9931-321c01f885c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:55.609082 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d3590-57b5-4878-9931-321c01f885c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:55.609902 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d3590-57b5-4878-9931-321c01f885c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:55.611543 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d3590-57b5-4878-9931-321c01f885c1 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:55.640310 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 869/1743] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:55.641252 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d3590-57b5-4878-9931-321c01f885c1 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:55.661031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d3590-57b5-4878-9931-321c01f885c1 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:55.673083 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e468d-1326-430a-bc45-f14374dcf177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:55.673773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e468d-1326-430a-bc45-f14374dcf177 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:55.674523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e468d-1326-430a-bc45-f14374dcf177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:55.674523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e468d-1326-430a-bc45-f14374dcf177 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:55.688982 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e468d-1326-430a-bc45-f14374dcf177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:55.706721 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e468d-1326-430a-bc45-f14374dcf177 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:55.759705 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146ca2c-bcb3-4f6c-b606-67c9ff8e565d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:55.781402 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 870/1744] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:08:55 2022] POST /identity/v3/projects => generated 357 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:55.782367 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e468d-1326-430a-bc45-f14374dcf177 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:55.791934 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcf0e5-871a-42e0-a5fb-a6a2ee4e9491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:55.795176 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcf0e5-871a-42e0-a5fb-a6a2ee4e9491 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:55.796066 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcf0e5-871a-42e0-a5fb-a6a2ee4e9491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:55.798376 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcf0e5-871a-42e0-a5fb-a6a2ee4e9491 admin admin] PATH_INFO: `/v3/projects/7793ae66072b4f25a2d88a3ab3a0b832/users/3d715176862b4ff583b115ef612bb73e/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:55.846290 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bcf0e5-871a-42e0-a5fb-a6a2ee4e9491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7793ae66072b4f25a2d88a3ab3a0b832, user_id=3d715176862b4ff583b115ef612bb73e, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:55.854259 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bcf0e5-871a-42e0-a5fb-a6a2ee4e9491 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:55.902612 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 875/1745] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:55 2022] PUT /identity/v3/projects/7793ae66072b4f25a2d88a3ab3a0b832/users/3d715176862b4ff583b115ef612bb73e/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:55.906681 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d7849-d86e-4615-8071-f05c35066383 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:55.906988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d7849-d86e-4615-8071-f05c35066383 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:55.907306 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d7849-d86e-4615-8071-f05c35066383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:55.934412 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e468d-1326-430a-bc45-f14374dcf177 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:55.941228 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-8c4d7849-d86e-4615-8071-f05c35066383 None None] MFA Rules not processed for user `5eb3da4d1e5e4a67830767d040e15a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:55.942606 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8c4d7849-d86e-4615-8071-f05c35066383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:55.994161 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:56.079353 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ae2d8-ca34-4448-bf01-6293c128c29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:56.080151 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ae2d8-ca34-4448-bf01-6293c128c29c admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:56.080440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ae2d8-ca34-4448-bf01-6293c128c29c admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:56.080793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ae2d8-ca34-4448-bf01-6293c128c29c admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:56.081592 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ae2d8-ca34-4448-bf01-6293c128c29c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:56.083736 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ae2d8-ca34-4448-bf01-6293c128c29c admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:56.087130 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 876/1746] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:56.088237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d7849-d86e-4615-8071-f05c35066383 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:56.100613 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d7849-d86e-4615-8071-f05c35066383 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:56.105765 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6ea9b-ec39-4c28-9ec5-89f45d68fc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:56.108799 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6ea9b-ec39-4c28-9ec5-89f45d68fc12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:56.108799 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6ea9b-ec39-4c28-9ec5-89f45d68fc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:56.108799 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6ea9b-ec39-4c28-9ec5-89f45d68fc12 admin admin] PATH_INFO: `/v3/projects/d4bdebc5d857445b88f6cd0c233ff1d3/users/c3228abc646c4d5fa1b2566d25caebd9/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:56.128791 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6ea9b-ec39-4c28-9ec5-89f45d68fc12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4bdebc5d857445b88f6cd0c233ff1d3, user_id=c3228abc646c4d5fa1b2566d25caebd9, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:56.131623 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6ea9b-ec39-4c28-9ec5-89f45d68fc12 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:56.160416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 877/1747] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:56 2022] PUT /identity/v3/projects/d4bdebc5d857445b88f6cd0c233ff1d3/users/c3228abc646c4d5fa1b2566d25caebd9/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:56.161379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6ea9b-ec39-4c28-9ec5-89f45d68fc12 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:56.187276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 871/1748] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:08:55 2022] POST /identity/v3/users => generated 308 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:56.204023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad265f0a-7d15-4d88-8fd4-f6a9b9096e16 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:56.204560 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad265f0a-7d15-4d88-8fd4-f6a9b9096e16 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:56.205081 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad265f0a-7d15-4d88-8fd4-f6a9b9096e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:56.247742 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6ea9b-ec39-4c28-9ec5-89f45d68fc12 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:56.256648 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58964004-a423-4531-a3d8-9f431c1e02f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:56.257361 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58964004-a423-4531-a3d8-9f431c1e02f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:56.259172 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58964004-a423-4531-a3d8-9f431c1e02f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:56.259489 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58964004-a423-4531-a3d8-9f431c1e02f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:56.260698 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58964004-a423-4531-a3d8-9f431c1e02f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:56.263067 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58964004-a423-4531-a3d8-9f431c1e02f8 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:56.303000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-ad265f0a-7d15-4d88-8fd4-f6a9b9096e16 None None] MFA Rules not processed for user `3d715176862b4ff583b115ef612bb73e`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:56.304291 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ad265f0a-7d15-4d88-8fd4-f6a9b9096e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:56.314705 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 878/1749] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:08:56 2022] POST /identity/v3/users => generated 285 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:56.317198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e12cec-3687-4287-bd24-40b1f032af7d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:56.317517 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e12cec-3687-4287-bd24-40b1f032af7d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:56.317824 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e12cec-3687-4287-bd24-40b1f032af7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:56.349743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:56.396937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f0e12cec-3687-4287-bd24-40b1f032af7d None None] MFA Rules not processed for user `c3228abc646c4d5fa1b2566d25caebd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:56.398880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f0e12cec-3687-4287-bd24-40b1f032af7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:56.453650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 872/1750] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:56.454806 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad265f0a-7d15-4d88-8fd4-f6a9b9096e16 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:56.475325 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad265f0a-7d15-4d88-8fd4-f6a9b9096e16 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:56.495544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 879/1751] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:56 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:56.496361 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e12cec-3687-4287-bd24-40b1f032af7d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:56.504675 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109a575-96e2-488d-a14b-a5fd8e1a920d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:56.505369 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109a575-96e2-488d-a14b-a5fd8e1a920d admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:56.505700 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109a575-96e2-488d-a14b-a5fd8e1a920d admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:56.505984 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109a575-96e2-488d-a14b-a5fd8e1a920d admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:56.506746 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109a575-96e2-488d-a14b-a5fd8e1a920d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:56.512418 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109a575-96e2-488d-a14b-a5fd8e1a920d admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:56.515446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e12cec-3687-4287-bd24-40b1f032af7d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:56.522122 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d01c8-9cd8-4623-8e51-62b916969c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:56.523459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d01c8-9cd8-4623-8e51-62b916969c99 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:56.524670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d01c8-9cd8-4623-8e51-62b916969c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:56.524670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d01c8-9cd8-4623-8e51-62b916969c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:56.525792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d01c8-9cd8-4623-8e51-62b916969c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:56.527812 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d01c8-9cd8-4623-8e51-62b916969c99 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:56.544052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 880/1753] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:56.546535 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d01c8-9cd8-4623-8e51-62b916969c99 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:56.547157 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 873/1753] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:56.548357 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109a575-96e2-488d-a14b-a5fd8e1a920d admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:56.558807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d01c8-9cd8-4623-8e51-62b916969c99 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:56.565416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17a846-4cb0-4916-8496-b9c56a85480f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:56.566418 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17a846-4cb0-4916-8496-b9c56a85480f admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:56.566968 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17a846-4cb0-4916-8496-b9c56a85480f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:56.567432 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17a846-4cb0-4916-8496-b9c56a85480f admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:56.568310 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17a846-4cb0-4916-8496-b9c56a85480f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:56.571708 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17a846-4cb0-4916-8496-b9c56a85480f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:56.573394 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109a575-96e2-488d-a14b-a5fd8e1a920d admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:56.584997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc56df2-15e3-451d-89fd-2e3fa1cf976d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:56.585782 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc56df2-15e3-451d-89fd-2e3fa1cf976d admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:56.586142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc56df2-15e3-451d-89fd-2e3fa1cf976d admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:56.586546 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc56df2-15e3-451d-89fd-2e3fa1cf976d admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:56.587592 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc56df2-15e3-451d-89fd-2e3fa1cf976d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:56.590533 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc56df2-15e3-451d-89fd-2e3fa1cf976d admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:56.599595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:56.640362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 881/1754] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:08:56 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:56.640362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17a846-4cb0-4916-8496-b9c56a85480f admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:56.678850 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 874/1755] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:08:56 2022] POST /identity/v3/projects => generated 409 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:56.679733 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc56df2-15e3-451d-89fd-2e3fa1cf976d admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:56.802390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17a846-4cb0-4916-8496-b9c56a85480f admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:56.855198 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc56df2-15e3-451d-89fd-2e3fa1cf976d admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:56.869891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15283f05-5c45-47d5-81e8-3412f9a45a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:56.870833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15283f05-5c45-47d5-81e8-3412f9a45a3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:56.871115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15283f05-5c45-47d5-81e8-3412f9a45a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:56.875453 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15283f05-5c45-47d5-81e8-3412f9a45a3c admin admin] PATH_INFO: `/v3/projects/ef5781966c1b456688d4ef83c2534d8e/users/6670d3361de34529a61b7ac79be36225/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:56.910451 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15283f05-5c45-47d5-81e8-3412f9a45a3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5781966c1b456688d4ef83c2534d8e, user_id=6670d3361de34529a61b7ac79be36225, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:56.912886 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15283f05-5c45-47d5-81e8-3412f9a45a3c admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:56.922140 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee96548-e4d5-4900-8cdf-64aec9925364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:56.923051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee96548-e4d5-4900-8cdf-64aec9925364 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:56.923396 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee96548-e4d5-4900-8cdf-64aec9925364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:56.923500 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee96548-e4d5-4900-8cdf-64aec9925364 admin admin] PATH_INFO: `/v3/projects/2590f5a34e2f4d9e86727449d3c29db2/users/872baef9cd4a4668a23a4d0fb361f354/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:56.965668 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 875/1756] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:56 2022] PUT /identity/v3/projects/ef5781966c1b456688d4ef83c2534d8e/users/6670d3361de34529a61b7ac79be36225/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:56.978373 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15283f05-5c45-47d5-81e8-3412f9a45a3c admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:56.988615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee96548-e4d5-4900-8cdf-64aec9925364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2590f5a34e2f4d9e86727449d3c29db2, user_id=872baef9cd4a4668a23a4d0fb361f354, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:56.992122 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee96548-e4d5-4900-8cdf-64aec9925364 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:57.028640 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 882/1757] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:56 2022] PUT /identity/v3/projects/2590f5a34e2f4d9e86727449d3c29db2/users/872baef9cd4a4668a23a4d0fb361f354/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:57.028858 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee96548-e4d5-4900-8cdf-64aec9925364 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:57.145105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15283f05-5c45-47d5-81e8-3412f9a45a3c admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:57.187120 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:57.244974 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee96548-e4d5-4900-8cdf-64aec9925364 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:57.259116 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db6424-8bda-4f24-a0df-f01aac0b10b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:57.261098 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db6424-8bda-4f24-a0df-f01aac0b10b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:57.264021 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db6424-8bda-4f24-a0df-f01aac0b10b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:57.265707 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db6424-8bda-4f24-a0df-f01aac0b10b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:57.267265 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db6424-8bda-4f24-a0df-f01aac0b10b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:57.273211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db6424-8bda-4f24-a0df-f01aac0b10b9 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:57.337369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 883/1758] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:08:57 2022] POST /identity/v3/users => generated 311 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:57.339112 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db6424-8bda-4f24-a0df-f01aac0b10b9 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:57.340246 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584f616-331c-4836-9d78-e6bec8646f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:57.341496 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584f616-331c-4836-9d78-e6bec8646f66 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:57.342041 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584f616-331c-4836-9d78-e6bec8646f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:57.343445 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584f616-331c-4836-9d78-e6bec8646f66 admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:57.348097 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584f616-331c-4836-9d78-e6bec8646f66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:57.355367 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584f616-331c-4836-9d78-e6bec8646f66 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:57.381309 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db6424-8bda-4f24-a0df-f01aac0b10b9 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:57.396555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf9658-f148-4b78-918b-ec7b98a98a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:57.399300 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf9658-f148-4b78-918b-ec7b98a98a1b admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:57.399946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf9658-f148-4b78-918b-ec7b98a98a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:57.401737 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf9658-f148-4b78-918b-ec7b98a98a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:57.409303 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf9658-f148-4b78-918b-ec7b98a98a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:57.412034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf9658-f148-4b78-918b-ec7b98a98a1b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:57.425968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 876/1759] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:08:56 2022] POST /identity/v3/users => generated 293 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:08:57.427011 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584f616-331c-4836-9d78-e6bec8646f66 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:57.444260 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 884/1760] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:57.445409 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf9658-f148-4b78-918b-ec7b98a98a1b admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:57.454811 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584f616-331c-4836-9d78-e6bec8646f66 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:57.465396 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:57.477271 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ba9e4-6b38-4209-9a43-f360a2528128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:57.483138 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ba9e4-6b38-4209-9a43-f360a2528128 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:57.485588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ba9e4-6b38-4209-9a43-f360a2528128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:57.487930 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ba9e4-6b38-4209-9a43-f360a2528128 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:57.491565 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ba9e4-6b38-4209-9a43-f360a2528128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:57.497095 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf9658-f148-4b78-918b-ec7b98a98a1b admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:57.501582 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ba9e4-6b38-4209-9a43-f360a2528128 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:57.522199 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2ede1-33a1-48e0-a4e3-72a25e92aa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:57.525775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2ede1-33a1-48e0-a4e3-72a25e92aa94 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:57.526342 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2ede1-33a1-48e0-a4e3-72a25e92aa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:57.528008 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2ede1-33a1-48e0-a4e3-72a25e92aa94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:57.539921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2ede1-33a1-48e0-a4e3-72a25e92aa94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:57.545378 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2ede1-33a1-48e0-a4e3-72a25e92aa94 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:57.557929 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 877/1761] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:57.560272 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ba9e4-6b38-4209-9a43-f360a2528128 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:57.583309 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 885/1762] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:57.586275 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2ede1-33a1-48e0-a4e3-72a25e92aa94 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:57.595924 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ba9e4-6b38-4209-9a43-f360a2528128 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:57.619118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce867d-be06-4c56-bd53-e2c734a44365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:57.621345 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce867d-be06-4c56-bd53-e2c734a44365 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:57.621345 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce867d-be06-4c56-bd53-e2c734a44365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:57.638467 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce867d-be06-4c56-bd53-e2c734a44365 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:57.647258 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce867d-be06-4c56-bd53-e2c734a44365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:57.665463 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce867d-be06-4c56-bd53-e2c734a44365 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:57.668468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2ede1-33a1-48e0-a4e3-72a25e92aa94 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:57.752079 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d62a72-4dac-475e-90d3-21a2bfdec04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:57.761562 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d62a72-4dac-475e-90d3-21a2bfdec04f admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:57.767602 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d62a72-4dac-475e-90d3-21a2bfdec04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:57.770109 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d62a72-4dac-475e-90d3-21a2bfdec04f admin admin] PATH_INFO: `/v3/projects/ef5781966c1b456688d4ef83c2534d8e/users/6670d3361de34529a61b7ac79be36225/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:57.802054 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d62a72-4dac-475e-90d3-21a2bfdec04f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5781966c1b456688d4ef83c2534d8e, user_id=6670d3361de34529a61b7ac79be36225, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:57.806296 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d62a72-4dac-475e-90d3-21a2bfdec04f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:57.829744 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 878/1763] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:57.829744 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce867d-be06-4c56-bd53-e2c734a44365 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:57.857420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce867d-be06-4c56-bd53-e2c734a44365 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:57.859968 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 886/1764] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:57 2022] PUT /identity/v3/projects/ef5781966c1b456688d4ef83c2534d8e/users/6670d3361de34529a61b7ac79be36225/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:57.862747 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d62a72-4dac-475e-90d3-21a2bfdec04f admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:58.027855 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d62a72-4dac-475e-90d3-21a2bfdec04f admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:58.034748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bc82c-ecf3-46cb-9c35-d317d61103dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:58.035845 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bc82c-ecf3-46cb-9c35-d317d61103dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:58.036191 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bc82c-ecf3-46cb-9c35-d317d61103dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:58.036540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bc82c-ecf3-46cb-9c35-d317d61103dd admin admin] PATH_INFO: `/v3/projects/5874ae83ee8d47abb1c4f099930af098/users/1d588cdb73e741259fe956233f12aa54/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:58.063817 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bc82c-ecf3-46cb-9c35-d317d61103dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5874ae83ee8d47abb1c4f099930af098, user_id=1d588cdb73e741259fe956233f12aa54, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:58.067234 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bc82c-ecf3-46cb-9c35-d317d61103dd admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:58.071423 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce5c13-4f7b-4c80-a812-d2944279a4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:58.073574 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce5c13-4f7b-4c80-a812-d2944279a4e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:58.074065 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce5c13-4f7b-4c80-a812-d2944279a4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:58.074530 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce5c13-4f7b-4c80-a812-d2944279a4e5 admin admin] PATH_INFO: `/v3/projects/2590f5a34e2f4d9e86727449d3c29db2/users/872baef9cd4a4668a23a4d0fb361f354/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:58.079737 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce5c13-4f7b-4c80-a812-d2944279a4e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2590f5a34e2f4d9e86727449d3c29db2, user_id=872baef9cd4a4668a23a4d0fb361f354, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:58.090827 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce5c13-4f7b-4c80-a812-d2944279a4e5 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:58.099882 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 887/1765] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:57 2022] PUT /identity/v3/projects/5874ae83ee8d47abb1c4f099930af098/users/1d588cdb73e741259fe956233f12aa54/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:58.113710 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bc82c-ecf3-46cb-9c35-d317d61103dd admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:58.144091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 879/1766] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:57 2022] PUT /identity/v3/projects/2590f5a34e2f4d9e86727449d3c29db2/users/872baef9cd4a4668a23a4d0fb361f354/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:58.149281 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012025fa-23c6-422c-b44f-4fa3d8208b54 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:58.157043 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012025fa-23c6-422c-b44f-4fa3d8208b54 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:58.157575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012025fa-23c6-422c-b44f-4fa3d8208b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:58.257706 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-012025fa-23c6-422c-b44f-4fa3d8208b54 None None] MFA Rules not processed for user `6670d3361de34529a61b7ac79be36225`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:58.260833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-012025fa-23c6-422c-b44f-4fa3d8208b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:58.277995 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bc82c-ecf3-46cb-9c35-d317d61103dd admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:58.552578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa3458-35b1-459c-8f44-4f0de11c29a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:58.553701 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa3458-35b1-459c-8f44-4f0de11c29a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:58.553989 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa3458-35b1-459c-8f44-4f0de11c29a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:58.554264 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa3458-35b1-459c-8f44-4f0de11c29a2 admin admin] PATH_INFO: `/v3/projects/c4b47822e37d47dc8673d3832bc84612/users/10278b4f9ff84bf3ab95f8c51a701656/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:58.612731 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa3458-35b1-459c-8f44-4f0de11c29a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4b47822e37d47dc8673d3832bc84612, user_id=10278b4f9ff84bf3ab95f8c51a701656, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:58.619178 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa3458-35b1-459c-8f44-4f0de11c29a2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:58.624647 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:58.652956 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 888/1767] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:58 2022] PUT /identity/v3/projects/c4b47822e37d47dc8673d3832bc84612/users/10278b4f9ff84bf3ab95f8c51a701656/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:58.653940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa3458-35b1-459c-8f44-4f0de11c29a2 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:58.764336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 880/1768] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:58 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 610 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:58.764336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aecf8f-a7c2-456f-9dcf-71a0320e6629 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:58.764336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aecf8f-a7c2-456f-9dcf-71a0320e6629 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:58.764336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aecf8f-a7c2-456f-9dcf-71a0320e6629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:58.810858 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:08:58.897883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa3458-35b1-459c-8f44-4f0de11c29a2 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:58.914198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217a29b-af74-4647-9923-fe774eff5b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:58.915067 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217a29b-af74-4647-9923-fe774eff5b35 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:58.916914 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217a29b-af74-4647-9923-fe774eff5b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:58.917222 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217a29b-af74-4647-9923-fe774eff5b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:58.926255 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217a29b-af74-4647-9923-fe774eff5b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:58.937632 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217a29b-af74-4647-9923-fe774eff5b35 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:58.991331 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 889/1769] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:58.993205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217a29b-af74-4647-9923-fe774eff5b35 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:59.016703 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-d8aecf8f-a7c2-456f-9dcf-71a0320e6629 None None] MFA Rules not processed for user `f64d942793a5493787c3e5c7815bc134`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:59.031584 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217a29b-af74-4647-9923-fe774eff5b35 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:59.032271 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-d8aecf8f-a7c2-456f-9dcf-71a0320e6629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:59.047884 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20db9b-a6d8-4849-a1d9-85a3dd7f6b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:59.048601 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20db9b-a6d8-4849-a1d9-85a3dd7f6b4a admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:59.048890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20db9b-a6d8-4849-a1d9-85a3dd7f6b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:59.049172 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20db9b-a6d8-4849-a1d9-85a3dd7f6b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:59.049930 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20db9b-a6d8-4849-a1d9-85a3dd7f6b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:59.068398 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20db9b-a6d8-4849-a1d9-85a3dd7f6b4a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:59.123132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 890/1770] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:08:59.123132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20db9b-a6d8-4849-a1d9-85a3dd7f6b4a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:59.128800 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3c20db9b-a6d8-4849-a1d9-85a3dd7f6b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:59.320590 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 881/1771] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Jul 14 12:08:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 561 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:08:59.321497 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aecf8f-a7c2-456f-9dcf-71a0320e6629 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:59.380891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aecf8f-a7c2-456f-9dcf-71a0320e6629 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:59.405420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024327f-574e-4bb5-9e35-5f589a1b337a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:59.406350 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024327f-574e-4bb5-9e35-5f589a1b337a admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:59.406698 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024327f-574e-4bb5-9e35-5f589a1b337a admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:59.406974 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024327f-574e-4bb5-9e35-5f589a1b337a admin admin] PATH_INFO: `/v3/projects/5874ae83ee8d47abb1c4f099930af098/users/1d588cdb73e741259fe956233f12aa54/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:59.426403 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024327f-574e-4bb5-9e35-5f589a1b337a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5874ae83ee8d47abb1c4f099930af098, user_id=1d588cdb73e741259fe956233f12aa54, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:59.428041 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024327f-574e-4bb5-9e35-5f589a1b337a admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:59.433904 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20db9b-a6d8-4849-a1d9-85a3dd7f6b4a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:59.454529 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29683e4c-f9be-413c-8f48-b896f808be82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:59.459848 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29683e4c-f9be-413c-8f48-b896f808be82 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:59.461953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29683e4c-f9be-413c-8f48-b896f808be82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:59.463046 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29683e4c-f9be-413c-8f48-b896f808be82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:59.487693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 882/1772] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:59 2022] PUT /identity/v3/projects/5874ae83ee8d47abb1c4f099930af098/users/1d588cdb73e741259fe956233f12aa54/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:59.488753 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024327f-574e-4bb5-9e35-5f589a1b337a admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:59.751682 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024327f-574e-4bb5-9e35-5f589a1b337a admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:08:59.771873 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef927b-4ea9-423f-a800-a687438a3baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:08:59.773110 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef927b-4ea9-423f-a800-a687438a3baf admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:59.773506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef927b-4ea9-423f-a800-a687438a3baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:59.773934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef927b-4ea9-423f-a800-a687438a3baf admin admin] PATH_INFO: `/v3/projects/c4b47822e37d47dc8673d3832bc84612/users/10278b4f9ff84bf3ab95f8c51a701656/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:59.779196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef927b-4ea9-423f-a800-a687438a3baf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4b47822e37d47dc8673d3832bc84612, user_id=10278b4f9ff84bf3ab95f8c51a701656, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:59.782390 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef927b-4ea9-423f-a800-a687438a3baf admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:59.838529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 883/1773] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:08:59 2022] PUT /identity/v3/projects/c4b47822e37d47dc8673d3832bc84612/users/10278b4f9ff84bf3ab95f8c51a701656/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:08:59.838529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc4e48-9db8-4272-8b95-6b0a8ede0bf5 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:08:59.838529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc4e48-9db8-4272-8b95-6b0a8ede0bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:08:59.838529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc4e48-9db8-4272-8b95-6b0a8ede0bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:08:59.840778 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29683e4c-f9be-413c-8f48-b896f808be82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:08:59.842611 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29683e4c-f9be-413c-8f48-b896f808be82 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:08:59.885471 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 891/1774] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:08:59 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 765 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:08:59.887490 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29683e4c-f9be-413c-8f48-b896f808be82 service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:08:59.890971 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-29683e4c-f9be-413c-8f48-b896f808be82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:59.953835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-31cc4e48-9db8-4272-8b95-6b0a8ede0bf5 None None] MFA Rules not processed for user `1d588cdb73e741259fe956233f12aa54`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:08:59.957091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-31cc4e48-9db8-4272-8b95-6b0a8ede0bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:08:59.985650 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:00.183486 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:00.210383 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29683e4c-f9be-413c-8f48-b896f808be82 service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:00.279435 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 884/1775] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:08:59 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:00.281991 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef34f0-db60-408d-98f5-93c24c8061e3 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:00.292184 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef34f0-db60-408d-98f5-93c24c8061e3 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:00.295313 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef34f0-db60-408d-98f5-93c24c8061e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:00.362694 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-92ef34f0-db60-408d-98f5-93c24c8061e3 None None] MFA Rules not processed for user `10278b4f9ff84bf3ab95f8c51a701656`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:00.367575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-92ef34f0-db60-408d-98f5-93c24c8061e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:00.382544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8227362-73e6-46ed-a1d1-03f5aa43f03b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969ee98dfe644ef2a016860aa1585317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:00.383428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8227362-73e6-46ed-a1d1-03f5aa43f03b service swift] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:00.384814 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8227362-73e6-46ed-a1d1-03f5aa43f03b service swift] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:00.388279 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8227362-73e6-46ed-a1d1-03f5aa43f03b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:00.540801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 885/1776] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:00.544527 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef34f0-db60-408d-98f5-93c24c8061e3 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:00.613186 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8227362-73e6-46ed-a1d1-03f5aa43f03b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:00.614931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8227362-73e6-46ed-a1d1-03f5aa43f03b service swift] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:00.642015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 892/1777] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Jul 14 12:08:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 756 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 12:09:00.643010 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8227362-73e6-46ed-a1d1-03f5aa43f03b service swift] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:00.650034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c8227362-73e6-46ed-a1d1-03f5aa43f03b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:00.815807 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef34f0-db60-408d-98f5-93c24c8061e3 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:00.839276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b84445-160a-42b1-971b-2099ebc43688 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:00.844165 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b84445-160a-42b1-971b-2099ebc43688 service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:00.847473 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b84445-160a-42b1-971b-2099ebc43688 service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:00.857242 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b84445-160a-42b1-971b-2099ebc43688 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:00.870995 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8227362-73e6-46ed-a1d1-03f5aa43f03b service swift] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:00.887486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f115d-ef79-464c-a5e7-034517087baa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:00.888642 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f115d-ef79-464c-a5e7-034517087baa service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:00.889328 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f115d-ef79-464c-a5e7-034517087baa service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:00.891873 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f115d-ef79-464c-a5e7-034517087baa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:00.928088 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:00.946554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f115d-ef79-464c-a5e7-034517087baa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:00.948619 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f115d-ef79-464c-a5e7-034517087baa service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:01.018525 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 893/1778] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:00 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:01.141782 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b84445-160a-42b1-971b-2099ebc43688 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:01.142729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b84445-160a-42b1-971b-2099ebc43688 service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:01.193804 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f115d-ef79-464c-a5e7-034517087baa service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:01.215607 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 886/1779] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:00 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:01.219011 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f115d-ef79-464c-a5e7-034517087baa service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:01.227633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52d7e8-a0db-441e-9c87-d0ac1682fa9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:01.229149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52d7e8-a0db-441e-9c87-d0ac1682fa9c service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:01.229149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52d7e8-a0db-441e-9c87-d0ac1682fa9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:01.233600 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52d7e8-a0db-441e-9c87-d0ac1682fa9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:01.264047 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52d7e8-a0db-441e-9c87-d0ac1682fa9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:01.270705 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52d7e8-a0db-441e-9c87-d0ac1682fa9c service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:01.329214 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 894/1780] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:01 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:01.922576 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b84445-160a-42b1-971b-2099ebc43688 service cinder] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:01.933222 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b84445-160a-42b1-971b-2099ebc43688 service cinder] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:01.951024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b198837-10ab-49e9-9273-ac4e37d2d709 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:01.955100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b198837-10ab-49e9-9273-ac4e37d2d709 service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:01.955924 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b198837-10ab-49e9-9273-ac4e37d2d709 service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:01.957183 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b198837-10ab-49e9-9273-ac4e37d2d709 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:02.088414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:02.341449 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b198837-10ab-49e9-9273-ac4e37d2d709 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:02.344587 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b198837-10ab-49e9-9273-ac4e37d2d709 service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:02.387035 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 887/1781] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:01 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:02.400058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28303b77-7729-41e9-822d-ea7d7be57a97 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:02.401639 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28303b77-7729-41e9-822d-ea7d7be57a97 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:02.402264 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28303b77-7729-41e9-822d-ea7d7be57a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:02.475978 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-28303b77-7729-41e9-822d-ea7d7be57a97 None None] MFA Rules not processed for user `2fedd4e015384379bf41c2e01ecc0a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:02.480114 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-28303b77-7729-41e9-822d-ea7d7be57a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:02.811907 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 895/1782] 10.222.0.61 () {58 vars in 1015 bytes} [Thu Jul 14 12:09:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:02.974114 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b198837-10ab-49e9-9273-ac4e37d2d709 service cinder] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:02.976896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-7b198837-10ab-49e9-9273-ac4e37d2d709 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:03.020916 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b198837-10ab-49e9-9273-ac4e37d2d709 service cinder] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:03.033885 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388b089-ae2c-4703-900b-0ce039cc21eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:03.036274 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28303b77-7729-41e9-822d-ea7d7be57a97 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:03.049811 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388b089-ae2c-4703-900b-0ce039cc21eb service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:03.051271 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388b089-ae2c-4703-900b-0ce039cc21eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:03.051557 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388b089-ae2c-4703-900b-0ce039cc21eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:03.103158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388b089-ae2c-4703-900b-0ce039cc21eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:03.112907 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388b089-ae2c-4703-900b-0ce039cc21eb service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:03.167076 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 888/1783] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:09:03.363240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28303b77-7729-41e9-822d-ea7d7be57a97 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:03.399420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9108f4-9e44-44a5-98a7-12c9d49271f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:03.400789 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9108f4-9e44-44a5-98a7-12c9d49271f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:03.402139 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9108f4-9e44-44a5-98a7-12c9d49271f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:03.403888 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9108f4-9e44-44a5-98a7-12c9d49271f4 admin admin] PATH_INFO: `/v3/users/3d715176862b4ff583b115ef612bb73e` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:03.409152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9108f4-9e44-44a5-98a7-12c9d49271f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d715176862b4ff583b115ef612bb73e)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:03.421698 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9108f4-9e44-44a5-98a7-12c9d49271f4 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:03.543850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0d9108f4-9e44-44a5-98a7-12c9d49271f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d715176862b4ff583b115ef612bb73e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:03.557908 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0d9108f4-9e44-44a5-98a7-12c9d49271f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d715176862b4ff583b115ef612bb73e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:03.576244 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0d9108f4-9e44-44a5-98a7-12c9d49271f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d715176862b4ff583b115ef612bb73e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:03.616522 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0d9108f4-9e44-44a5-98a7-12c9d49271f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d715176862b4ff583b115ef612bb73e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:03.618967 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0d9108f4-9e44-44a5-98a7-12c9d49271f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d715176862b4ff583b115ef612bb73e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:03.635157 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 896/1784] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:03 2022] DELETE /identity/v3/users/3d715176862b4ff583b115ef612bb73e => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:03.641404 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f364a6-c205-4b33-84e3-b2128e15b0bd None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:03.642051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f364a6-c205-4b33-84e3-b2128e15b0bd None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:03.642418 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f364a6-c205-4b33-84e3-b2128e15b0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:03.733412 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-c5f364a6-c205-4b33-84e3-b2128e15b0bd None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:03.737012 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-c5f364a6-c205-4b33-84e3-b2128e15b0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:03.787757 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb06ef-c8bf-4ce1-91f3-c92dbf29f173 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:03.788195 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb06ef-c8bf-4ce1-91f3-c92dbf29f173 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:03.788573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb06ef-c8bf-4ce1-91f3-c92dbf29f173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:03.845253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:03.876051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-68eb06ef-c8bf-4ce1-91f3-c92dbf29f173 None None] MFA Rules not processed for user `872baef9cd4a4668a23a4d0fb361f354`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:03.880011 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-68eb06ef-c8bf-4ce1-91f3-c92dbf29f173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:03.956623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 889/1785] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:09:03.966835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f364a6-c205-4b33-84e3-b2128e15b0bd None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:03.969314 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-c5f364a6-c205-4b33-84e3-b2128e15b0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:04.086666 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 897/1786] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:03 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:09:04.114133 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f364a6-c205-4b33-84e3-b2128e15b0bd None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:04.118701 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38171a5-e6b3-4ee3-8883-faff2dae8d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:04.119421 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38171a5-e6b3-4ee3-8883-faff2dae8d50 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:04.119702 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38171a5-e6b3-4ee3-8883-faff2dae8d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:04.119972 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38171a5-e6b3-4ee3-8883-faff2dae8d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:04.159515 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38171a5-e6b3-4ee3-8883-faff2dae8d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:04.167139 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38171a5-e6b3-4ee3-8883-faff2dae8d50 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:04.200742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 890/1787] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:09:06.376478 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55ddd7-bbcf-4911-9532-697acb837162 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:06.377522 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55ddd7-bbcf-4911-9532-697acb837162 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:06.377860 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55ddd7-bbcf-4911-9532-697acb837162 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:06.386879 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 898/1788] 10.222.0.79 () {54 vars in 921 bytes} [Thu Jul 14 12:09:06 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:09:06.440890 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d402bc-74be-4428-8075-4b3c35b1c9e5 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:06.441339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d402bc-74be-4428-8075-4b3c35b1c9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:06.441339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d402bc-74be-4428-8075-4b3c35b1c9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:06.503077 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-52d402bc-74be-4428-8075-4b3c35b1c9e5 None None] MFA Rules not processed for user `e41a4d3a822c403fad048764a0edf209`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:06.504714 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-52d402bc-74be-4428-8075-4b3c35b1c9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:06.750780 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:06.826123 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 891/1789] 10.222.0.79 () {58 vars in 1018 bytes} [Thu Jul 14 12:09:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:09:07.033230 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55ddd7-bbcf-4911-9532-697acb837162 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:07.035378 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-de55ddd7-bbcf-4911-9532-697acb837162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:07.101247 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55ddd7-bbcf-4911-9532-697acb837162 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:07.125402 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094500ae-ccbd-46f2-81d0-c944f2f2e21a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:07.127580 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094500ae-ccbd-46f2-81d0-c944f2f2e21a service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:07.127872 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094500ae-ccbd-46f2-81d0-c944f2f2e21a service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:07.131339 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094500ae-ccbd-46f2-81d0-c944f2f2e21a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:07.170179 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094500ae-ccbd-46f2-81d0-c944f2f2e21a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:07.175396 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094500ae-ccbd-46f2-81d0-c944f2f2e21a service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:07.233804 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 899/1790] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:09.299511 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7813aa-9df5-45a1-a2f4-5adac574dd03 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:09.300451 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7813aa-9df5-45a1-a2f4-5adac574dd03 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:09.300894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7813aa-9df5-45a1-a2f4-5adac574dd03 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:09.303072 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 892/1791] 10.222.0.79 () {54 vars in 921 bytes} [Thu Jul 14 12:09:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:09:09.372741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e58fd-763e-499c-8510-278c6fe6ee46 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:09.373353 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e58fd-763e-499c-8510-278c6fe6ee46 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:09.373353 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e58fd-763e-499c-8510-278c6fe6ee46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:09.447662 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-184e58fd-763e-499c-8510-278c6fe6ee46 None None] MFA Rules not processed for user `d6070c6b901f4e2ebe621a3e42dd2d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:09.448880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-184e58fd-763e-499c-8510-278c6fe6ee46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:09.599475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 900/1792] 10.222.0.79 () {58 vars in 1018 bytes} [Thu Jul 14 12:09:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:10.006720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7813aa-9df5-45a1-a2f4-5adac574dd03 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:10.008756 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-db7813aa-9df5-45a1-a2f4-5adac574dd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:10.067811 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7813aa-9df5-45a1-a2f4-5adac574dd03 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:10.087323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131532c-5dfd-4f01-8c30-266916662b51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6070c6b901f4e2ebe621a3e42dd2d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:10.090468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131532c-5dfd-4f01-8c30-266916662b51 service placement] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:10.092745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131532c-5dfd-4f01-8c30-266916662b51 service placement] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:10.103963 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131532c-5dfd-4f01-8c30-266916662b51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:10.141541 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131532c-5dfd-4f01-8c30-266916662b51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:10.145815 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131532c-5dfd-4f01-8c30-266916662b51 service placement] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:10.197574 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 893/1793] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:10.360292 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e58fd-763e-499c-8510-278c6fe6ee46 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:10.362219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-184e58fd-763e-499c-8510-278c6fe6ee46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:10.424671 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e58fd-763e-499c-8510-278c6fe6ee46 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:10.446728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17755727-b57f-48e1-9023-ca1061266012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:10.447756 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17755727-b57f-48e1-9023-ca1061266012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:10.448118 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17755727-b57f-48e1-9023-ca1061266012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:10.448462 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17755727-b57f-48e1-9023-ca1061266012 admin admin] PATH_INFO: `/v3/users/c3228abc646c4d5fa1b2566d25caebd9` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:10.449841 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17755727-b57f-48e1-9023-ca1061266012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3228abc646c4d5fa1b2566d25caebd9)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:10.451977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17755727-b57f-48e1-9023-ca1061266012 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:10.582735 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-17755727-b57f-48e1-9023-ca1061266012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3228abc646c4d5fa1b2566d25caebd9'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:10.611632 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-17755727-b57f-48e1-9023-ca1061266012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3228abc646c4d5fa1b2566d25caebd9'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:10.623360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-17755727-b57f-48e1-9023-ca1061266012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3228abc646c4d5fa1b2566d25caebd9'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:10.649155 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:10.658483 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-17755727-b57f-48e1-9023-ca1061266012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3228abc646c4d5fa1b2566d25caebd9'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:10.659559 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-17755727-b57f-48e1-9023-ca1061266012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3228abc646c4d5fa1b2566d25caebd9'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:10.680389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 901/1794] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:10 2022] DELETE /identity/v3/users/c3228abc646c4d5fa1b2566d25caebd9 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:10.680550 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9936a60-702b-4415-b7d4-cf69e2298498 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:10.680550 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9936a60-702b-4415-b7d4-cf69e2298498 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:10.680550 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9936a60-702b-4415-b7d4-cf69e2298498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:10.726383 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-e9936a60-702b-4415-b7d4-cf69e2298498 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:10.734445 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e9936a60-702b-4415-b7d4-cf69e2298498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:10.840006 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 894/1795] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:10.902883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17755727-b57f-48e1-9023-ca1061266012 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:10.921147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-17755727-b57f-48e1-9023-ca1061266012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:11.023293 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17755727-b57f-48e1-9023-ca1061266012 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:11.027183 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596d8ef-b558-4c7b-b999-aa3bf5a61053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:11.028308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596d8ef-b558-4c7b-b999-aa3bf5a61053 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:11.028707 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596d8ef-b558-4c7b-b999-aa3bf5a61053 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:11.028993 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596d8ef-b558-4c7b-b999-aa3bf5a61053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:11.048645 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596d8ef-b558-4c7b-b999-aa3bf5a61053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:11.051004 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596d8ef-b558-4c7b-b999-aa3bf5a61053 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:11.074729 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 902/1796] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:11.241008 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9936a60-702b-4415-b7d4-cf69e2298498 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:11.242654 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e9936a60-702b-4415-b7d4-cf69e2298498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:11.279728 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9936a60-702b-4415-b7d4-cf69e2298498 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:11.290951 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e99cf-86c2-428b-a014-7a1047ef08ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:11.298923 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e99cf-86c2-428b-a014-7a1047ef08ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:11.303064 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e99cf-86c2-428b-a014-7a1047ef08ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:11.303510 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e99cf-86c2-428b-a014-7a1047ef08ce admin admin] PATH_INFO: `/v3/projects/7793ae66072b4f25a2d88a3ab3a0b832` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:11.307126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e99cf-86c2-428b-a014-7a1047ef08ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=7793ae66072b4f25a2d88a3ab3a0b832)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:11.309236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e99cf-86c2-428b-a014-7a1047ef08ce admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:11.504692 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-758e99cf-86c2-428b-a014-7a1047ef08ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7793ae66072b4f25a2d88a3ab3a0b832', 'request_id': 'req-758e99cf-86c2-428b-a014-7a1047ef08ce'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:11.543467 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-758e99cf-86c2-428b-a014-7a1047ef08ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7793ae66072b4f25a2d88a3ab3a0b832', 'request_id': 'req-758e99cf-86c2-428b-a014-7a1047ef08ce'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:11.567537 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-758e99cf-86c2-428b-a014-7a1047ef08ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7793ae66072b4f25a2d88a3ab3a0b832', 'request_id': 'req-758e99cf-86c2-428b-a014-7a1047ef08ce'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:11.611921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-758e99cf-86c2-428b-a014-7a1047ef08ce admin admin] The token cache is being invalidate because project 7793ae66072b4f25a2d88a3ab3a0b832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:11.612687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-758e99cf-86c2-428b-a014-7a1047ef08ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:11.614418 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-758e99cf-86c2-428b-a014-7a1047ef08ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:11.623842 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 895/1797] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:11 2022] DELETE /identity/v3/projects/7793ae66072b4f25a2d88a3ab3a0b832 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:11.625080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596d8ef-b558-4c7b-b999-aa3bf5a61053 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:11.656301 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596d8ef-b558-4c7b-b999-aa3bf5a61053 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:11.803843 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7c236-736e-4d38-8392-28c31d59025c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:11.805062 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7c236-736e-4d38-8392-28c31d59025c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:11.805504 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7c236-736e-4d38-8392-28c31d59025c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:11.805941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7c236-736e-4d38-8392-28c31d59025c admin admin] PATH_INFO: `/v3/users/10278b4f9ff84bf3ab95f8c51a701656` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:11.807826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7c236-736e-4d38-8392-28c31d59025c admin admin] RBAC: Authorizing `identity:delete_user(user_id=10278b4f9ff84bf3ab95f8c51a701656)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:11.810319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7c236-736e-4d38-8392-28c31d59025c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:11.900276 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-88e7c236-736e-4d38-8392-28c31d59025c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10278b4f9ff84bf3ab95f8c51a701656'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:11.915043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-88e7c236-736e-4d38-8392-28c31d59025c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10278b4f9ff84bf3ab95f8c51a701656'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:11.931610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-88e7c236-736e-4d38-8392-28c31d59025c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10278b4f9ff84bf3ab95f8c51a701656'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:11.954630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-88e7c236-736e-4d38-8392-28c31d59025c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10278b4f9ff84bf3ab95f8c51a701656'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:11.955515 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-88e7c236-736e-4d38-8392-28c31d59025c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10278b4f9ff84bf3ab95f8c51a701656'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:11.969909 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 903/1798] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:11 2022] DELETE /identity/v3/users/10278b4f9ff84bf3ab95f8c51a701656 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:12.921513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938eede-10d0-4f88-bb31-f2f170e65212 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:12.922376 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938eede-10d0-4f88-bb31-f2f170e65212 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:12.922829 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938eede-10d0-4f88-bb31-f2f170e65212 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:12.924861 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 896/1799] 10.222.0.79 () {54 vars in 921 bytes} [Thu Jul 14 12:09:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:09:12.968423 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55f074-d94a-4586-925d-ebe86953c7e0 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:12.968930 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55f074-d94a-4586-925d-ebe86953c7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:12.969023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55f074-d94a-4586-925d-ebe86953c7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:12.998760 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3e55f074-d94a-4586-925d-ebe86953c7e0 None None] MFA Rules not processed for user `d6070c6b901f4e2ebe621a3e42dd2d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:13.005021 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3e55f074-d94a-4586-925d-ebe86953c7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:13.034145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:13.095973 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938eede-10d0-4f88-bb31-f2f170e65212 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:13.098322 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e938eede-10d0-4f88-bb31-f2f170e65212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:13.218260 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 904/1800] 10.222.0.79 () {58 vars in 1018 bytes} [Thu Jul 14 12:09:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:13.249235 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55f074-d94a-4586-925d-ebe86953c7e0 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:13.250987 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3e55f074-d94a-4586-925d-ebe86953c7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:13.280571 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55f074-d94a-4586-925d-ebe86953c7e0 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:13.294943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddca78e-d260-4ffb-81df-cc7ff4c16ea1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6070c6b901f4e2ebe621a3e42dd2d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:13.299332 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddca78e-d260-4ffb-81df-cc7ff4c16ea1 service placement] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:13.299332 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddca78e-d260-4ffb-81df-cc7ff4c16ea1 service placement] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:13.299332 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddca78e-d260-4ffb-81df-cc7ff4c16ea1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:13.321385 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:13.332275 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddca78e-d260-4ffb-81df-cc7ff4c16ea1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:13.334330 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddca78e-d260-4ffb-81df-cc7ff4c16ea1 service placement] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:13.359482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938eede-10d0-4f88-bb31-f2f170e65212 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:13.365126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9d35c-0d5d-43ea-b172-b58e69b45174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:13.366077 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9d35c-0d5d-43ea-b172-b58e69b45174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:13.366415 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9d35c-0d5d-43ea-b172-b58e69b45174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:13.366810 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9d35c-0d5d-43ea-b172-b58e69b45174 admin admin] PATH_INFO: `/v3/users/3bbfece64cb94565b1a733ae486a4635` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:13.367048 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 905/1801] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:13.368128 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9d35c-0d5d-43ea-b172-b58e69b45174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bbfece64cb94565b1a733ae486a4635)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:13.371067 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9d35c-0d5d-43ea-b172-b58e69b45174 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:13.418550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddca78e-d260-4ffb-81df-cc7ff4c16ea1 service placement] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:13.420738 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5ddca78e-d260-4ffb-81df-cc7ff4c16ea1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:13.460026 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddca78e-d260-4ffb-81df-cc7ff4c16ea1 service placement] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:13.490179 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2156d-0b83-422b-98d1-8bbf07a346fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:13.495121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2156d-0b83-422b-98d1-8bbf07a346fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:13.495433 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2156d-0b83-422b-98d1-8bbf07a346fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:13.497195 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2156d-0b83-422b-98d1-8bbf07a346fc admin admin] PATH_INFO: `/v3/projects/c4b47822e37d47dc8673d3832bc84612` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:13.501034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2156d-0b83-422b-98d1-8bbf07a346fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4b47822e37d47dc8673d3832bc84612)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:13.513891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9db9d35c-0d5d-43ea-b172-b58e69b45174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bbfece64cb94565b1a733ae486a4635'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:13.514174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2156d-0b83-422b-98d1-8bbf07a346fc admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:13.533864 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9db9d35c-0d5d-43ea-b172-b58e69b45174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bbfece64cb94565b1a733ae486a4635'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:13.534767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9db9d35c-0d5d-43ea-b172-b58e69b45174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bbfece64cb94565b1a733ae486a4635'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:13.565031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9db9d35c-0d5d-43ea-b172-b58e69b45174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bbfece64cb94565b1a733ae486a4635'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:13.566062 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9db9d35c-0d5d-43ea-b172-b58e69b45174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bbfece64cb94565b1a733ae486a4635'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:13.626277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 897/1802] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:13 2022] DELETE /identity/v3/users/3bbfece64cb94565b1a733ae486a4635 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:13.627478 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9d35c-0d5d-43ea-b172-b58e69b45174 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:13.630901 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-9db9d35c-0d5d-43ea-b172-b58e69b45174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:13.667018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-30c2156d-0b83-422b-98d1-8bbf07a346fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4b47822e37d47dc8673d3832bc84612', 'request_id': 'req-30c2156d-0b83-422b-98d1-8bbf07a346fc'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:13.687005 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-30c2156d-0b83-422b-98d1-8bbf07a346fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4b47822e37d47dc8673d3832bc84612', 'request_id': 'req-30c2156d-0b83-422b-98d1-8bbf07a346fc'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:13.695552 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-30c2156d-0b83-422b-98d1-8bbf07a346fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4b47822e37d47dc8673d3832bc84612', 'request_id': 'req-30c2156d-0b83-422b-98d1-8bbf07a346fc'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:13.719104 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-30c2156d-0b83-422b-98d1-8bbf07a346fc admin admin] The token cache is being invalidate because project c4b47822e37d47dc8673d3832bc84612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:13.719549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-30c2156d-0b83-422b-98d1-8bbf07a346fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:13.720984 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-30c2156d-0b83-422b-98d1-8bbf07a346fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:13.723893 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 906/1803] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:13 2022] DELETE /identity/v3/projects/c4b47822e37d47dc8673d3832bc84612 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:13.725653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6ae0f-9f70-47bf-a45c-5b979061c570 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:13.726073 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6ae0f-9f70-47bf-a45c-5b979061c570 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:13.726687 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6ae0f-9f70-47bf-a45c-5b979061c570 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:13.731801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 907/1804] 10.222.0.79 () {54 vars in 921 bytes} [Thu Jul 14 12:09:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:09:13.734364 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052d3d4-b82b-4d5e-9cb1-050663c1f112 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:13.734685 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052d3d4-b82b-4d5e-9cb1-050663c1f112 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:13.735211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052d3d4-b82b-4d5e-9cb1-050663c1f112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:13.773021 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-d052d3d4-b82b-4d5e-9cb1-050663c1f112 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:13.774390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d052d3d4-b82b-4d5e-9cb1-050663c1f112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:13.779420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9d35c-0d5d-43ea-b172-b58e69b45174 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:13.870101 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74292c-e059-4710-921d-3123e2e58dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:13.871336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74292c-e059-4710-921d-3123e2e58dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:13.871822 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74292c-e059-4710-921d-3123e2e58dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:13.872272 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74292c-e059-4710-921d-3123e2e58dbe admin admin] PATH_INFO: `/v3/projects/d4bdebc5d857445b88f6cd0c233ff1d3` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:13.875194 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74292c-e059-4710-921d-3123e2e58dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4bdebc5d857445b88f6cd0c233ff1d3)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:13.877394 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74292c-e059-4710-921d-3123e2e58dbe admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:13.887500 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 908/1805] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:13.887500 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fb382-85ce-4463-94bb-25a904dbdb75 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:13.887500 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fb382-85ce-4463-94bb-25a904dbdb75 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:13.887500 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fb382-85ce-4463-94bb-25a904dbdb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:13.910022 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-834fb382-85ce-4463-94bb-25a904dbdb75 None None] MFA Rules not processed for user `e41a4d3a822c403fad048764a0edf209`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:13.911267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-834fb382-85ce-4463-94bb-25a904dbdb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:13.915019 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:13.931864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:13.961186 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1d74292c-e059-4710-921d-3123e2e58dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4bdebc5d857445b88f6cd0c233ff1d3', 'request_id': 'req-1d74292c-e059-4710-921d-3123e2e58dbe'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:13.970121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1d74292c-e059-4710-921d-3123e2e58dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4bdebc5d857445b88f6cd0c233ff1d3', 'request_id': 'req-1d74292c-e059-4710-921d-3123e2e58dbe'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:13.978407 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1d74292c-e059-4710-921d-3123e2e58dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4bdebc5d857445b88f6cd0c233ff1d3', 'request_id': 'req-1d74292c-e059-4710-921d-3123e2e58dbe'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:13.997131 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1d74292c-e059-4710-921d-3123e2e58dbe admin admin] The token cache is being invalidate because project d4bdebc5d857445b88f6cd0c233ff1d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:13.997743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1d74292c-e059-4710-921d-3123e2e58dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:13.999351 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1d74292c-e059-4710-921d-3123e2e58dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:14.001492 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 898/1806] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:13 2022] DELETE /identity/v3/projects/d4bdebc5d857445b88f6cd0c233ff1d3 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:14.004432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd03659-b870-4a64-9b98-ad0b336784d1 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:14.004683 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd03659-b870-4a64-9b98-ad0b336784d1 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:14.004978 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd03659-b870-4a64-9b98-ad0b336784d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:14.047408 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-3fd03659-b870-4a64-9b98-ad0b336784d1 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:14.048086 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 909/1807] 10.222.0.79 () {58 vars in 1018 bytes} [Thu Jul 14 12:09:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:14.048925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-3fd03659-b870-4a64-9b98-ad0b336784d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:14.049195 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fb382-85ce-4463-94bb-25a904dbdb75 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:14.052526 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-834fb382-85ce-4463-94bb-25a904dbdb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:14.085302 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fb382-85ce-4463-94bb-25a904dbdb75 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:14.136544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 899/1808] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:14.137525 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd03659-b870-4a64-9b98-ad0b336784d1 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:14.139451 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-3fd03659-b870-4a64-9b98-ad0b336784d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:14.155809 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd03659-b870-4a64-9b98-ad0b336784d1 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:14.162671 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b026e-703e-46b1-96de-fb03d98354a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:14.164870 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b026e-703e-46b1-96de-fb03d98354a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:14.165240 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b026e-703e-46b1-96de-fb03d98354a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:14.165594 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b026e-703e-46b1-96de-fb03d98354a7 admin admin] PATH_INFO: `/v3/users/1d588cdb73e741259fe956233f12aa54` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:14.167327 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b026e-703e-46b1-96de-fb03d98354a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d588cdb73e741259fe956233f12aa54)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:14.170913 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b026e-703e-46b1-96de-fb03d98354a7 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:14.189984 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf2092-518f-4d13-b12f-6800b80f7e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:14.190988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf2092-518f-4d13-b12f-6800b80f7e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:14.191278 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf2092-518f-4d13-b12f-6800b80f7e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:14.191775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf2092-518f-4d13-b12f-6800b80f7e1e admin admin] PATH_INFO: `/v3/projects/76a36dd094284d0bb9c131ffbbd9540d` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:14.197255 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf2092-518f-4d13-b12f-6800b80f7e1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=76a36dd094284d0bb9c131ffbbd9540d)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:14.199286 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf2092-518f-4d13-b12f-6800b80f7e1e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:14.244985 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-b33b026e-703e-46b1-96de-fb03d98354a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d588cdb73e741259fe956233f12aa54'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:14.256696 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-b33b026e-703e-46b1-96de-fb03d98354a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d588cdb73e741259fe956233f12aa54'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:14.257886 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-b33b026e-703e-46b1-96de-fb03d98354a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d588cdb73e741259fe956233f12aa54'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:14.278523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-b33b026e-703e-46b1-96de-fb03d98354a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d588cdb73e741259fe956233f12aa54'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:14.280105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-b33b026e-703e-46b1-96de-fb03d98354a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d588cdb73e741259fe956233f12aa54'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:14.298187 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 900/1809] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:14 2022] DELETE /identity/v3/users/1d588cdb73e741259fe956233f12aa54 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:14.301067 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b026e-703e-46b1-96de-fb03d98354a7 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:14.301067 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b33b026e-703e-46b1-96de-fb03d98354a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:14.308613 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4dcf2092-518f-4d13-b12f-6800b80f7e1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76a36dd094284d0bb9c131ffbbd9540d', 'request_id': 'req-4dcf2092-518f-4d13-b12f-6800b80f7e1e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:14.317865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4dcf2092-518f-4d13-b12f-6800b80f7e1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76a36dd094284d0bb9c131ffbbd9540d', 'request_id': 'req-4dcf2092-518f-4d13-b12f-6800b80f7e1e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:14.325635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4dcf2092-518f-4d13-b12f-6800b80f7e1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76a36dd094284d0bb9c131ffbbd9540d', 'request_id': 'req-4dcf2092-518f-4d13-b12f-6800b80f7e1e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:14.346892 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:14.350741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4dcf2092-518f-4d13-b12f-6800b80f7e1e admin admin] The token cache is being invalidate because project 76a36dd094284d0bb9c131ffbbd9540d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:14.351338 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4dcf2092-518f-4d13-b12f-6800b80f7e1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:14.352111 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4dcf2092-518f-4d13-b12f-6800b80f7e1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:14.354424 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 910/1810] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:14 2022] DELETE /identity/v3/projects/76a36dd094284d0bb9c131ffbbd9540d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:14.355460 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf2092-518f-4d13-b12f-6800b80f7e1e admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:14.360175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4dcf2092-518f-4d13-b12f-6800b80f7e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:14.430403 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:14.445017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b026e-703e-46b1-96de-fb03d98354a7 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:14.453469 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65be0f-6121-4557-98e2-bdd4feaef572 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:14.454833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65be0f-6121-4557-98e2-bdd4feaef572 service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:14.455354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65be0f-6121-4557-98e2-bdd4feaef572 service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:14.456002 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65be0f-6121-4557-98e2-bdd4feaef572 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:14.458631 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-7a65be0f-6121-4557-98e2-bdd4feaef572 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:14.468722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf2092-518f-4d13-b12f-6800b80f7e1e admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:14.479140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65be0f-6121-4557-98e2-bdd4feaef572 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:14.481225 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65be0f-6121-4557-98e2-bdd4feaef572 service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:14.520490 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 901/1811] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:14.521980 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65be0f-6121-4557-98e2-bdd4feaef572 service nova] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:14.523757 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-7a65be0f-6121-4557-98e2-bdd4feaef572 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:14.612820 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816595d-3da6-4e11-9bca-ac5abf3abe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:14.613762 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816595d-3da6-4e11-9bca-ac5abf3abe7b admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:14.614160 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816595d-3da6-4e11-9bca-ac5abf3abe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:14.614566 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816595d-3da6-4e11-9bca-ac5abf3abe7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:14.615420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816595d-3da6-4e11-9bca-ac5abf3abe7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:09:14.615840 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816595d-3da6-4e11-9bca-ac5abf3abe7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:14.618213 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816595d-3da6-4e11-9bca-ac5abf3abe7b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:14.630909 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65be0f-6121-4557-98e2-bdd4feaef572 service nova] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:14.638918 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 911/1812] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:09:14.640022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3006e7-1305-41d2-b156-6b913371930e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:14.640180 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816595d-3da6-4e11-9bca-ac5abf3abe7b admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:14.641412 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3006e7-1305-41d2-b156-6b913371930e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:14.641745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3006e7-1305-41d2-b156-6b913371930e admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:14.642026 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3006e7-1305-41d2-b156-6b913371930e admin admin] PATH_INFO: `/v3/users/872baef9cd4a4668a23a4d0fb361f354` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:14.643580 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3006e7-1305-41d2-b156-6b913371930e admin admin] RBAC: Authorizing `identity:delete_user(user_id=872baef9cd4a4668a23a4d0fb361f354)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:14.645876 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3006e7-1305-41d2-b156-6b913371930e admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:14.660031 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816595d-3da6-4e11-9bca-ac5abf3abe7b admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:14.667546 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a27ca-0069-4b7b-9ae3-cde3762dc8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:14.669673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a27ca-0069-4b7b-9ae3-cde3762dc8e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:14.670688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a27ca-0069-4b7b-9ae3-cde3762dc8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:14.671434 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a27ca-0069-4b7b-9ae3-cde3762dc8e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:14.671821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a27ca-0069-4b7b-9ae3-cde3762dc8e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:14.674089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a27ca-0069-4b7b-9ae3-cde3762dc8e7 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:14.714571 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 912/1813] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:14 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:14.715734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a27ca-0069-4b7b-9ae3-cde3762dc8e7 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:14.744584 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-bd3006e7-1305-41d2-b156-6b913371930e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872baef9cd4a4668a23a4d0fb361f354'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:14.755112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-bd3006e7-1305-41d2-b156-6b913371930e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872baef9cd4a4668a23a4d0fb361f354'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:14.758113 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-bd3006e7-1305-41d2-b156-6b913371930e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872baef9cd4a4668a23a4d0fb361f354'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:14.778275 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-bd3006e7-1305-41d2-b156-6b913371930e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872baef9cd4a4668a23a4d0fb361f354'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:14.779437 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-bd3006e7-1305-41d2-b156-6b913371930e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872baef9cd4a4668a23a4d0fb361f354'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:14.804817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 902/1814] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:14 2022] DELETE /identity/v3/users/872baef9cd4a4668a23a4d0fb361f354 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:14.808118 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a27ca-0069-4b7b-9ae3-cde3762dc8e7 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:14.817586 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3006e7-1305-41d2-b156-6b913371930e admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:14.820292 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-bd3006e7-1305-41d2-b156-6b913371930e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:14.877674 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54859f-56a3-4465-921d-e18b7d290fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:14.878473 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54859f-56a3-4465-921d-e18b7d290fcc admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:14.878922 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54859f-56a3-4465-921d-e18b7d290fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:14.879406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54859f-56a3-4465-921d-e18b7d290fcc admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:14.880221 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54859f-56a3-4465-921d-e18b7d290fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:14.882374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54859f-56a3-4465-921d-e18b7d290fcc admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:14.890196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:14.906127 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:14.933296 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 913/1815] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:14 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:09:14.940231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54859f-56a3-4465-921d-e18b7d290fcc admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:14.942803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-aa54859f-56a3-4465-921d-e18b7d290fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:14.952212 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3006e7-1305-41d2-b156-6b913371930e admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:14.957710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4b6eb-f963-492d-b9de-e376067ce2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:14.959841 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4b6eb-f963-492d-b9de-e376067ce2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:14.959841 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4b6eb-f963-492d-b9de-e376067ce2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:14.960232 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4b6eb-f963-492d-b9de-e376067ce2e9 admin admin] PATH_INFO: `/v3/projects/5874ae83ee8d47abb1c4f099930af098` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:14.973726 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4b6eb-f963-492d-b9de-e376067ce2e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5874ae83ee8d47abb1c4f099930af098)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:14.977318 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4b6eb-f963-492d-b9de-e376067ce2e9 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:14.999026 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54859f-56a3-4465-921d-e18b7d290fcc admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:15.020812 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2cbe0-0246-472a-bc8d-249c77c934c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:15.021964 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2cbe0-0246-472a-bc8d-249c77c934c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:15.022443 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2cbe0-0246-472a-bc8d-249c77c934c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:15.022969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2cbe0-0246-472a-bc8d-249c77c934c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:15.024313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2cbe0-0246-472a-bc8d-249c77c934c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:15.028703 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2cbe0-0246-472a-bc8d-249c77c934c2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:15.056497 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 914/1816] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:15.058035 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2cbe0-0246-472a-bc8d-249c77c934c2 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:15.075137 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-cba4b6eb-f963-492d-b9de-e376067ce2e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5874ae83ee8d47abb1c4f099930af098', 'request_id': 'req-cba4b6eb-f963-492d-b9de-e376067ce2e9'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:15.078583 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2cbe0-0246-472a-bc8d-249c77c934c2 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:15.090186 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-cba4b6eb-f963-492d-b9de-e376067ce2e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5874ae83ee8d47abb1c4f099930af098', 'request_id': 'req-cba4b6eb-f963-492d-b9de-e376067ce2e9'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:15.103654 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-cba4b6eb-f963-492d-b9de-e376067ce2e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5874ae83ee8d47abb1c4f099930af098', 'request_id': 'req-cba4b6eb-f963-492d-b9de-e376067ce2e9'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:15.134457 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-cba4b6eb-f963-492d-b9de-e376067ce2e9 admin admin] The token cache is being invalidate because project 5874ae83ee8d47abb1c4f099930af098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:15.137529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-cba4b6eb-f963-492d-b9de-e376067ce2e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:15.143062 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-cba4b6eb-f963-492d-b9de-e376067ce2e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:15.148263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 903/1817] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:14 2022] DELETE /identity/v3/projects/5874ae83ee8d47abb1c4f099930af098 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:15.155755 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37424e63-b629-47eb-88fa-48fdae537687 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:15.156043 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37424e63-b629-47eb-88fa-48fdae537687 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:15.156335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37424e63-b629-47eb-88fa-48fdae537687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:15.185567 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747e3ca-6eb7-4d51-8a49-5770da4a2e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:15.187188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747e3ca-6eb7-4d51-8a49-5770da4a2e40 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:15.187501 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747e3ca-6eb7-4d51-8a49-5770da4a2e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:15.187783 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747e3ca-6eb7-4d51-8a49-5770da4a2e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:15.188531 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747e3ca-6eb7-4d51-8a49-5770da4a2e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:15.194397 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747e3ca-6eb7-4d51-8a49-5770da4a2e40 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:15.213207 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 915/1818] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:15.219018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747e3ca-6eb7-4d51-8a49-5770da4a2e40 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:15.222045 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-37424e63-b629-47eb-88fa-48fdae537687 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:15.225552 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0747e3ca-6eb7-4d51-8a49-5770da4a2e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:15.226303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-37424e63-b629-47eb-88fa-48fdae537687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:15.257050 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 904/1819] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:15.272046 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77c042-9382-4b70-94c9-fb7cef21deb3 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:15.272348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77c042-9382-4b70-94c9-fb7cef21deb3 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:15.272674 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77c042-9382-4b70-94c9-fb7cef21deb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:15.289085 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747e3ca-6eb7-4d51-8a49-5770da4a2e40 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:15.303212 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123a052-fb31-4ad5-b6d3-caed88bd482d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:15.304418 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123a052-fb31-4ad5-b6d3-caed88bd482d admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:15.304549 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-dd77c042-9382-4b70-94c9-fb7cef21deb3 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:15.304962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123a052-fb31-4ad5-b6d3-caed88bd482d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:15.305388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123a052-fb31-4ad5-b6d3-caed88bd482d admin admin] PATH_INFO: `/v3/projects/51a070a56ef747ca979c7f072a00bf26/users/f041f57093f942cabda4c11e30013785/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:15.307983 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-dd77c042-9382-4b70-94c9-fb7cef21deb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:15.341087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123a052-fb31-4ad5-b6d3-caed88bd482d admin admin] RBAC: Authorizing `identity:create_grant(project_id=51a070a56ef747ca979c7f072a00bf26, user_id=f041f57093f942cabda4c11e30013785, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:15.347605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123a052-fb31-4ad5-b6d3-caed88bd482d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:15.362954 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 905/1820] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:15.363896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77c042-9382-4b70-94c9-fb7cef21deb3 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:15.365234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-dd77c042-9382-4b70-94c9-fb7cef21deb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:15.380015 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77c042-9382-4b70-94c9-fb7cef21deb3 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:15.386543 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 916/1821] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:15 2022] PUT /identity/v3/projects/51a070a56ef747ca979c7f072a00bf26/users/f041f57093f942cabda4c11e30013785/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:15.387697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123a052-fb31-4ad5-b6d3-caed88bd482d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:15.567232 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d6140-73c3-44a4-b80e-b0232f483f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:15.568112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d6140-73c3-44a4-b80e-b0232f483f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:15.568911 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d6140-73c3-44a4-b80e-b0232f483f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:15.569211 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d6140-73c3-44a4-b80e-b0232f483f89 admin admin] PATH_INFO: `/v3/projects/2590f5a34e2f4d9e86727449d3c29db2` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:15.571055 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d6140-73c3-44a4-b80e-b0232f483f89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2590f5a34e2f4d9e86727449d3c29db2)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:15.572999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d6140-73c3-44a4-b80e-b0232f483f89 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:15.609085 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123a052-fb31-4ad5-b6d3-caed88bd482d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:15.614129 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07257c8-77fd-4edc-a420-e77182721a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:15.614967 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07257c8-77fd-4edc-a420-e77182721a90 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:15.615611 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07257c8-77fd-4edc-a420-e77182721a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:15.615611 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07257c8-77fd-4edc-a420-e77182721a90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:15.616861 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07257c8-77fd-4edc-a420-e77182721a90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:09:15.618023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07257c8-77fd-4edc-a420-e77182721a90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:15.619794 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07257c8-77fd-4edc-a420-e77182721a90 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:15.651752 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 917/1822] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:09:15.653502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca955c4-b375-4ace-bd17-f04117a2e686 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:15.654079 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca955c4-b375-4ace-bd17-f04117a2e686 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:15.655050 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca955c4-b375-4ace-bd17-f04117a2e686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:15.667128 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:15.673850 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-857d6140-73c3-44a4-b80e-b0232f483f89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2590f5a34e2f4d9e86727449d3c29db2', 'request_id': 'req-857d6140-73c3-44a4-b80e-b0232f483f89'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:15.685865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-857d6140-73c3-44a4-b80e-b0232f483f89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2590f5a34e2f4d9e86727449d3c29db2', 'request_id': 'req-857d6140-73c3-44a4-b80e-b0232f483f89'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:15.691828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-8ca955c4-b375-4ace-bd17-f04117a2e686 None None] MFA Rules not processed for user `f041f57093f942cabda4c11e30013785`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:15.693273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8ca955c4-b375-4ace-bd17-f04117a2e686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:15.695243 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-857d6140-73c3-44a4-b80e-b0232f483f89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2590f5a34e2f4d9e86727449d3c29db2', 'request_id': 'req-857d6140-73c3-44a4-b80e-b0232f483f89'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:15.714192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-857d6140-73c3-44a4-b80e-b0232f483f89 admin admin] The token cache is being invalidate because project 2590f5a34e2f4d9e86727449d3c29db2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:15.714733 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-857d6140-73c3-44a4-b80e-b0232f483f89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:15.716012 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-857d6140-73c3-44a4-b80e-b0232f483f89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:15.719386 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 906/1823] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:15 2022] DELETE /identity/v3/projects/2590f5a34e2f4d9e86727449d3c29db2 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:15.720630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d6140-73c3-44a4-b80e-b0232f483f89 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:15.722109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-857d6140-73c3-44a4-b80e-b0232f483f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:15.749855 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:15.787006 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 918/1824] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:15.788541 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bae49e-ac11-454a-ad39-7b171d5e8f80 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:15.788938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bae49e-ac11-454a-ad39-7b171d5e8f80 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:15.789321 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bae49e-ac11-454a-ad39-7b171d5e8f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:15.810143 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-31bae49e-ac11-454a-ad39-7b171d5e8f80 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:15.811831 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d6140-73c3-44a4-b80e-b0232f483f89 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:15.812420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-31bae49e-ac11-454a-ad39-7b171d5e8f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:15.817203 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f1569-6bfb-49b0-a005-5e24aa5e824d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:15.818164 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f1569-6bfb-49b0-a005-5e24aa5e824d admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:15.818746 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f1569-6bfb-49b0-a005-5e24aa5e824d admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:15.819166 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f1569-6bfb-49b0-a005-5e24aa5e824d admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:15.820034 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f1569-6bfb-49b0-a005-5e24aa5e824d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:15.822382 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 919/1825] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:15.823399 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bae49e-ac11-454a-ad39-7b171d5e8f80 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:15.823705 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f1569-6bfb-49b0-a005-5e24aa5e824d admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:15.831823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-31bae49e-ac11-454a-ad39-7b171d5e8f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:15.850521 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bae49e-ac11-454a-ad39-7b171d5e8f80 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:15.858278 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23647e5-b30b-4914-af7f-c7d1b2166336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:15.859820 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23647e5-b30b-4914-af7f-c7d1b2166336 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:15.860440 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23647e5-b30b-4914-af7f-c7d1b2166336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:15.861016 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23647e5-b30b-4914-af7f-c7d1b2166336 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:15.862675 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23647e5-b30b-4914-af7f-c7d1b2166336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:15.865154 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23647e5-b30b-4914-af7f-c7d1b2166336 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:15.868830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 907/1826] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:15 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:15.868830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0be9b-3290-4664-bad2-c6e39e8d8dc9 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:15.868830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0be9b-3290-4664-bad2-c6e39e8d8dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:15.869291 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0be9b-3290-4664-bad2-c6e39e8d8dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:15.895451 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-95b0be9b-3290-4664-bad2-c6e39e8d8dc9 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:15.896837 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-95b0be9b-3290-4664-bad2-c6e39e8d8dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:15.918680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 920/1827] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:15 2022] POST /identity/v3/projects => generated 387 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:15.920999 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23647e5-b30b-4914-af7f-c7d1b2166336 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:15.986578 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 908/1828] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:15.986578 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0be9b-3290-4664-bad2-c6e39e8d8dc9 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:15.997644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0be9b-3290-4664-bad2-c6e39e8d8dc9 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:16.013275 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23647e5-b30b-4914-af7f-c7d1b2166336 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:16.021297 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3647938-edf4-4da0-aaf6-5ab1b232ecf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:16.022439 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3647938-edf4-4da0-aaf6-5ab1b232ecf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:16.023437 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3647938-edf4-4da0-aaf6-5ab1b232ecf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:16.023900 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3647938-edf4-4da0-aaf6-5ab1b232ecf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:16.024613 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3647938-edf4-4da0-aaf6-5ab1b232ecf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:16.027077 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3647938-edf4-4da0-aaf6-5ab1b232ecf5 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:16.066172 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 921/1829] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:15 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:16.069844 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3647938-edf4-4da0-aaf6-5ab1b232ecf5 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:16.083903 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3647938-edf4-4da0-aaf6-5ab1b232ecf5 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:16.089454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004939b-f11c-4c54-a77d-3eeb488298be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:16.090253 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa4827-18e8-4853-9a50-97ad039222d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:16.090548 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004939b-f11c-4c54-a77d-3eeb488298be admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:16.090995 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004939b-f11c-4c54-a77d-3eeb488298be admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:16.091600 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004939b-f11c-4c54-a77d-3eeb488298be admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:16.092866 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa4827-18e8-4853-9a50-97ad039222d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:16.093226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004939b-f11c-4c54-a77d-3eeb488298be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:09:16.093604 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa4827-18e8-4853-9a50-97ad039222d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:16.093779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004939b-f11c-4c54-a77d-3eeb488298be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:16.094336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa4827-18e8-4853-9a50-97ad039222d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:16.094922 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa4827-18e8-4853-9a50-97ad039222d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:16.095432 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004939b-f11c-4c54-a77d-3eeb488298be admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:16.097289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa4827-18e8-4853-9a50-97ad039222d9 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:16.106905 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:16.109989 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 922/1830] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:09:16.111156 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004939b-f11c-4c54-a77d-3eeb488298be admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:16.130364 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004939b-f11c-4c54-a77d-3eeb488298be admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:16.134932 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 909/1831] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:15 2022] POST /identity/v3/users => generated 300 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:16.135952 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa4827-18e8-4853-9a50-97ad039222d9 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:16.137999 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302c8ef-e192-4d0b-a9db-ac50722edb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:16.138852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302c8ef-e192-4d0b-a9db-ac50722edb80 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:16.139149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302c8ef-e192-4d0b-a9db-ac50722edb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:16.139432 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302c8ef-e192-4d0b-a9db-ac50722edb80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:16.140179 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f302c8ef-e192-4d0b-a9db-ac50722edb80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:16.141800 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f302c8ef-e192-4d0b-a9db-ac50722edb80 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:16.147390 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa4827-18e8-4853-9a50-97ad039222d9 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:16.151922 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b82f0-bf64-491a-88da-e7ffd062877d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:16.152732 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b82f0-bf64-491a-88da-e7ffd062877d admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:16.153022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b82f0-bf64-491a-88da-e7ffd062877d admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:16.153148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 923/1832] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:16.153360 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b82f0-bf64-491a-88da-e7ffd062877d admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:16.153881 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302c8ef-e192-4d0b-a9db-ac50722edb80 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:16.153988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b82f0-bf64-491a-88da-e7ffd062877d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:16.156550 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b82f0-bf64-491a-88da-e7ffd062877d admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:16.172158 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302c8ef-e192-4d0b-a9db-ac50722edb80 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:16.178311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83498b63-8111-4cf1-9219-338ef103d871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:16.179241 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83498b63-8111-4cf1-9219-338ef103d871 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:16.179622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83498b63-8111-4cf1-9219-338ef103d871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:16.179977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83498b63-8111-4cf1-9219-338ef103d871 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:16.180820 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83498b63-8111-4cf1-9219-338ef103d871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:16.182425 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83498b63-8111-4cf1-9219-338ef103d871 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:16.185927 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 910/1833] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:16 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:16.186793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b82f0-bf64-491a-88da-e7ffd062877d admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:16.193355 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 924/1834] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:16.194282 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83498b63-8111-4cf1-9219-338ef103d871 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:16.204679 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83498b63-8111-4cf1-9219-338ef103d871 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:16.253544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b82f0-bf64-491a-88da-e7ffd062877d admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:16.258623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984553b-9d21-4da4-9bc7-486a489fed04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:16.259302 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984553b-9d21-4da4-9bc7-486a489fed04 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:16.259742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984553b-9d21-4da4-9bc7-486a489fed04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:16.260028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984553b-9d21-4da4-9bc7-486a489fed04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:16.260764 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984553b-9d21-4da4-9bc7-486a489fed04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:16.262386 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984553b-9d21-4da4-9bc7-486a489fed04 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:16.265481 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7865a-8bc9-4918-a19c-6fbdc4550e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:16.266243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7865a-8bc9-4918-a19c-6fbdc4550e0a admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:16.266630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7865a-8bc9-4918-a19c-6fbdc4550e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:16.266975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7865a-8bc9-4918-a19c-6fbdc4550e0a admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:16.267739 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7865a-8bc9-4918-a19c-6fbdc4550e0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:16.269724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7865a-8bc9-4918-a19c-6fbdc4550e0a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:16.273544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 911/1835] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:16.277470 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984553b-9d21-4da4-9bc7-486a489fed04 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:16.288862 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984553b-9d21-4da4-9bc7-486a489fed04 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:16.289831 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:16.295474 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426a55b-d24b-4aa7-b2a0-d920f463a7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:16.296581 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426a55b-d24b-4aa7-b2a0-d920f463a7f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:16.296943 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426a55b-d24b-4aa7-b2a0-d920f463a7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:16.297299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426a55b-d24b-4aa7-b2a0-d920f463a7f0 admin admin] PATH_INFO: `/v3/projects/9add147801ba4028b4cd681a658492fe/users/2ffc5da328e24819a7695654267c1b68/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:16.298054 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 925/1836] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:16 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:16.299347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7865a-8bc9-4918-a19c-6fbdc4550e0a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:16.313830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7865a-8bc9-4918-a19c-6fbdc4550e0a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:16.314191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426a55b-d24b-4aa7-b2a0-d920f463a7f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9add147801ba4028b4cd681a658492fe, user_id=2ffc5da328e24819a7695654267c1b68, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:16.316995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426a55b-d24b-4aa7-b2a0-d920f463a7f0 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:16.318854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac067d-2eb8-4415-ac9b-47202712dec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:16.319784 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac067d-2eb8-4415-ac9b-47202712dec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:16.320067 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac067d-2eb8-4415-ac9b-47202712dec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:16.320350 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac067d-2eb8-4415-ac9b-47202712dec9 admin admin] PATH_INFO: `/v3/projects/00aba904a38b4d17a7ac322fcd7c265e/users/e53b8fd4b4ef4feba927f770fd6a09da/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:16.332486 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 912/1837] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:16 2022] PUT /identity/v3/projects/9add147801ba4028b4cd681a658492fe/users/2ffc5da328e24819a7695654267c1b68/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:16.333417 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426a55b-d24b-4aa7-b2a0-d920f463a7f0 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:16.338132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac067d-2eb8-4415-ac9b-47202712dec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00aba904a38b4d17a7ac322fcd7c265e, user_id=e53b8fd4b4ef4feba927f770fd6a09da, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:16.340990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac067d-2eb8-4415-ac9b-47202712dec9 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:16.366589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 926/1838] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:16 2022] PUT /identity/v3/projects/00aba904a38b4d17a7ac322fcd7c265e/users/e53b8fd4b4ef4feba927f770fd6a09da/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:16.369515 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac067d-2eb8-4415-ac9b-47202712dec9 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:16.416932 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426a55b-d24b-4aa7-b2a0-d920f463a7f0 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:16.455129 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac067d-2eb8-4415-ac9b-47202712dec9 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:16.463365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cd9a3-e46b-4a85-b955-5a839dff26b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:16.465768 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cd9a3-e46b-4a85-b955-5a839dff26b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:16.466227 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cd9a3-e46b-4a85-b955-5a839dff26b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:16.466685 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cd9a3-e46b-4a85-b955-5a839dff26b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:16.468019 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cd9a3-e46b-4a85-b955-5a839dff26b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:16.470482 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cd9a3-e46b-4a85-b955-5a839dff26b4 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:16.482891 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 927/1839] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:16.484085 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ac82d-7e5b-4aa0-99ef-cacce1d3ca03 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:16.484380 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ac82d-7e5b-4aa0-99ef-cacce1d3ca03 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:16.484658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ac82d-7e5b-4aa0-99ef-cacce1d3ca03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:16.486353 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:16.503531 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813192a4-1723-454b-a07b-f3c71ca8227f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:16.504224 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813192a4-1723-454b-a07b-f3c71ca8227f admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:16.504514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813192a4-1723-454b-a07b-f3c71ca8227f admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:16.504788 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813192a4-1723-454b-a07b-f3c71ca8227f admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:16.505519 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813192a4-1723-454b-a07b-f3c71ca8227f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:16.507499 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813192a4-1723-454b-a07b-f3c71ca8227f admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:16.507646 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-4a6ac82d-7e5b-4aa0-99ef-cacce1d3ca03 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:16.508789 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4a6ac82d-7e5b-4aa0-99ef-cacce1d3ca03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:16.523258 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 928/1840] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:16.523258 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ac82d-7e5b-4aa0-99ef-cacce1d3ca03 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:16.523506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 913/1841] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:16.523506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813192a4-1723-454b-a07b-f3c71ca8227f admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:16.535020 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ac82d-7e5b-4aa0-99ef-cacce1d3ca03 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:16.540455 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8604bc-c21b-443b-9f24-674331a21d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:16.541427 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8604bc-c21b-443b-9f24-674331a21d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:16.541713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8604bc-c21b-443b-9f24-674331a21d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:16.541990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8604bc-c21b-443b-9f24-674331a21d5f admin admin] PATH_INFO: `/v3/projects/9add147801ba4028b4cd681a658492fe/users/2ffc5da328e24819a7695654267c1b68/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:16.542486 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813192a4-1723-454b-a07b-f3c71ca8227f admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:16.546755 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8604bc-c21b-443b-9f24-674331a21d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9add147801ba4028b4cd681a658492fe, user_id=2ffc5da328e24819a7695654267c1b68, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:16.547184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8604bc-c21b-443b-9f24-674331a21d5f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:16.552785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbffe0b-00c7-457e-a271-937d81d59686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:16.553558 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbffe0b-00c7-457e-a271-937d81d59686 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:16.553913 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbffe0b-00c7-457e-a271-937d81d59686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:16.554260 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbffe0b-00c7-457e-a271-937d81d59686 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:16.555104 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbffe0b-00c7-457e-a271-937d81d59686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:16.556783 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbffe0b-00c7-457e-a271-937d81d59686 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:16.561657 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 929/1842] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:16 2022] PUT /identity/v3/projects/9add147801ba4028b4cd681a658492fe/users/2ffc5da328e24819a7695654267c1b68/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:16.562697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8604bc-c21b-443b-9f24-674331a21d5f admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:16.564926 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ba8604bc-c21b-443b-9f24-674331a21d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:16.568708 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 914/1843] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:16.573162 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6b70b-5ccf-4817-80ec-ef1bc784fd2d None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:16.573484 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6b70b-5ccf-4817-80ec-ef1bc784fd2d None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:16.573767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6b70b-5ccf-4817-80ec-ef1bc784fd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:16.602025 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-acb6b70b-5ccf-4817-80ec-ef1bc784fd2d None None] MFA Rules not processed for user `2ffc5da328e24819a7695654267c1b68`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:16.603354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-acb6b70b-5ccf-4817-80ec-ef1bc784fd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:16.628175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8604bc-c21b-443b-9f24-674331a21d5f admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:16.633349 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36caa93a-fd86-4c20-b751-9e6053e8fe58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:16.633349 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36caa93a-fd86-4c20-b751-9e6053e8fe58 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:16.633613 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36caa93a-fd86-4c20-b751-9e6053e8fe58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:16.633697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36caa93a-fd86-4c20-b751-9e6053e8fe58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:16.689660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 915/1844] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:09:16.690836 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6b70b-5ccf-4817-80ec-ef1bc784fd2d None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:16.711182 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36caa93a-fd86-4c20-b751-9e6053e8fe58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:16.712711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36caa93a-fd86-4c20-b751-9e6053e8fe58 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:16.718909 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:16.725431 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 930/1845] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:16.726783 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36caa93a-fd86-4c20-b751-9e6053e8fe58 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:16.728944 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-36caa93a-fd86-4c20-b751-9e6053e8fe58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:16.815918 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6b70b-5ccf-4817-80ec-ef1bc784fd2d None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:16.827266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da89ff0-8c32-44f5-9221-26d814c11931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:16.830690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da89ff0-8c32-44f5-9221-26d814c11931 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:16.831232 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da89ff0-8c32-44f5-9221-26d814c11931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:16.831487 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36caa93a-fd86-4c20-b751-9e6053e8fe58 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:16.831644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da89ff0-8c32-44f5-9221-26d814c11931 admin admin] PATH_INFO: `/v3/projects/4da49006c836483995ed1e860a95c398/users/81e656362ec047df992b32f1533f1741/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:16.835836 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd94af-e0a2-451f-8c9c-253b45f64ff8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:16.836684 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd94af-e0a2-451f-8c9c-253b45f64ff8 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:16.836973 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd94af-e0a2-451f-8c9c-253b45f64ff8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:16.837242 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd94af-e0a2-451f-8c9c-253b45f64ff8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:16.851521 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd94af-e0a2-451f-8c9c-253b45f64ff8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:16.853043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd94af-e0a2-451f-8c9c-253b45f64ff8 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:16.864344 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da89ff0-8c32-44f5-9221-26d814c11931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da49006c836483995ed1e860a95c398, user_id=81e656362ec047df992b32f1533f1741, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:16.868248 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da89ff0-8c32-44f5-9221-26d814c11931 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:16.874864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 931/1846] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:16.909587 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 916/1847] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:16 2022] PUT /identity/v3/projects/4da49006c836483995ed1e860a95c398/users/81e656362ec047df992b32f1533f1741/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:16.921934 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc869e6-d14c-4bb6-bee5-470e19eb90eb None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:16.922232 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc869e6-d14c-4bb6-bee5-470e19eb90eb None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:16.923615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc869e6-d14c-4bb6-bee5-470e19eb90eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:16.924975 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da89ff0-8c32-44f5-9221-26d814c11931 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:16.983235 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-cfc869e6-d14c-4bb6-bee5-470e19eb90eb None None] MFA Rules not processed for user `81e656362ec047df992b32f1533f1741`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:16.984610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-cfc869e6-d14c-4bb6-bee5-470e19eb90eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:17.010472 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:17.044471 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da89ff0-8c32-44f5-9221-26d814c11931 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:17.052371 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8916f-2b9b-4a20-a64e-71f6cbfe4982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:17.054770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8916f-2b9b-4a20-a64e-71f6cbfe4982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:17.055169 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8916f-2b9b-4a20-a64e-71f6cbfe4982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:17.055589 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8916f-2b9b-4a20-a64e-71f6cbfe4982 admin admin] PATH_INFO: `/v3/users/f041f57093f942cabda4c11e30013785` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:17.057784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8916f-2b9b-4a20-a64e-71f6cbfe4982 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f041f57093f942cabda4c11e30013785)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:17.060232 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8916f-2b9b-4a20-a64e-71f6cbfe4982 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:17.082087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 932/1848] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:17.088413 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc869e6-d14c-4bb6-bee5-470e19eb90eb None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:17.104204 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc869e6-d14c-4bb6-bee5-470e19eb90eb None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:17.110851 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac29c4-dbf6-4fe7-a9d1-498991cea592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:17.112179 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac29c4-dbf6-4fe7-a9d1-498991cea592 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:17.112533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac29c4-dbf6-4fe7-a9d1-498991cea592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:17.114076 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac29c4-dbf6-4fe7-a9d1-498991cea592 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:17.114892 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac29c4-dbf6-4fe7-a9d1-498991cea592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:17.117796 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac29c4-dbf6-4fe7-a9d1-498991cea592 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:17.142109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-55e8916f-2b9b-4a20-a64e-71f6cbfe4982 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f041f57093f942cabda4c11e30013785'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:17.154049 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-55e8916f-2b9b-4a20-a64e-71f6cbfe4982 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f041f57093f942cabda4c11e30013785'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:17.155607 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 933/1849] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:17 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:17.158122 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-55e8916f-2b9b-4a20-a64e-71f6cbfe4982 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f041f57093f942cabda4c11e30013785'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:17.160480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac29c4-dbf6-4fe7-a9d1-498991cea592 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:17.163975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ebac29c4-dbf6-4fe7-a9d1-498991cea592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:17.175558 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-55e8916f-2b9b-4a20-a64e-71f6cbfe4982 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f041f57093f942cabda4c11e30013785'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:17.176431 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-55e8916f-2b9b-4a20-a64e-71f6cbfe4982 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f041f57093f942cabda4c11e30013785'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:17.193910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 917/1850] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:16 2022] DELETE /identity/v3/users/f041f57093f942cabda4c11e30013785 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:09:17.198226 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1e189-6f09-4ded-b88c-7fdc5e437725 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:17.199901 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1e189-6f09-4ded-b88c-7fdc5e437725 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:17.200353 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1e189-6f09-4ded-b88c-7fdc5e437725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:17.221263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-a9d1e189-6f09-4ded-b88c-7fdc5e437725 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:17.222732 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a9d1e189-6f09-4ded-b88c-7fdc5e437725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:17.324040 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac29c4-dbf6-4fe7-a9d1-498991cea592 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:17.334837 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 918/1851] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:09:17.335545 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ab56d-cef5-43d9-bb13-5f37356f9773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:17.336239 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ab56d-cef5-43d9-bb13-5f37356f9773 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:17.336522 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ab56d-cef5-43d9-bb13-5f37356f9773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:17.336796 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ab56d-cef5-43d9-bb13-5f37356f9773 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:17.337579 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ab56d-cef5-43d9-bb13-5f37356f9773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:17.339535 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ab56d-cef5-43d9-bb13-5f37356f9773 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:17.357450 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1e189-6f09-4ded-b88c-7fdc5e437725 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:17.360258 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a9d1e189-6f09-4ded-b88c-7fdc5e437725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:17.369026 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:17.382622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 934/1852] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:17 2022] POST /identity/v3/users => generated 291 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:17.383575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ab56d-cef5-43d9-bb13-5f37356f9773 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:17.397678 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ab56d-cef5-43d9-bb13-5f37356f9773 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:17.403012 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b13fae-82f4-424f-8ea4-e76047fc2df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:17.403759 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b13fae-82f4-424f-8ea4-e76047fc2df6 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:17.405101 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b13fae-82f4-424f-8ea4-e76047fc2df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:17.405398 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b13fae-82f4-424f-8ea4-e76047fc2df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:17.406203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b13fae-82f4-424f-8ea4-e76047fc2df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:17.408618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b13fae-82f4-424f-8ea4-e76047fc2df6 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:17.432139 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 935/1853] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:17.436445 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b13fae-82f4-424f-8ea4-e76047fc2df6 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:17.457306 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b13fae-82f4-424f-8ea4-e76047fc2df6 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:17.465503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72822bce-c3ac-4619-a2eb-25911e62e879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:17.469503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72822bce-c3ac-4619-a2eb-25911e62e879 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:17.469503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72822bce-c3ac-4619-a2eb-25911e62e879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:17.469503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72822bce-c3ac-4619-a2eb-25911e62e879 admin admin] PATH_INFO: `/v3/projects/c03e2e96d7074222b28844a0191b61ff/users/188607ed43a44590adf2ccebf3053fe9/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:17.482048 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1e189-6f09-4ded-b88c-7fdc5e437725 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:17.492954 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7c4b4-79b5-45e4-8fb6-b0b6938c50dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:17.494449 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7c4b4-79b5-45e4-8fb6-b0b6938c50dc service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:17.496545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7c4b4-79b5-45e4-8fb6-b0b6938c50dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:17.497938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7c4b4-79b5-45e4-8fb6-b0b6938c50dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:17.513921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72822bce-c3ac-4619-a2eb-25911e62e879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c03e2e96d7074222b28844a0191b61ff, user_id=188607ed43a44590adf2ccebf3053fe9, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:17.514253 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7c4b4-79b5-45e4-8fb6-b0b6938c50dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:17.516509 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7c4b4-79b5-45e4-8fb6-b0b6938c50dc service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:17.518461 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72822bce-c3ac-4619-a2eb-25911e62e879 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:17.544586 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 919/1854] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:09:17.551916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 936/1855] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:17 2022] PUT /identity/v3/projects/c03e2e96d7074222b28844a0191b61ff/users/188607ed43a44590adf2ccebf3053fe9/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:17.556384 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7c4b4-79b5-45e4-8fb6-b0b6938c50dc service neutron] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:17.561455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:17.570248 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7c4b4-79b5-45e4-8fb6-b0b6938c50dc service neutron] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:17.641872 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fade08-d677-434f-a405-0cfe662549ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:17.643171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fade08-d677-434f-a405-0cfe662549ca admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:17.643909 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fade08-d677-434f-a405-0cfe662549ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:17.643909 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fade08-d677-434f-a405-0cfe662549ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:17.644774 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fade08-d677-434f-a405-0cfe662549ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:17.647112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fade08-d677-434f-a405-0cfe662549ca admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:17.663097 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72822bce-c3ac-4619-a2eb-25911e62e879 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:17.665228 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 920/1856] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:17.677133 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72822bce-c3ac-4619-a2eb-25911e62e879 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:17.682867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef9bd3-7268-4e06-905f-1f337833bde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:17.683796 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef9bd3-7268-4e06-905f-1f337833bde9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:17.684365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef9bd3-7268-4e06-905f-1f337833bde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:17.684365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef9bd3-7268-4e06-905f-1f337833bde9 admin admin] PATH_INFO: `/v3/projects/c03e2e96d7074222b28844a0191b61ff/users/188607ed43a44590adf2ccebf3053fe9/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:17.686395 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef9bd3-7268-4e06-905f-1f337833bde9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c03e2e96d7074222b28844a0191b61ff, user_id=188607ed43a44590adf2ccebf3053fe9, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:17.689971 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef9bd3-7268-4e06-905f-1f337833bde9 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:17.702535 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 937/1857] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:17 2022] PUT /identity/v3/projects/c03e2e96d7074222b28844a0191b61ff/users/188607ed43a44590adf2ccebf3053fe9/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:09:17.711827 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa30a93-4432-42bb-86aa-49b4023c59f7 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:17.712397 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa30a93-4432-42bb-86aa-49b4023c59f7 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:17.712747 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa30a93-4432-42bb-86aa-49b4023c59f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:17.744471 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-bfa30a93-4432-42bb-86aa-49b4023c59f7 None None] MFA Rules not processed for user `188607ed43a44590adf2ccebf3053fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:17.746652 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-bfa30a93-4432-42bb-86aa-49b4023c59f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:17.820227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 921/1858] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:17 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:17.833609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef9bd3-7268-4e06-905f-1f337833bde9 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:17.835784 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f1ef9bd3-7268-4e06-905f-1f337833bde9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:17.924690 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef9bd3-7268-4e06-905f-1f337833bde9 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:17.929620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dc601-896a-44fe-9989-70d91bc396ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:17.930457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dc601-896a-44fe-9989-70d91bc396ee service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:17.930865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dc601-896a-44fe-9989-70d91bc396ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:17.931240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dc601-896a-44fe-9989-70d91bc396ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:17.942029 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430dc601-896a-44fe-9989-70d91bc396ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:17.944472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430dc601-896a-44fe-9989-70d91bc396ee service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:17.957067 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 938/1859] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:17 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:18.086816 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa30a93-4432-42bb-86aa-49b4023c59f7 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:18.111234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa30a93-4432-42bb-86aa-49b4023c59f7 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:18.117841 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37b0f4-95fe-4d9a-b0a3-6a8ce89727c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:18.118485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37b0f4-95fe-4d9a-b0a3-6a8ce89727c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:18.118792 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37b0f4-95fe-4d9a-b0a3-6a8ce89727c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:18.119070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37b0f4-95fe-4d9a-b0a3-6a8ce89727c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:18.128753 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-4e37b0f4-95fe-4d9a-b0a3-6a8ce89727c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:18.252616 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37b0f4-95fe-4d9a-b0a3-6a8ce89727c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:18.254183 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37b0f4-95fe-4d9a-b0a3-6a8ce89727c5 service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:18.270701 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 922/1860] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:18.724734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dc601-896a-44fe-9989-70d91bc396ee service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:18.726213 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827966d-8cd5-48fc-95c4-1f7774f3043b None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:18.726338 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-430dc601-896a-44fe-9989-70d91bc396ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:18.726796 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827966d-8cd5-48fc-95c4-1f7774f3043b None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:18.727069 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827966d-8cd5-48fc-95c4-1f7774f3043b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:18.777348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-5827966d-8cd5-48fc-95c4-1f7774f3043b None None] MFA Rules not processed for user `e53b8fd4b4ef4feba927f770fd6a09da`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:18.778597 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5827966d-8cd5-48fc-95c4-1f7774f3043b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:18.790158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:18.820201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dc601-896a-44fe-9989-70d91bc396ee service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:18.824892 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e4f4f-52ff-4332-af3c-aad844868dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:18.825764 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e4f4f-52ff-4332-af3c-aad844868dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:18.826050 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e4f4f-52ff-4332-af3c-aad844868dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:18.826379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e4f4f-52ff-4332-af3c-aad844868dae admin admin] PATH_INFO: `/v3/projects/51a070a56ef747ca979c7f072a00bf26` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:18.827633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e4f4f-52ff-4332-af3c-aad844868dae admin admin] RBAC: Authorizing `identity:delete_project(project_id=51a070a56ef747ca979c7f072a00bf26)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:18.829566 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e4f4f-52ff-4332-af3c-aad844868dae admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:18.863571 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 923/1861] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:18.868854 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827966d-8cd5-48fc-95c4-1f7774f3043b None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:18.871464 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5827966d-8cd5-48fc-95c4-1f7774f3043b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:18.887094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827966d-8cd5-48fc-95c4-1f7774f3043b None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:18.889556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7f7e4f4f-52ff-4332-af3c-aad844868dae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51a070a56ef747ca979c7f072a00bf26', 'request_id': 'req-7f7e4f4f-52ff-4332-af3c-aad844868dae'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:18.895945 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7f7e4f4f-52ff-4332-af3c-aad844868dae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51a070a56ef747ca979c7f072a00bf26', 'request_id': 'req-7f7e4f4f-52ff-4332-af3c-aad844868dae'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:18.898138 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:18.907694 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7f7e4f4f-52ff-4332-af3c-aad844868dae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51a070a56ef747ca979c7f072a00bf26', 'request_id': 'req-7f7e4f4f-52ff-4332-af3c-aad844868dae'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:18.926220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7f7e4f4f-52ff-4332-af3c-aad844868dae admin admin] The token cache is being invalidate because project 51a070a56ef747ca979c7f072a00bf26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:18.926537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7f7e4f4f-52ff-4332-af3c-aad844868dae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:18.927374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7f7e4f4f-52ff-4332-af3c-aad844868dae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:18.931825 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 939/1862] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:18 2022] DELETE /identity/v3/projects/51a070a56ef747ca979c7f072a00bf26 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:18.933557 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e4f4f-52ff-4332-af3c-aad844868dae admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:18.935596 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7f7e4f4f-52ff-4332-af3c-aad844868dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:18.970539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414eb6f-52f9-4b28-b9a7-2388bf304e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:18.970942 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414eb6f-52f9-4b28-b9a7-2388bf304e3f admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:18.971234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414eb6f-52f9-4b28-b9a7-2388bf304e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:18.971516 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414eb6f-52f9-4b28-b9a7-2388bf304e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:18.972359 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414eb6f-52f9-4b28-b9a7-2388bf304e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:18.974369 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414eb6f-52f9-4b28-b9a7-2388bf304e3f admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:19.014473 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e4f4f-52ff-4332-af3c-aad844868dae admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:19.018265 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 924/1863] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:18 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:19.019147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414eb6f-52f9-4b28-b9a7-2388bf304e3f admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:19.020881 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-4414eb6f-52f9-4b28-b9a7-2388bf304e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:19.085001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974c8a3-ca45-4ad6-b122-2e4ddfb76d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:19.085902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974c8a3-ca45-4ad6-b122-2e4ddfb76d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:19.086194 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974c8a3-ca45-4ad6-b122-2e4ddfb76d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:19.086472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974c8a3-ca45-4ad6-b122-2e4ddfb76d7d admin admin] PATH_INFO: `/v3/users/2ffc5da328e24819a7695654267c1b68` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:19.088172 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974c8a3-ca45-4ad6-b122-2e4ddfb76d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ffc5da328e24819a7695654267c1b68)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:19.090087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974c8a3-ca45-4ad6-b122-2e4ddfb76d7d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:19.102992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414eb6f-52f9-4b28-b9a7-2388bf304e3f admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:19.109685 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fdc6ae-b039-4c19-bc10-0fb0d861e787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:19.110573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdc6ae-b039-4c19-bc10-0fb0d861e787 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:19.110958 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdc6ae-b039-4c19-bc10-0fb0d861e787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:19.111413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdc6ae-b039-4c19-bc10-0fb0d861e787 admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:19.112233 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fdc6ae-b039-4c19-bc10-0fb0d861e787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:19.114584 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fdc6ae-b039-4c19-bc10-0fb0d861e787 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:19.138560 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 925/1864] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:19 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:19.142786 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fdc6ae-b039-4c19-bc10-0fb0d861e787 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:19.145066 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1974c8a3-ca45-4ad6-b122-2e4ddfb76d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ffc5da328e24819a7695654267c1b68'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:19.155494 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1974c8a3-ca45-4ad6-b122-2e4ddfb76d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ffc5da328e24819a7695654267c1b68'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:19.157615 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fdc6ae-b039-4c19-bc10-0fb0d861e787 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:19.167961 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2fccd-3a48-4ad3-b17e-f5491269b6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:19.167961 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2fccd-3a48-4ad3-b17e-f5491269b6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:19.167961 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2fccd-3a48-4ad3-b17e-f5491269b6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:19.167961 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2fccd-3a48-4ad3-b17e-f5491269b6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:19.168444 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2fccd-3a48-4ad3-b17e-f5491269b6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:19.168444 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2fccd-3a48-4ad3-b17e-f5491269b6e6 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:19.175616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1974c8a3-ca45-4ad6-b122-2e4ddfb76d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ffc5da328e24819a7695654267c1b68'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:19.179781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 926/1865] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:09:19.190956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2fccd-3a48-4ad3-b17e-f5491269b6e6 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:19.195245 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1974c8a3-ca45-4ad6-b122-2e4ddfb76d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ffc5da328e24819a7695654267c1b68'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:19.196095 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1974c8a3-ca45-4ad6-b122-2e4ddfb76d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ffc5da328e24819a7695654267c1b68'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:19.201086 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2fccd-3a48-4ad3-b17e-f5491269b6e6 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:19.203133 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 940/1866] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:18 2022] DELETE /identity/v3/users/2ffc5da328e24819a7695654267c1b68 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:19.220735 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:19.275529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8dd04-6f44-4590-991b-60cc5ed1a8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:19.276543 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8dd04-6f44-4590-991b-60cc5ed1a8a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:19.276886 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8dd04-6f44-4590-991b-60cc5ed1a8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:19.277418 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8dd04-6f44-4590-991b-60cc5ed1a8a3 admin admin] PATH_INFO: `/v3/projects/de106c66fc4c4ed49d6c74060df62c81/users/40359476f0314ab9889900fab3cb331d/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:19.303940 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8dd04-6f44-4590-991b-60cc5ed1a8a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de106c66fc4c4ed49d6c74060df62c81, user_id=40359476f0314ab9889900fab3cb331d, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:19.307122 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8dd04-6f44-4590-991b-60cc5ed1a8a3 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:19.339189 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 927/1867] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:19 2022] PUT /identity/v3/projects/de106c66fc4c4ed49d6c74060df62c81/users/40359476f0314ab9889900fab3cb331d/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:19.340617 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974c8a3-ca45-4ad6-b122-2e4ddfb76d7d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:19.342964 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1974c8a3-ca45-4ad6-b122-2e4ddfb76d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:19.368722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974c8a3-ca45-4ad6-b122-2e4ddfb76d7d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:19.387212 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:19.513461 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02515fb-acee-43fa-84f1-33e48d0d095b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:19.514874 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02515fb-acee-43fa-84f1-33e48d0d095b admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:19.515323 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02515fb-acee-43fa-84f1-33e48d0d095b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:19.515443 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02515fb-acee-43fa-84f1-33e48d0d095b admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:19.516179 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02515fb-acee-43fa-84f1-33e48d0d095b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:19.517903 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02515fb-acee-43fa-84f1-33e48d0d095b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:19.566006 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 941/1868] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:19.567011 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8dd04-6f44-4590-991b-60cc5ed1a8a3 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:19.607636 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8dd04-6f44-4590-991b-60cc5ed1a8a3 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:19.613721 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211c38b-9954-4aac-8d4e-aed241104616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:19.615163 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211c38b-9954-4aac-8d4e-aed241104616 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:19.615381 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211c38b-9954-4aac-8d4e-aed241104616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:19.615647 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211c38b-9954-4aac-8d4e-aed241104616 admin admin] PATH_INFO: `/v3/projects/de106c66fc4c4ed49d6c74060df62c81/users/40359476f0314ab9889900fab3cb331d/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:19.617894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211c38b-9954-4aac-8d4e-aed241104616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de106c66fc4c4ed49d6c74060df62c81, user_id=40359476f0314ab9889900fab3cb331d, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:19.621403 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211c38b-9954-4aac-8d4e-aed241104616 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:19.637473 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 928/1869] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:19 2022] PUT /identity/v3/projects/de106c66fc4c4ed49d6c74060df62c81/users/40359476f0314ab9889900fab3cb331d/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:09:19.813925 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41f967-c6a2-4331-ac19-18fcc14dbc44 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:19.814385 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41f967-c6a2-4331-ac19-18fcc14dbc44 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:19.814845 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41f967-c6a2-4331-ac19-18fcc14dbc44 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:19.816890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 942/1870] 10.222.0.79 () {54 vars in 921 bytes} [Thu Jul 14 12:09:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:09:19.834164 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb3953-c8ba-4b30-b5ac-424878bdbeaf None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:19.834359 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb3953-c8ba-4b30-b5ac-424878bdbeaf None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:19.834689 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb3953-c8ba-4b30-b5ac-424878bdbeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:19.874642 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-e2eb3953-c8ba-4b30-b5ac-424878bdbeaf None None] MFA Rules not processed for user `e41a4d3a822c403fad048764a0edf209`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:19.876081 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e2eb3953-c8ba-4b30-b5ac-424878bdbeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:19.950879 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41f967-c6a2-4331-ac19-18fcc14dbc44 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:19.954718 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5d41f967-c6a2-4331-ac19-18fcc14dbc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:20.031170 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 929/1871] 10.222.0.79 () {58 vars in 1018 bytes} [Thu Jul 14 12:09:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:20.134797 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb3953-c8ba-4b30-b5ac-424878bdbeaf None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:20.136629 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e2eb3953-c8ba-4b30-b5ac-424878bdbeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:20.162242 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41f967-c6a2-4331-ac19-18fcc14dbc44 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:20.165405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb3953-c8ba-4b30-b5ac-424878bdbeaf None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:20.175808 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1ef53-4ee3-477c-8d5f-4c8d0e34bc43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:20.176537 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1ef53-4ee3-477c-8d5f-4c8d0e34bc43 service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:20.177185 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1ef53-4ee3-477c-8d5f-4c8d0e34bc43 service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:20.177185 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1ef53-4ee3-477c-8d5f-4c8d0e34bc43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:20.185135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fbb2f-40c6-4fa2-a528-544b0b1bd3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:20.186121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fbb2f-40c6-4fa2-a528-544b0b1bd3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:20.186389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fbb2f-40c6-4fa2-a528-544b0b1bd3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:20.186687 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fbb2f-40c6-4fa2-a528-544b0b1bd3e4 admin admin] PATH_INFO: `/v3/projects/9add147801ba4028b4cd681a658492fe` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:20.189882 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fbb2f-40c6-4fa2-a528-544b0b1bd3e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9add147801ba4028b4cd681a658492fe)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:20.192063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1ef53-4ee3-477c-8d5f-4c8d0e34bc43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:20.194668 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1ef53-4ee3-477c-8d5f-4c8d0e34bc43 service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:20.200870 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fbb2f-40c6-4fa2-a528-544b0b1bd3e4 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:20.210374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 930/1872] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:09:20.331266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-200fbb2f-40c6-4fa2-a528-544b0b1bd3e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9add147801ba4028b4cd681a658492fe', 'request_id': 'req-200fbb2f-40c6-4fa2-a528-544b0b1bd3e4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:20.338480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-200fbb2f-40c6-4fa2-a528-544b0b1bd3e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9add147801ba4028b4cd681a658492fe', 'request_id': 'req-200fbb2f-40c6-4fa2-a528-544b0b1bd3e4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:20.346268 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-200fbb2f-40c6-4fa2-a528-544b0b1bd3e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9add147801ba4028b4cd681a658492fe', 'request_id': 'req-200fbb2f-40c6-4fa2-a528-544b0b1bd3e4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:20.382775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-200fbb2f-40c6-4fa2-a528-544b0b1bd3e4 admin admin] The token cache is being invalidate because project 9add147801ba4028b4cd681a658492fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:20.383491 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-200fbb2f-40c6-4fa2-a528-544b0b1bd3e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:20.384641 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-200fbb2f-40c6-4fa2-a528-544b0b1bd3e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:20.387086 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 943/1873] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:19 2022] DELETE /identity/v3/projects/9add147801ba4028b4cd681a658492fe => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:09:20.392597 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98de76-27a5-4e45-9147-e7ba65665dad None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:20.392896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98de76-27a5-4e45-9147-e7ba65665dad None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:20.393181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98de76-27a5-4e45-9147-e7ba65665dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:20.448443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-2f98de76-27a5-4e45-9147-e7ba65665dad None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:20.451186 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-2f98de76-27a5-4e45-9147-e7ba65665dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:20.585994 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 931/1874] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:09:20.594175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e54be7-14bc-4f27-8e50-f58e1068885c None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:20.594415 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e54be7-14bc-4f27-8e50-f58e1068885c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:20.594692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e54be7-14bc-4f27-8e50-f58e1068885c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:20.616834 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-06e54be7-14bc-4f27-8e50-f58e1068885c None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:20.618762 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-06e54be7-14bc-4f27-8e50-f58e1068885c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:20.633589 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98de76-27a5-4e45-9147-e7ba65665dad None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:20.633788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 944/1875] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:20.644051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:20.648789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98de76-27a5-4e45-9147-e7ba65665dad None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:20.656041 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893af2a2-9282-4971-bd1c-b8477e63bb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:20.657296 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893af2a2-9282-4971-bd1c-b8477e63bb88 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:20.657705 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893af2a2-9282-4971-bd1c-b8477e63bb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:20.658209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893af2a2-9282-4971-bd1c-b8477e63bb88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:20.659098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893af2a2-9282-4971-bd1c-b8477e63bb88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:09:20.659420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893af2a2-9282-4971-bd1c-b8477e63bb88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:20.661201 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893af2a2-9282-4971-bd1c-b8477e63bb88 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:20.680232 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 932/1876] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:09:20.681300 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e54be7-14bc-4f27-8e50-f58e1068885c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:20.695759 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e54be7-14bc-4f27-8e50-f58e1068885c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:20.701997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef570083-b6ec-4d60-ab4d-3447bb8e7ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:20.702735 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef570083-b6ec-4d60-ab4d-3447bb8e7ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:20.703222 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef570083-b6ec-4d60-ab4d-3447bb8e7ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:20.703511 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef570083-b6ec-4d60-ab4d-3447bb8e7ed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:20.704358 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef570083-b6ec-4d60-ab4d-3447bb8e7ed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:20.706617 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef570083-b6ec-4d60-ab4d-3447bb8e7ed8 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:20.758722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 945/1877] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:20 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:09:20.760269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893af2a2-9282-4971-bd1c-b8477e63bb88 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:20.774901 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893af2a2-9282-4971-bd1c-b8477e63bb88 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:20.866117 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f165f-c5fc-4f6e-b29d-e41874f15c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:20.868549 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f165f-c5fc-4f6e-b29d-e41874f15c6f admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:20.869065 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f165f-c5fc-4f6e-b29d-e41874f15c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:20.869804 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f165f-c5fc-4f6e-b29d-e41874f15c6f admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:20.870819 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f165f-c5fc-4f6e-b29d-e41874f15c6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:20.873145 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f165f-c5fc-4f6e-b29d-e41874f15c6f admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:20.922182 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 933/1878] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:20 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:09:20.926058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef570083-b6ec-4d60-ab4d-3447bb8e7ed8 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:20.946106 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef570083-b6ec-4d60-ab4d-3447bb8e7ed8 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:20.950250 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6873bb-a263-4cb1-85ee-b101517f76eb None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:20.950600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6873bb-a263-4cb1-85ee-b101517f76eb None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:20.950975 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6873bb-a263-4cb1-85ee-b101517f76eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:20.958851 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52d9c5-da95-4e84-852e-40ff55571fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:20.960765 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52d9c5-da95-4e84-852e-40ff55571fbd admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:20.961424 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52d9c5-da95-4e84-852e-40ff55571fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:20.962206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52d9c5-da95-4e84-852e-40ff55571fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:20.963691 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52d9c5-da95-4e84-852e-40ff55571fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:20.966790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52d9c5-da95-4e84-852e-40ff55571fbd admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:20.972323 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:20.989768 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 946/1879] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:20.991089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52d9c5-da95-4e84-852e-40ff55571fbd admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:21.003877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-0a6873bb-a263-4cb1-85ee-b101517f76eb None None] MFA Rules not processed for user `40359476f0314ab9889900fab3cb331d`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:21.005250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52d9c5-da95-4e84-852e-40ff55571fbd admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:21.005657 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-0a6873bb-a263-4cb1-85ee-b101517f76eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:21.013212 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd31447-4445-4392-9b69-26fb68da86f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:21.014290 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd31447-4445-4392-9b69-26fb68da86f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:21.014622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd31447-4445-4392-9b69-26fb68da86f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:21.015100 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd31447-4445-4392-9b69-26fb68da86f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:21.016958 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd31447-4445-4392-9b69-26fb68da86f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:21.018708 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd31447-4445-4392-9b69-26fb68da86f0 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:21.040155 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 947/1880] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:21.041130 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd31447-4445-4392-9b69-26fb68da86f0 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:21.057908 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd31447-4445-4392-9b69-26fb68da86f0 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:21.074267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3272da7-8087-4e1d-b0aa-cfb43dad7e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:21.075237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3272da7-8087-4e1d-b0aa-cfb43dad7e8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:21.075616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3272da7-8087-4e1d-b0aa-cfb43dad7e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:21.075948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3272da7-8087-4e1d-b0aa-cfb43dad7e8c admin admin] PATH_INFO: `/v3/projects/deeaadcfdb3b492e94e59b6dcb0956bc/users/f471515e7c834623a3c9e5be5c11740f/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:21.105993 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3272da7-8087-4e1d-b0aa-cfb43dad7e8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=deeaadcfdb3b492e94e59b6dcb0956bc, user_id=f471515e7c834623a3c9e5be5c11740f, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:21.110169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3272da7-8087-4e1d-b0aa-cfb43dad7e8c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:21.134222 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 948/1881] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:21 2022] PUT /identity/v3/projects/deeaadcfdb3b492e94e59b6dcb0956bc/users/f471515e7c834623a3c9e5be5c11740f/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:21.147791 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a5547-8d6e-49f7-afc7-adf95cb9836b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:21.148133 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a5547-8d6e-49f7-afc7-adf95cb9836b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:21.148418 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a5547-8d6e-49f7-afc7-adf95cb9836b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:21.161743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 934/1882] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:21.173995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874b339-9e3c-49ec-8caf-3a8f7fd84d8c None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:21.174557 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874b339-9e3c-49ec-8caf-3a8f7fd84d8c None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:21.175716 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874b339-9e3c-49ec-8caf-3a8f7fd84d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:21.186605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f38a5547-8d6e-49f7-afc7-adf95cb9836b None None] MFA Rules not processed for user `f471515e7c834623a3c9e5be5c11740f`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:21.188381 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f38a5547-8d6e-49f7-afc7-adf95cb9836b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:21.203787 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-c874b339-9e3c-49ec-8caf-3a8f7fd84d8c None None] MFA Rules not processed for user `e53b8fd4b4ef4feba927f770fd6a09da`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:21.205996 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-c874b339-9e3c-49ec-8caf-3a8f7fd84d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:21.282151 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 935/1883] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:21.292925 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874b339-9e3c-49ec-8caf-3a8f7fd84d8c None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:21.294352 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-c874b339-9e3c-49ec-8caf-3a8f7fd84d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:21.301674 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 949/1884] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:21.307178 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a5547-8d6e-49f7-afc7-adf95cb9836b None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:21.313849 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:21.416034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a5547-8d6e-49f7-afc7-adf95cb9836b None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:21.421895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b33901-929e-4c1a-b6a5-97eb39d100b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:21.422669 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b33901-929e-4c1a-b6a5-97eb39d100b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:21.422956 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b33901-929e-4c1a-b6a5-97eb39d100b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:21.423238 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b33901-929e-4c1a-b6a5-97eb39d100b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:21.423931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b33901-929e-4c1a-b6a5-97eb39d100b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:21.425954 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b33901-929e-4c1a-b6a5-97eb39d100b6 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:21.464592 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874b339-9e3c-49ec-8caf-3a8f7fd84d8c None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:21.481133 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 950/1885] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:21 2022] POST /identity/v3/projects => generated 387 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:09:21.483020 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b33901-929e-4c1a-b6a5-97eb39d100b6 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:21.483298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339d767-09a9-475b-8201-da6168962451 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:21.484606 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339d767-09a9-475b-8201-da6168962451 service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:21.484898 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339d767-09a9-475b-8201-da6168962451 service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:21.485182 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339d767-09a9-475b-8201-da6168962451 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:21.487832 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-2339d767-09a9-475b-8201-da6168962451 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:21.504603 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339d767-09a9-475b-8201-da6168962451 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:21.507247 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339d767-09a9-475b-8201-da6168962451 service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:21.518971 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 936/1886] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:09:21.596687 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:21.646052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b33901-929e-4c1a-b6a5-97eb39d100b6 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:21.659331 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f572221-d6e5-4690-960a-84354d7b3039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:21.660103 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f572221-d6e5-4690-960a-84354d7b3039 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:21.660632 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f572221-d6e5-4690-960a-84354d7b3039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:21.661179 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f572221-d6e5-4690-960a-84354d7b3039 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:21.662176 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f572221-d6e5-4690-960a-84354d7b3039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:21.663843 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f572221-d6e5-4690-960a-84354d7b3039 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:21.711646 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 951/1887] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:21 2022] POST /identity/v3/users => generated 300 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:21.716677 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339d767-09a9-475b-8201-da6168962451 service nova] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:21.735231 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339d767-09a9-475b-8201-da6168962451 service nova] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:21.750542 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d401af-22dd-4c72-90be-c5c182d7c10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:21.753760 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d401af-22dd-4c72-90be-c5c182d7c10d admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:21.754066 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d401af-22dd-4c72-90be-c5c182d7c10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:21.754351 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d401af-22dd-4c72-90be-c5c182d7c10d admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:21.756807 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d401af-22dd-4c72-90be-c5c182d7c10d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:21.759917 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d401af-22dd-4c72-90be-c5c182d7c10d admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:21.788341 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 937/1888] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:21.789267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f572221-d6e5-4690-960a-84354d7b3039 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:21.816792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f572221-d6e5-4690-960a-84354d7b3039 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:21.827538 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73984c8f-6d60-4d78-aa7a-f4ddd6ea8667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:21.831433 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73984c8f-6d60-4d78-aa7a-f4ddd6ea8667 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:21.831839 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73984c8f-6d60-4d78-aa7a-f4ddd6ea8667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:21.832062 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73984c8f-6d60-4d78-aa7a-f4ddd6ea8667 admin admin] PATH_INFO: `/v3/projects/f70f8795f26f4dd9a42924c4cb300db6/users/e32db967e79e445683416c30cfc9facd/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:21.845736 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d401af-22dd-4c72-90be-c5c182d7c10d admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:21.847543 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-50d401af-22dd-4c72-90be-c5c182d7c10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:21.862086 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73984c8f-6d60-4d78-aa7a-f4ddd6ea8667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f70f8795f26f4dd9a42924c4cb300db6, user_id=e32db967e79e445683416c30cfc9facd, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:21.865864 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d401af-22dd-4c72-90be-c5c182d7c10d admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:21.866702 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73984c8f-6d60-4d78-aa7a-f4ddd6ea8667 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:21.873671 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4366c5-6a41-4b15-963a-a93f62b4fd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:21.874898 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4366c5-6a41-4b15-963a-a93f62b4fd87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:21.875207 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4366c5-6a41-4b15-963a-a93f62b4fd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:21.875712 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4366c5-6a41-4b15-963a-a93f62b4fd87 admin admin] PATH_INFO: `/v3/users/8bc50d564f3b4c48a71363ad5a9ad87c` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:21.877515 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4366c5-6a41-4b15-963a-a93f62b4fd87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bc50d564f3b4c48a71363ad5a9ad87c)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:21.880801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4366c5-6a41-4b15-963a-a93f62b4fd87 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:21.903035 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 952/1889] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:21 2022] PUT /identity/v3/projects/f70f8795f26f4dd9a42924c4cb300db6/users/e32db967e79e445683416c30cfc9facd/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:21.904609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73984c8f-6d60-4d78-aa7a-f4ddd6ea8667 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:21.981648 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0f4366c5-6a41-4b15-963a-a93f62b4fd87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bc50d564f3b4c48a71363ad5a9ad87c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:21.992899 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0f4366c5-6a41-4b15-963a-a93f62b4fd87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bc50d564f3b4c48a71363ad5a9ad87c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:21.993559 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0f4366c5-6a41-4b15-963a-a93f62b4fd87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bc50d564f3b4c48a71363ad5a9ad87c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:22.017270 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73984c8f-6d60-4d78-aa7a-f4ddd6ea8667 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:22.021100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0f4366c5-6a41-4b15-963a-a93f62b4fd87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bc50d564f3b4c48a71363ad5a9ad87c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:22.021890 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0f4366c5-6a41-4b15-963a-a93f62b4fd87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bc50d564f3b4c48a71363ad5a9ad87c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:22.030125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c92777-24ee-4c84-a2c4-70136ce93ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:22.031958 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c92777-24ee-4c84-a2c4-70136ce93ace admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:22.033778 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c92777-24ee-4c84-a2c4-70136ce93ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:22.035509 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c92777-24ee-4c84-a2c4-70136ce93ace admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:22.036785 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c92777-24ee-4c84-a2c4-70136ce93ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:22.039297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 938/1890] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:21 2022] DELETE /identity/v3/users/8bc50d564f3b4c48a71363ad5a9ad87c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:09:22.040339 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c92777-24ee-4c84-a2c4-70136ce93ace admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:22.044458 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42930b-c23d-4258-b7f8-784433cffa6d None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:22.045586 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42930b-c23d-4258-b7f8-784433cffa6d None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:22.045586 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42930b-c23d-4258-b7f8-784433cffa6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:22.060070 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 953/1891] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:22.064939 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c92777-24ee-4c84-a2c4-70136ce93ace admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:22.067610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-fb42930b-c23d-4258-b7f8-784433cffa6d None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:22.067610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-fb42930b-c23d-4258-b7f8-784433cffa6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:22.071043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-11c92777-24ee-4c84-a2c4-70136ce93ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:22.096125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c92777-24ee-4c84-a2c4-70136ce93ace admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:22.150885 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:22.166323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 939/1892] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:22.183343 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42930b-c23d-4258-b7f8-784433cffa6d None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:22.186429 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-fb42930b-c23d-4258-b7f8-784433cffa6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:22.187861 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a2694-d661-4933-a523-9376d68058b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:22.188784 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a2694-d661-4933-a523-9376d68058b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:22.189072 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a2694-d661-4933-a523-9376d68058b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:22.189353 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a2694-d661-4933-a523-9376d68058b4 admin admin] PATH_INFO: `/v3/projects/f70f8795f26f4dd9a42924c4cb300db6/users/e32db967e79e445683416c30cfc9facd/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:22.191790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a2694-d661-4933-a523-9376d68058b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f70f8795f26f4dd9a42924c4cb300db6, user_id=e32db967e79e445683416c30cfc9facd, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:22.194485 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a2694-d661-4933-a523-9376d68058b4 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:22.206871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 954/1893] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:22 2022] PUT /identity/v3/projects/f70f8795f26f4dd9a42924c4cb300db6/users/e32db967e79e445683416c30cfc9facd/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:22.217608 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d94a3-4e1d-43f9-8ea6-56b02dbf30fd None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:22.217900 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d94a3-4e1d-43f9-8ea6-56b02dbf30fd None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:22.218184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d94a3-4e1d-43f9-8ea6-56b02dbf30fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:22.248051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ff3d94a3-4e1d-43f9-8ea6-56b02dbf30fd None None] MFA Rules not processed for user `e32db967e79e445683416c30cfc9facd`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:22.249795 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ff3d94a3-4e1d-43f9-8ea6-56b02dbf30fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:22.275112 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:22.309075 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42930b-c23d-4258-b7f8-784433cffa6d None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:22.351562 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 955/1894] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:22.364821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d94a3-4e1d-43f9-8ea6-56b02dbf30fd None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:22.366224 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ff3d94a3-4e1d-43f9-8ea6-56b02dbf30fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:22.374296 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb778d0e-fcb6-46bf-8c6f-01a6c9aa4bd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:22.377049 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb778d0e-fcb6-46bf-8c6f-01a6c9aa4bd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:22.377762 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb778d0e-fcb6-46bf-8c6f-01a6c9aa4bd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:22.377762 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb778d0e-fcb6-46bf-8c6f-01a6c9aa4bd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:22.445199 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d94a3-4e1d-43f9-8ea6-56b02dbf30fd None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:22.450092 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d7b37-6dd7-458d-bac6-7ed0fd93252e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:22.451564 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d7b37-6dd7-458d-bac6-7ed0fd93252e service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:22.451865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d7b37-6dd7-458d-bac6-7ed0fd93252e service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:22.452356 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d7b37-6dd7-458d-bac6-7ed0fd93252e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:22.468499 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d7b37-6dd7-458d-bac6-7ed0fd93252e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:22.470050 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d7b37-6dd7-458d-bac6-7ed0fd93252e service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:22.494690 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 956/1895] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:09:22.495779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb778d0e-fcb6-46bf-8c6f-01a6c9aa4bd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:22.497539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb778d0e-fcb6-46bf-8c6f-01a6c9aa4bd9 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:22.510509 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 940/1896] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:09:22.603417 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d7b37-6dd7-458d-bac6-7ed0fd93252e service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:22.616495 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d7b37-6dd7-458d-bac6-7ed0fd93252e service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:22.622949 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636b840-4862-4326-bdce-46280ecc69e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:22.623686 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636b840-4862-4326-bdce-46280ecc69e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:22.624008 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636b840-4862-4326-bdce-46280ecc69e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:22.624519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636b840-4862-4326-bdce-46280ecc69e7 admin admin] PATH_INFO: `/v3/users/f471515e7c834623a3c9e5be5c11740f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:22.626155 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636b840-4862-4326-bdce-46280ecc69e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f471515e7c834623a3c9e5be5c11740f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:22.628534 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636b840-4862-4326-bdce-46280ecc69e7 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:22.714100 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7636b840-4862-4326-bdce-46280ecc69e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f471515e7c834623a3c9e5be5c11740f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:22.727474 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7636b840-4862-4326-bdce-46280ecc69e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f471515e7c834623a3c9e5be5c11740f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:22.737716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7636b840-4862-4326-bdce-46280ecc69e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f471515e7c834623a3c9e5be5c11740f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:22.758665 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7636b840-4862-4326-bdce-46280ecc69e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f471515e7c834623a3c9e5be5c11740f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:22.759508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-7636b840-4862-4326-bdce-46280ecc69e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f471515e7c834623a3c9e5be5c11740f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:22.789397 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 957/1897] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:22 2022] DELETE /identity/v3/users/f471515e7c834623a3c9e5be5c11740f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:22.794337 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11b87a-0f94-405c-9d8d-c7572ab76e73 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:22.794662 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11b87a-0f94-405c-9d8d-c7572ab76e73 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:22.795495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11b87a-0f94-405c-9d8d-c7572ab76e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:22.828863 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-3b11b87a-0f94-405c-9d8d-c7572ab76e73 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:22.831255 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-3b11b87a-0f94-405c-9d8d-c7572ab76e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:22.993118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 941/1898] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:23.005888 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636b840-4862-4326-bdce-46280ecc69e7 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:23.007749 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7636b840-4862-4326-bdce-46280ecc69e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:23.068645 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:23.125832 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636b840-4862-4326-bdce-46280ecc69e7 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:23.130158 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ae17a-e524-4d2a-93a5-2859e977ea57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:23.130851 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ae17a-e524-4d2a-93a5-2859e977ea57 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:23.131141 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ae17a-e524-4d2a-93a5-2859e977ea57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:23.131424 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ae17a-e524-4d2a-93a5-2859e977ea57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:23.156595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ae17a-e524-4d2a-93a5-2859e977ea57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:23.158058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ae17a-e524-4d2a-93a5-2859e977ea57 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:23.170078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 958/1899] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:23.265028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11b87a-0f94-405c-9d8d-c7572ab76e73 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:23.266982 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-3b11b87a-0f94-405c-9d8d-c7572ab76e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:23.316265 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:23.323885 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11b87a-0f94-405c-9d8d-c7572ab76e73 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:23.330585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ea48c-a41f-4256-b982-2cf11076a528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:23.331725 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ea48c-a41f-4256-b982-2cf11076a528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:23.332014 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ea48c-a41f-4256-b982-2cf11076a528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:23.332476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ea48c-a41f-4256-b982-2cf11076a528 admin admin] PATH_INFO: `/v3/projects/526afcda4c094008befd4e021c33c9ba` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:23.334147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ea48c-a41f-4256-b982-2cf11076a528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=526afcda4c094008befd4e021c33c9ba)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:23.336818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ea48c-a41f-4256-b982-2cf11076a528 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:23.431429 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0c1ea48c-a41f-4256-b982-2cf11076a528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '526afcda4c094008befd4e021c33c9ba', 'request_id': 'req-0c1ea48c-a41f-4256-b982-2cf11076a528'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:23.438387 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0c1ea48c-a41f-4256-b982-2cf11076a528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '526afcda4c094008befd4e021c33c9ba', 'request_id': 'req-0c1ea48c-a41f-4256-b982-2cf11076a528'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:23.443954 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0c1ea48c-a41f-4256-b982-2cf11076a528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '526afcda4c094008befd4e021c33c9ba', 'request_id': 'req-0c1ea48c-a41f-4256-b982-2cf11076a528'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:23.459319 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0c1ea48c-a41f-4256-b982-2cf11076a528 admin admin] The token cache is being invalidate because project 526afcda4c094008befd4e021c33c9ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:23.459639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0c1ea48c-a41f-4256-b982-2cf11076a528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:23.460288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0c1ea48c-a41f-4256-b982-2cf11076a528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:23.465186 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 942/1900] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:23 2022] DELETE /identity/v3/projects/526afcda4c094008befd4e021c33c9ba => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:23.466616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ae17a-e524-4d2a-93a5-2859e977ea57 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:23.488245 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ae17a-e524-4d2a-93a5-2859e977ea57 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:23.572367 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f749d23-e640-415c-b290-ea8f1aabeb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:23.573324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f749d23-e640-415c-b290-ea8f1aabeb67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:23.573614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f749d23-e640-415c-b290-ea8f1aabeb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:23.573894 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f749d23-e640-415c-b290-ea8f1aabeb67 admin admin] PATH_INFO: `/v3/users/6670d3361de34529a61b7ac79be36225` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:23.575176 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f749d23-e640-415c-b290-ea8f1aabeb67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6670d3361de34529a61b7ac79be36225)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:23.577856 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f749d23-e640-415c-b290-ea8f1aabeb67 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:23.641861 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5f749d23-e640-415c-b290-ea8f1aabeb67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6670d3361de34529a61b7ac79be36225'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:23.654680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5f749d23-e640-415c-b290-ea8f1aabeb67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6670d3361de34529a61b7ac79be36225'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:23.667347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5f749d23-e640-415c-b290-ea8f1aabeb67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6670d3361de34529a61b7ac79be36225'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:23.689936 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5f749d23-e640-415c-b290-ea8f1aabeb67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6670d3361de34529a61b7ac79be36225'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:23.691324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5f749d23-e640-415c-b290-ea8f1aabeb67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6670d3361de34529a61b7ac79be36225'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:23.699371 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ea48c-a41f-4256-b982-2cf11076a528 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:23.701083 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-0c1ea48c-a41f-4256-b982-2cf11076a528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:23.703393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 959/1901] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:23 2022] DELETE /identity/v3/users/6670d3361de34529a61b7ac79be36225 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:23.731277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ea48c-a41f-4256-b982-2cf11076a528 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:23.858656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54fa3a-84d6-4d02-b219-b06621414680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:23.879274 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54fa3a-84d6-4d02-b219-b06621414680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:23.879571 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54fa3a-84d6-4d02-b219-b06621414680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:23.880357 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54fa3a-84d6-4d02-b219-b06621414680 admin admin] PATH_INFO: `/v3/projects/deeaadcfdb3b492e94e59b6dcb0956bc` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:23.881455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54fa3a-84d6-4d02-b219-b06621414680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=deeaadcfdb3b492e94e59b6dcb0956bc)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:23.886024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54fa3a-84d6-4d02-b219-b06621414680 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:23.952660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ba54fa3a-84d6-4d02-b219-b06621414680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deeaadcfdb3b492e94e59b6dcb0956bc', 'request_id': 'req-ba54fa3a-84d6-4d02-b219-b06621414680'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:23.961699 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ba54fa3a-84d6-4d02-b219-b06621414680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deeaadcfdb3b492e94e59b6dcb0956bc', 'request_id': 'req-ba54fa3a-84d6-4d02-b219-b06621414680'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:23.970349 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ba54fa3a-84d6-4d02-b219-b06621414680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deeaadcfdb3b492e94e59b6dcb0956bc', 'request_id': 'req-ba54fa3a-84d6-4d02-b219-b06621414680'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:23.988058 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ba54fa3a-84d6-4d02-b219-b06621414680 admin admin] The token cache is being invalidate because project deeaadcfdb3b492e94e59b6dcb0956bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:23.989095 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ba54fa3a-84d6-4d02-b219-b06621414680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:23.990146 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ba54fa3a-84d6-4d02-b219-b06621414680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:23.992278 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 943/1902] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:23 2022] DELETE /identity/v3/projects/deeaadcfdb3b492e94e59b6dcb0956bc => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:09:23.996113 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f749d23-e640-415c-b290-ea8f1aabeb67 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:23.997658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5f749d23-e640-415c-b290-ea8f1aabeb67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:24.011193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f749d23-e640-415c-b290-ea8f1aabeb67 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:24.067879 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:24.076213 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d32f6-d61e-4079-98b7-ed5c83c2ee83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:24.077298 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d32f6-d61e-4079-98b7-ed5c83c2ee83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:24.077936 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d32f6-d61e-4079-98b7-ed5c83c2ee83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:24.078827 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d32f6-d61e-4079-98b7-ed5c83c2ee83 admin admin] PATH_INFO: `/v3/users/e32db967e79e445683416c30cfc9facd` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:24.080192 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d32f6-d61e-4079-98b7-ed5c83c2ee83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e32db967e79e445683416c30cfc9facd)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:24.082683 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d32f6-d61e-4079-98b7-ed5c83c2ee83 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:24.138915 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-ca9d32f6-d61e-4079-98b7-ed5c83c2ee83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e32db967e79e445683416c30cfc9facd'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:24.149119 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-ca9d32f6-d61e-4079-98b7-ed5c83c2ee83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e32db967e79e445683416c30cfc9facd'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:24.150264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54fa3a-84d6-4d02-b219-b06621414680 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:24.151766 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ba54fa3a-84d6-4d02-b219-b06621414680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:24.164156 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-ca9d32f6-d61e-4079-98b7-ed5c83c2ee83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e32db967e79e445683416c30cfc9facd'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:24.165364 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54fa3a-84d6-4d02-b219-b06621414680 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:24.171292 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7102df-744c-4ed1-81d1-fe2132a8e96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:24.172175 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7102df-744c-4ed1-81d1-fe2132a8e96a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:24.172462 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7102df-744c-4ed1-81d1-fe2132a8e96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:24.172745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7102df-744c-4ed1-81d1-fe2132a8e96a admin admin] PATH_INFO: `/v3/projects/ef5781966c1b456688d4ef83c2534d8e` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:24.173980 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7102df-744c-4ed1-81d1-fe2132a8e96a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef5781966c1b456688d4ef83c2534d8e)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:24.177106 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7102df-744c-4ed1-81d1-fe2132a8e96a admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:24.191032 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-ca9d32f6-d61e-4079-98b7-ed5c83c2ee83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e32db967e79e445683416c30cfc9facd'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:24.192198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-ca9d32f6-d61e-4079-98b7-ed5c83c2ee83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e32db967e79e445683416c30cfc9facd'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:24.198782 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:24.198980 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 960/1903] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:23 2022] DELETE /identity/v3/users/e32db967e79e445683416c30cfc9facd => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:24.242590 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1b7102df-744c-4ed1-81d1-fe2132a8e96a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef5781966c1b456688d4ef83c2534d8e', 'request_id': 'req-1b7102df-744c-4ed1-81d1-fe2132a8e96a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:24.249245 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1b7102df-744c-4ed1-81d1-fe2132a8e96a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef5781966c1b456688d4ef83c2534d8e', 'request_id': 'req-1b7102df-744c-4ed1-81d1-fe2132a8e96a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:24.262650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1b7102df-744c-4ed1-81d1-fe2132a8e96a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef5781966c1b456688d4ef83c2534d8e', 'request_id': 'req-1b7102df-744c-4ed1-81d1-fe2132a8e96a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:24.277381 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1b7102df-744c-4ed1-81d1-fe2132a8e96a admin admin] The token cache is being invalidate because project ef5781966c1b456688d4ef83c2534d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:24.277996 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1b7102df-744c-4ed1-81d1-fe2132a8e96a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:24.278586 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1b7102df-744c-4ed1-81d1-fe2132a8e96a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:24.280793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 944/1904] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:24 2022] DELETE /identity/v3/projects/ef5781966c1b456688d4ef83c2534d8e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:24.287487 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569ae09-1670-430c-b3cf-393957a1d866 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:24.287774 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569ae09-1670-430c-b3cf-393957a1d866 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:24.288101 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569ae09-1670-430c-b3cf-393957a1d866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:24.309698 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6569ae09-1670-430c-b3cf-393957a1d866 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:24.311778 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6569ae09-1670-430c-b3cf-393957a1d866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:24.373487 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 961/1905] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:24.381343 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79675aea-3560-467d-b6b1-d017f301a45e None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:24.381634 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79675aea-3560-467d-b6b1-d017f301a45e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:24.381917 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79675aea-3560-467d-b6b1-d017f301a45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:24.405907 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-79675aea-3560-467d-b6b1-d017f301a45e None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:24.407876 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-79675aea-3560-467d-b6b1-d017f301a45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:24.417408 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 945/1906] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:24.422237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569ae09-1670-430c-b3cf-393957a1d866 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:24.434583 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569ae09-1670-430c-b3cf-393957a1d866 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:24.440108 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5c9a4-6b9c-4788-9129-78da2ef92741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:24.440909 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5c9a4-6b9c-4788-9129-78da2ef92741 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:24.441294 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5c9a4-6b9c-4788-9129-78da2ef92741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:24.442360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5c9a4-6b9c-4788-9129-78da2ef92741 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:24.443411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5c9a4-6b9c-4788-9129-78da2ef92741 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:09:24.443792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5c9a4-6b9c-4788-9129-78da2ef92741 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:24.445564 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5c9a4-6b9c-4788-9129-78da2ef92741 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:24.465281 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 962/1907] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:09:24.466260 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79675aea-3560-467d-b6b1-d017f301a45e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:24.476992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79675aea-3560-467d-b6b1-d017f301a45e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:24.486794 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed903b-1b7b-4cdb-bdea-f800babc38eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:24.487645 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed903b-1b7b-4cdb-bdea-f800babc38eb admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:24.487828 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed903b-1b7b-4cdb-bdea-f800babc38eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:24.488069 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed903b-1b7b-4cdb-bdea-f800babc38eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:24.488780 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed903b-1b7b-4cdb-bdea-f800babc38eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:24.490757 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed903b-1b7b-4cdb-bdea-f800babc38eb admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:24.533695 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 946/1908] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:24 2022] POST /identity/v3/projects => generated 401 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:24.538180 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5c9a4-6b9c-4788-9129-78da2ef92741 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:24.553803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5c9a4-6b9c-4788-9129-78da2ef92741 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:24.570652 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed903b-1b7b-4cdb-bdea-f800babc38eb admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:24.583556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a9ed903b-1b7b-4cdb-bdea-f800babc38eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:24.655297 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8eb96-7464-431e-86bc-ab2cd41c75b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:24.656251 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8eb96-7464-431e-86bc-ab2cd41c75b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:24.656739 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8eb96-7464-431e-86bc-ab2cd41c75b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:24.657201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8eb96-7464-431e-86bc-ab2cd41c75b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:24.658094 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8eb96-7464-431e-86bc-ab2cd41c75b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:24.660790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8eb96-7464-431e-86bc-ab2cd41c75b9 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:24.669781 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:24.690981 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 963/1909] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:24 2022] POST /identity/v3/users => generated 301 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:24.691971 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8eb96-7464-431e-86bc-ab2cd41c75b9 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:24.705783 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8eb96-7464-431e-86bc-ab2cd41c75b9 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:24.711059 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b03b4-0c7e-44ca-8c0c-fce11c361c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:24.711794 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b03b4-0c7e-44ca-8c0c-fce11c361c56 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:24.712086 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b03b4-0c7e-44ca-8c0c-fce11c361c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:24.712408 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b03b4-0c7e-44ca-8c0c-fce11c361c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:24.713163 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b03b4-0c7e-44ca-8c0c-fce11c361c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:24.714988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b03b4-0c7e-44ca-8c0c-fce11c361c56 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:24.722259 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed903b-1b7b-4cdb-bdea-f800babc38eb admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:24.727387 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57dd35-7e8e-4c9e-9662-41ef16d1ec8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:24.728265 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57dd35-7e8e-4c9e-9662-41ef16d1ec8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:24.728881 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57dd35-7e8e-4c9e-9662-41ef16d1ec8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:24.729164 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57dd35-7e8e-4c9e-9662-41ef16d1ec8c admin admin] PATH_INFO: `/v3/projects/f70f8795f26f4dd9a42924c4cb300db6` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:24.730399 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57dd35-7e8e-4c9e-9662-41ef16d1ec8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f70f8795f26f4dd9a42924c4cb300db6)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:24.734532 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57dd35-7e8e-4c9e-9662-41ef16d1ec8c admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:24.735636 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 964/1910] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:24.736949 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b03b4-0c7e-44ca-8c0c-fce11c361c56 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:24.751077 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b03b4-0c7e-44ca-8c0c-fce11c361c56 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:24.757399 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f3223-83df-4f56-aec4-67a26fd82e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:24.759210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f3223-83df-4f56-aec4-67a26fd82e00 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:24.760239 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f3223-83df-4f56-aec4-67a26fd82e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:24.760744 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f3223-83df-4f56-aec4-67a26fd82e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:24.762364 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f3223-83df-4f56-aec4-67a26fd82e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:24.766866 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f3223-83df-4f56-aec4-67a26fd82e00 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:24.781024 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 965/1911] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:24.787027 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f3223-83df-4f56-aec4-67a26fd82e00 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:24.799989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-5d57dd35-7e8e-4c9e-9662-41ef16d1ec8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f70f8795f26f4dd9a42924c4cb300db6', 'request_id': 'req-5d57dd35-7e8e-4c9e-9662-41ef16d1ec8c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:24.800508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f3223-83df-4f56-aec4-67a26fd82e00 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:24.807194 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-5d57dd35-7e8e-4c9e-9662-41ef16d1ec8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f70f8795f26f4dd9a42924c4cb300db6', 'request_id': 'req-5d57dd35-7e8e-4c9e-9662-41ef16d1ec8c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:24.814435 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-5d57dd35-7e8e-4c9e-9662-41ef16d1ec8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f70f8795f26f4dd9a42924c4cb300db6', 'request_id': 'req-5d57dd35-7e8e-4c9e-9662-41ef16d1ec8c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:24.839733 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-5d57dd35-7e8e-4c9e-9662-41ef16d1ec8c admin admin] The token cache is being invalidate because project f70f8795f26f4dd9a42924c4cb300db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:24.840026 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-5d57dd35-7e8e-4c9e-9662-41ef16d1ec8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:24.841932 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-5d57dd35-7e8e-4c9e-9662-41ef16d1ec8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:24.846109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 947/1912] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:24 2022] DELETE /identity/v3/projects/f70f8795f26f4dd9a42924c4cb300db6 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:09:24.851197 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de107832-c8b8-4787-9cbb-a8f6fc14d059 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:24.851493 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de107832-c8b8-4787-9cbb-a8f6fc14d059 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:24.852000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de107832-c8b8-4787-9cbb-a8f6fc14d059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:24.861879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:24.878582 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-de107832-c8b8-4787-9cbb-a8f6fc14d059 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:24.880467 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-de107832-c8b8-4787-9cbb-a8f6fc14d059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:24.890687 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124ae57-b5de-4341-9f8c-371c630d1738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:24.890687 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124ae57-b5de-4341-9f8c-371c630d1738 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:24.890687 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124ae57-b5de-4341-9f8c-371c630d1738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:24.890687 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124ae57-b5de-4341-9f8c-371c630d1738 admin admin] PATH_INFO: `/v3/projects/ee6b818bdc0f43a9a0e06577c01dd383/users/6c3ffe86a9174f08bb6287d5b8d50d77/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:24.898154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 948/1913] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:24.906202 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f9903-decc-4fe3-a39c-3746a0b498a3 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:24.906539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f9903-decc-4fe3-a39c-3746a0b498a3 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:24.907661 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f9903-decc-4fe3-a39c-3746a0b498a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:24.913198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124ae57-b5de-4341-9f8c-371c630d1738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6b818bdc0f43a9a0e06577c01dd383, user_id=6c3ffe86a9174f08bb6287d5b8d50d77, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:24.916886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124ae57-b5de-4341-9f8c-371c630d1738 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:24.940408 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-939f9903-decc-4fe3-a39c-3746a0b498a3 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:24.941963 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-939f9903-decc-4fe3-a39c-3746a0b498a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:24.943922 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 966/1914] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:24 2022] PUT /identity/v3/projects/ee6b818bdc0f43a9a0e06577c01dd383/users/6c3ffe86a9174f08bb6287d5b8d50d77/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:24.954408 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0ae7d-b6e8-4e1a-82a0-0de63f9a9e32 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:24.954749 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0ae7d-b6e8-4e1a-82a0-0de63f9a9e32 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:24.955579 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0ae7d-b6e8-4e1a-82a0-0de63f9a9e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:25.011254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3cc0ae7d-b6e8-4e1a-82a0-0de63f9a9e32 None None] MFA Rules not processed for user `6c3ffe86a9174f08bb6287d5b8d50d77`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:25.016794 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3cc0ae7d-b6e8-4e1a-82a0-0de63f9a9e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:25.071551 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 949/1915] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:25.075780 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f9903-decc-4fe3-a39c-3746a0b498a3 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:25.089056 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f9903-decc-4fe3-a39c-3746a0b498a3 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:25.100743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05b28e-9cd9-4b03-9de3-cf078e6ed11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:25.102213 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05b28e-9cd9-4b03-9de3-cf078e6ed11d admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:25.102745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05b28e-9cd9-4b03-9de3-cf078e6ed11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:25.103565 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05b28e-9cd9-4b03-9de3-cf078e6ed11d admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:25.104405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05b28e-9cd9-4b03-9de3-cf078e6ed11d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:09:25.104798 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05b28e-9cd9-4b03-9de3-cf078e6ed11d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:25.107467 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05b28e-9cd9-4b03-9de3-cf078e6ed11d admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:25.175162 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 950/1916] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:09:25.176153 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05b28e-9cd9-4b03-9de3-cf078e6ed11d admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:25.216154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05b28e-9cd9-4b03-9de3-cf078e6ed11d admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:25.239545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc7d18-c543-4183-b98f-69158f477788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:25.240181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc7d18-c543-4183-b98f-69158f477788 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:25.240475 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc7d18-c543-4183-b98f-69158f477788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:25.240760 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc7d18-c543-4183-b98f-69158f477788 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:25.241490 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc7d18-c543-4183-b98f-69158f477788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:25.250096 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc7d18-c543-4183-b98f-69158f477788 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:25.293373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 967/1917] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:09:25.300951 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0ae7d-b6e8-4e1a-82a0-0de63f9a9e32 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:25.305547 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3cc0ae7d-b6e8-4e1a-82a0-0de63f9a9e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:25.321084 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 951/1918] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:25 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:25.325310 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc7d18-c543-4183-b98f-69158f477788 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:25.341983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0ae7d-b6e8-4e1a-82a0-0de63f9a9e32 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:25.416975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:25.450108 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac7e97-cc8d-4d10-89ef-73fbaed1bf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:25.450824 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac7e97-cc8d-4d10-89ef-73fbaed1bf07 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:25.451330 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac7e97-cc8d-4d10-89ef-73fbaed1bf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:25.452287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac7e97-cc8d-4d10-89ef-73fbaed1bf07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:25.453216 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac7e97-cc8d-4d10-89ef-73fbaed1bf07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:25.455188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac7e97-cc8d-4d10-89ef-73fbaed1bf07 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:25.489640 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc7d18-c543-4183-b98f-69158f477788 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:25.489886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 968/1919] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:25 2022] POST /identity/v3/projects => generated 401 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:25.494372 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac7e97-cc8d-4d10-89ef-73fbaed1bf07 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:25.593285 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d6a0a-84c0-4ed2-8fbd-153cb0779ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:25.594568 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d6a0a-84c0-4ed2-8fbd-153cb0779ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:25.595242 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d6a0a-84c0-4ed2-8fbd-153cb0779ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:25.595893 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d6a0a-84c0-4ed2-8fbd-153cb0779ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:25.596981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d6a0a-84c0-4ed2-8fbd-153cb0779ec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:25.599382 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d6a0a-84c0-4ed2-8fbd-153cb0779ec3 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:25.616310 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac7e97-cc8d-4d10-89ef-73fbaed1bf07 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:25.617357 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:25.625643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcedd53-ddea-4b88-8b98-7e1680bdcafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:25.627520 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcedd53-ddea-4b88-8b98-7e1680bdcafa admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:25.628015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcedd53-ddea-4b88-8b98-7e1680bdcafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:25.628838 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcedd53-ddea-4b88-8b98-7e1680bdcafa admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:25.630097 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcedd53-ddea-4b88-8b98-7e1680bdcafa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:25.631621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 952/1920] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:25 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:09:25.632768 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcedd53-ddea-4b88-8b98-7e1680bdcafa admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:25.633466 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d6a0a-84c0-4ed2-8fbd-153cb0779ec3 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:25.650201 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d6a0a-84c0-4ed2-8fbd-153cb0779ec3 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:25.664419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 969/1921] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:25 2022] POST /identity/v3/users => generated 307 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:25.664615 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e04f01-44ec-4897-abaf-014383542a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:25.664615 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e04f01-44ec-4897-abaf-014383542a04 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:25.664615 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e04f01-44ec-4897-abaf-014383542a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:25.664615 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e04f01-44ec-4897-abaf-014383542a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:25.664921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e04f01-44ec-4897-abaf-014383542a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:25.666920 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcedd53-ddea-4b88-8b98-7e1680bdcafa admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:25.667864 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e04f01-44ec-4897-abaf-014383542a04 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:25.679993 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 953/1922] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:25.683602 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcedd53-ddea-4b88-8b98-7e1680bdcafa admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:25.688473 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff74a1-c378-4533-8afe-8c3d2ee71ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:25.689146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff74a1-c378-4533-8afe-8c3d2ee71ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:25.689500 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff74a1-c378-4533-8afe-8c3d2ee71ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:25.690049 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff74a1-c378-4533-8afe-8c3d2ee71ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:25.690638 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e04f01-44ec-4897-abaf-014383542a04 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:25.690838 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff74a1-c378-4533-8afe-8c3d2ee71ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:25.692684 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff74a1-c378-4533-8afe-8c3d2ee71ce9 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:25.705119 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e04f01-44ec-4897-abaf-014383542a04 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:25.706526 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 970/1923] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:25.710419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff74a1-c378-4533-8afe-8c3d2ee71ce9 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:25.712398 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a056d6-af2e-4451-b008-7971ad725f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:25.713104 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a056d6-af2e-4451-b008-7971ad725f05 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:25.713394 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a056d6-af2e-4451-b008-7971ad725f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:25.713674 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a056d6-af2e-4451-b008-7971ad725f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:25.714405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a056d6-af2e-4451-b008-7971ad725f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:25.716312 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a056d6-af2e-4451-b008-7971ad725f05 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:25.724014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff74a1-c378-4533-8afe-8c3d2ee71ce9 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:25.729539 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f0ee1-2918-4794-9a72-e85b336d05a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:25.730832 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f0ee1-2918-4794-9a72-e85b336d05a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:25.731321 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f0ee1-2918-4794-9a72-e85b336d05a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:25.731795 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f0ee1-2918-4794-9a72-e85b336d05a2 admin admin] PATH_INFO: `/v3/projects/12d5323d824f483eb6d41958a94759ac/users/c09c454090d04a47b23acdc75bc02297/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:25.743027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 954/1924] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:09:25.747193 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a056d6-af2e-4451-b008-7971ad725f05 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:25.750901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f0ee1-2918-4794-9a72-e85b336d05a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d5323d824f483eb6d41958a94759ac, user_id=c09c454090d04a47b23acdc75bc02297, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:25.754314 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f0ee1-2918-4794-9a72-e85b336d05a2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:25.772051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a056d6-af2e-4451-b008-7971ad725f05 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:25.775995 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 971/1925] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:25 2022] PUT /identity/v3/projects/12d5323d824f483eb6d41958a94759ac/users/c09c454090d04a47b23acdc75bc02297/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:25.780916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f0ee1-2918-4794-9a72-e85b336d05a2 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:25.873247 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77391dd-990a-4c74-beba-fae4a175eee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:25.874651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77391dd-990a-4c74-beba-fae4a175eee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:25.875017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77391dd-990a-4c74-beba-fae4a175eee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:25.875372 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77391dd-990a-4c74-beba-fae4a175eee5 admin admin] PATH_INFO: `/v3/projects/4fca784997a445da93bf6b1fc0cdbc3f/users/811ef89925da46338a466e5b2f104932/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:25.894460 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77391dd-990a-4c74-beba-fae4a175eee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fca784997a445da93bf6b1fc0cdbc3f, user_id=811ef89925da46338a466e5b2f104932, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:25.899000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77391dd-990a-4c74-beba-fae4a175eee5 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:25.930451 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 955/1926] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:25 2022] PUT /identity/v3/projects/4fca784997a445da93bf6b1fc0cdbc3f/users/811ef89925da46338a466e5b2f104932/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:25.932732 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f0ee1-2918-4794-9a72-e85b336d05a2 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:25.942709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fce56-7343-4e8f-ad75-db544a09cbe0 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:25.943010 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fce56-7343-4e8f-ad75-db544a09cbe0 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:25.943281 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fce56-7343-4e8f-ad75-db544a09cbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:25.984605 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-c60fce56-7343-4e8f-ad75-db544a09cbe0 None None] MFA Rules not processed for user `811ef89925da46338a466e5b2f104932`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:25.986399 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-c60fce56-7343-4e8f-ad75-db544a09cbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:25.989335 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:26.044803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90358178-3de4-4ef6-8f34-cdc55aa7b255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:26.045564 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90358178-3de4-4ef6-8f34-cdc55aa7b255 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:26.045858 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90358178-3de4-4ef6-8f34-cdc55aa7b255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:26.046140 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90358178-3de4-4ef6-8f34-cdc55aa7b255 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:26.046935 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90358178-3de4-4ef6-8f34-cdc55aa7b255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:26.049546 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90358178-3de4-4ef6-8f34-cdc55aa7b255 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:26.070458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 972/1927] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:26.073098 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90358178-3de4-4ef6-8f34-cdc55aa7b255 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:26.086901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90358178-3de4-4ef6-8f34-cdc55aa7b255 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:26.094751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cf6fa-fd4c-4a05-9aaf-ca5c88643a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:26.095711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cf6fa-fd4c-4a05-9aaf-ca5c88643a3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:26.096001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cf6fa-fd4c-4a05-9aaf-ca5c88643a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:26.096282 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cf6fa-fd4c-4a05-9aaf-ca5c88643a3a admin admin] PATH_INFO: `/v3/projects/12d5323d824f483eb6d41958a94759ac/users/c09c454090d04a47b23acdc75bc02297/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:26.099121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cf6fa-fd4c-4a05-9aaf-ca5c88643a3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d5323d824f483eb6d41958a94759ac, user_id=c09c454090d04a47b23acdc75bc02297, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:26.103919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cf6fa-fd4c-4a05-9aaf-ca5c88643a3a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:26.104572 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 956/1928] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:26.109638 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fce56-7343-4e8f-ad75-db544a09cbe0 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:26.125861 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 973/1929] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:26 2022] PUT /identity/v3/projects/12d5323d824f483eb6d41958a94759ac/users/c09c454090d04a47b23acdc75bc02297/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:26.126184 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fce56-7343-4e8f-ad75-db544a09cbe0 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:26.128247 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77193df7-8dd3-4d58-bd5b-d31bcb182fa2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:26.128556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77193df7-8dd3-4d58-bd5b-d31bcb182fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:26.128839 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77193df7-8dd3-4d58-bd5b-d31bcb182fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:26.168014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-77193df7-8dd3-4d58-bd5b-d31bcb182fa2 None None] MFA Rules not processed for user `c09c454090d04a47b23acdc75bc02297`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:26.169495 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-77193df7-8dd3-4d58-bd5b-d31bcb182fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:26.202131 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:26.234396 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19f4f4-5224-474d-a13e-9610ecb26258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:26.235124 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19f4f4-5224-474d-a13e-9610ecb26258 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:26.235411 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19f4f4-5224-474d-a13e-9610ecb26258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:26.236096 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19f4f4-5224-474d-a13e-9610ecb26258 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:26.236817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19f4f4-5224-474d-a13e-9610ecb26258 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:26.240781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19f4f4-5224-474d-a13e-9610ecb26258 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:26.270381 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 974/1930] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:26 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:09:26.281924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77193df7-8dd3-4d58-bd5b-d31bcb182fa2 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:26.283466 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-77193df7-8dd3-4d58-bd5b-d31bcb182fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:26.301752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 957/1931] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:26 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:09:26.306185 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19f4f4-5224-474d-a13e-9610ecb26258 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:26.356675 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77193df7-8dd3-4d58-bd5b-d31bcb182fa2 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:26.387070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19f4f4-5224-474d-a13e-9610ecb26258 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:26.394742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea8c7b-21a6-430f-b637-f89b99c67c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:26.395462 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea8c7b-21a6-430f-b637-f89b99c67c2a admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:26.395747 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea8c7b-21a6-430f-b637-f89b99c67c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:26.396023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea8c7b-21a6-430f-b637-f89b99c67c2a admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:26.396769 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea8c7b-21a6-430f-b637-f89b99c67c2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:26.399038 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea8c7b-21a6-430f-b637-f89b99c67c2a admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:26.437590 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 958/1932] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:26 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:26.441606 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea8c7b-21a6-430f-b637-f89b99c67c2a admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:26.445963 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23b93f-6263-46fa-a5c0-fbc8ced0730f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:26.447102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23b93f-6263-46fa-a5c0-fbc8ced0730f service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:26.447577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23b93f-6263-46fa-a5c0-fbc8ced0730f service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:26.448169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23b93f-6263-46fa-a5c0-fbc8ced0730f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:26.454440 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:26.473788 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea8c7b-21a6-430f-b637-f89b99c67c2a admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:26.487539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a655d25-0c77-4216-aab1-a586ada264ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:26.488333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a655d25-0c77-4216-aab1-a586ada264ad admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:26.488760 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a655d25-0c77-4216-aab1-a586ada264ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:26.489113 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a655d25-0c77-4216-aab1-a586ada264ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:26.490369 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a655d25-0c77-4216-aab1-a586ada264ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:26.492502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a655d25-0c77-4216-aab1-a586ada264ad admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:26.510377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 959/1933] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:26.515111 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a655d25-0c77-4216-aab1-a586ada264ad admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:26.532355 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a655d25-0c77-4216-aab1-a586ada264ad admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:26.540472 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2e23e-7189-45f6-884d-a73a936f8afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:26.541428 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2e23e-7189-45f6-884d-a73a936f8afb admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:26.542126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2e23e-7189-45f6-884d-a73a936f8afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:26.542991 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2e23e-7189-45f6-884d-a73a936f8afb admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:26.543988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23b93f-6263-46fa-a5c0-fbc8ced0730f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:26.544190 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2e23e-7189-45f6-884d-a73a936f8afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:26.547177 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2e23e-7189-45f6-884d-a73a936f8afb admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:26.547548 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23b93f-6263-46fa-a5c0-fbc8ced0730f service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:26.566422 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 975/1934] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:26 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:09:26.586759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 960/1935] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:26.590726 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23b93f-6263-46fa-a5c0-fbc8ced0730f service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:26.605150 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23b93f-6263-46fa-a5c0-fbc8ced0730f service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:26.611449 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed8939-63e0-4e1f-8359-f6c912592ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:26.615135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed8939-63e0-4e1f-8359-f6c912592ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:26.615135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed8939-63e0-4e1f-8359-f6c912592ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:26.615135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed8939-63e0-4e1f-8359-f6c912592ce4 admin admin] PATH_INFO: `/v3/projects/a67e868594fa4805aeba01f5ed784234/users/e5d50896d80f4df4abe02ee00a054a75/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:26.644905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed8939-63e0-4e1f-8359-f6c912592ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a67e868594fa4805aeba01f5ed784234, user_id=e5d50896d80f4df4abe02ee00a054a75, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:26.648083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed8939-63e0-4e1f-8359-f6c912592ce4 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:26.674216 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 976/1936] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:26 2022] PUT /identity/v3/projects/a67e868594fa4805aeba01f5ed784234/users/e5d50896d80f4df4abe02ee00a054a75/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:26.685927 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c2c44-3402-458b-8afb-da8db9661bd9 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:26.686226 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c2c44-3402-458b-8afb-da8db9661bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:26.686517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c2c44-3402-458b-8afb-da8db9661bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:26.696859 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed8939-63e0-4e1f-8359-f6c912592ce4 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:26.753703 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-547c2c44-3402-458b-8afb-da8db9661bd9 None None] MFA Rules not processed for user `e5d50896d80f4df4abe02ee00a054a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:26.755150 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-547c2c44-3402-458b-8afb-da8db9661bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:26.817064 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed8939-63e0-4e1f-8359-f6c912592ce4 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:26.823453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15556721-c11e-4c2b-b8de-dc88184d3189 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:26.824355 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15556721-c11e-4c2b-b8de-dc88184d3189 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:26.824794 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15556721-c11e-4c2b-b8de-dc88184d3189 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:26.825392 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15556721-c11e-4c2b-b8de-dc88184d3189 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:26.866373 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 961/1937] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:26.874667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c2c44-3402-458b-8afb-da8db9661bd9 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:26.953003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:26.996719 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15556721-c11e-4c2b-b8de-dc88184d3189 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:27.000244 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15556721-c11e-4c2b-b8de-dc88184d3189 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:27.002996 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c2c44-3402-458b-8afb-da8db9661bd9 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:27.024830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 977/1938] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:26 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:09:27.038881 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406e58d-268b-4db5-bafc-3d6c5dd98cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:27.053157 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406e58d-268b-4db5-bafc-3d6c5dd98cff admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:27.053157 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406e58d-268b-4db5-bafc-3d6c5dd98cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:27.053157 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406e58d-268b-4db5-bafc-3d6c5dd98cff admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:27.053157 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406e58d-268b-4db5-bafc-3d6c5dd98cff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:27.054715 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406e58d-268b-4db5-bafc-3d6c5dd98cff admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:27.140721 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15556721-c11e-4c2b-b8de-dc88184d3189 service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:27.141055 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 962/1939] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:26 2022] POST /identity/v3/projects => generated 387 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:27.165142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15556721-c11e-4c2b-b8de-dc88184d3189 service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:27.234740 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:27.280430 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b4c88-8720-42c3-b9e5-b0411092b753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:27.281242 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b4c88-8720-42c3-b9e5-b0411092b753 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:27.281598 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b4c88-8720-42c3-b9e5-b0411092b753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:27.281983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b4c88-8720-42c3-b9e5-b0411092b753 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:27.282799 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b4c88-8720-42c3-b9e5-b0411092b753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:27.284923 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b4c88-8720-42c3-b9e5-b0411092b753 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:27.336159 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 978/1940] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:27 2022] POST /identity/v3/users => generated 300 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:27.337956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406e58d-268b-4db5-bafc-3d6c5dd98cff admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:27.357337 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406e58d-268b-4db5-bafc-3d6c5dd98cff admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:27.366791 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7115a-5425-4cd3-afe0-8066790b708e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:27.367874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7115a-5425-4cd3-afe0-8066790b708e admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:27.368353 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7115a-5425-4cd3-afe0-8066790b708e admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:27.368900 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7115a-5425-4cd3-afe0-8066790b708e admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:27.370131 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7115a-5425-4cd3-afe0-8066790b708e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:27.372678 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7115a-5425-4cd3-afe0-8066790b708e admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:27.394209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 963/1941] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:27.396192 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b4c88-8720-42c3-b9e5-b0411092b753 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:27.407566 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b4c88-8720-42c3-b9e5-b0411092b753 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:27.412758 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55c862-8dc1-43e5-900a-49b7785b1c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:27.413723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55c862-8dc1-43e5-900a-49b7785b1c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:27.413996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55c862-8dc1-43e5-900a-49b7785b1c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:27.414279 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55c862-8dc1-43e5-900a-49b7785b1c8a admin admin] PATH_INFO: `/v3/projects/63a9a594be64400ba2b9d28689b08393/users/4039c37f0cf04d7f9ed3e20bb289cd11/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:27.475116 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55c862-8dc1-43e5-900a-49b7785b1c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a9a594be64400ba2b9d28689b08393, user_id=4039c37f0cf04d7f9ed3e20bb289cd11, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:27.490048 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55c862-8dc1-43e5-900a-49b7785b1c8a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:27.536878 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 979/1942] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:27 2022] PUT /identity/v3/projects/63a9a594be64400ba2b9d28689b08393/users/4039c37f0cf04d7f9ed3e20bb289cd11/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:27.541886 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7115a-5425-4cd3-afe0-8066790b708e admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:27.560042 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7115a-5425-4cd3-afe0-8066790b708e admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:27.647802 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021aac0a-2624-4b7a-a934-9696d1f04254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:27.648628 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aac0a-2624-4b7a-a934-9696d1f04254 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:27.649018 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aac0a-2624-4b7a-a934-9696d1f04254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:27.649502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aac0a-2624-4b7a-a934-9696d1f04254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:27.650311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021aac0a-2624-4b7a-a934-9696d1f04254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:27.652182 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021aac0a-2624-4b7a-a934-9696d1f04254 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:27.664240 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 964/1943] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:27.668693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55c862-8dc1-43e5-900a-49b7785b1c8a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:27.684181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55c862-8dc1-43e5-900a-49b7785b1c8a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:27.689686 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb85da-3907-4ff2-ba48-ba124ae4ef33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:27.691227 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb85da-3907-4ff2-ba48-ba124ae4ef33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:27.691227 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb85da-3907-4ff2-ba48-ba124ae4ef33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:27.691227 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb85da-3907-4ff2-ba48-ba124ae4ef33 admin admin] PATH_INFO: `/v3/projects/63a9a594be64400ba2b9d28689b08393/users/4039c37f0cf04d7f9ed3e20bb289cd11/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:27.693319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb85da-3907-4ff2-ba48-ba124ae4ef33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a9a594be64400ba2b9d28689b08393, user_id=4039c37f0cf04d7f9ed3e20bb289cd11, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:27.696027 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb85da-3907-4ff2-ba48-ba124ae4ef33 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:27.710944 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 980/1944] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:27 2022] PUT /identity/v3/projects/63a9a594be64400ba2b9d28689b08393/users/4039c37f0cf04d7f9ed3e20bb289cd11/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:09:27.721909 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bef1c9-ee12-4714-9ec9-826194203f5d None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:27.722216 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bef1c9-ee12-4714-9ec9-826194203f5d None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:27.722521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bef1c9-ee12-4714-9ec9-826194203f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:27.766929 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-f1bef1c9-ee12-4714-9ec9-826194203f5d None None] MFA Rules not processed for user `4039c37f0cf04d7f9ed3e20bb289cd11`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:27.767857 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-f1bef1c9-ee12-4714-9ec9-826194203f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:27.866951 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 965/1945] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:27.878701 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb85da-3907-4ff2-ba48-ba124ae4ef33 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:28.014938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb85da-3907-4ff2-ba48-ba124ae4ef33 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:28.022754 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77eb14-4cb8-4d75-847c-70cf64e23a8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:28.023367 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77eb14-4cb8-4d75-847c-70cf64e23a8f service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:28.023664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77eb14-4cb8-4d75-847c-70cf64e23a8f service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:28.024136 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77eb14-4cb8-4d75-847c-70cf64e23a8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:28.038296 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77eb14-4cb8-4d75-847c-70cf64e23a8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:28.039880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77eb14-4cb8-4d75-847c-70cf64e23a8f service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:28.094533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 981/1946] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:29.629043 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bef1c9-ee12-4714-9ec9-826194203f5d None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:29.630572 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-f1bef1c9-ee12-4714-9ec9-826194203f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:29.643818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bef1c9-ee12-4714-9ec9-826194203f5d None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:29.649089 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b65cc7-dff8-4411-9fea-926f6c73311e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:29.649758 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b65cc7-dff8-4411-9fea-926f6c73311e service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:29.650123 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b65cc7-dff8-4411-9fea-926f6c73311e service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:29.650327 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b65cc7-dff8-4411-9fea-926f6c73311e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:29.684990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:29.733916 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b65cc7-dff8-4411-9fea-926f6c73311e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:29.736096 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b65cc7-dff8-4411-9fea-926f6c73311e service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:29.747327 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 966/1947] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:32.241256 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77eb14-4cb8-4d75-847c-70cf64e23a8f service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:32.303110 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77eb14-4cb8-4d75-847c-70cf64e23a8f service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:32.307811 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1132998-936b-4960-869d-bc3feca7e76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:32.308697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1132998-936b-4960-869d-bc3feca7e76a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:32.308965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1132998-936b-4960-869d-bc3feca7e76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:32.309238 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1132998-936b-4960-869d-bc3feca7e76a admin admin] PATH_INFO: `/v3/users/6c3ffe86a9174f08bb6287d5b8d50d77` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:32.310973 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1132998-936b-4960-869d-bc3feca7e76a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c3ffe86a9174f08bb6287d5b8d50d77)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:32.312984 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1132998-936b-4960-869d-bc3feca7e76a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:32.348696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:32.365318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d1132998-936b-4960-869d-bc3feca7e76a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c3ffe86a9174f08bb6287d5b8d50d77'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:32.373280 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d1132998-936b-4960-869d-bc3feca7e76a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c3ffe86a9174f08bb6287d5b8d50d77'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:32.380774 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d1132998-936b-4960-869d-bc3feca7e76a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c3ffe86a9174f08bb6287d5b8d50d77'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:32.393369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d1132998-936b-4960-869d-bc3feca7e76a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c3ffe86a9174f08bb6287d5b8d50d77'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:32.394155 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d1132998-936b-4960-869d-bc3feca7e76a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c3ffe86a9174f08bb6287d5b8d50d77'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:32.400049 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 982/1948] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:32 2022] DELETE /identity/v3/users/6c3ffe86a9174f08bb6287d5b8d50d77 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:32.404725 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c64e6c-3d5e-4229-a555-e4e94d9fb292 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:32.405907 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c64e6c-3d5e-4229-a555-e4e94d9fb292 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:32.405907 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c64e6c-3d5e-4229-a555-e4e94d9fb292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:32.424597 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-91c64e6c-3d5e-4229-a555-e4e94d9fb292 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:32.425827 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-91c64e6c-3d5e-4229-a555-e4e94d9fb292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:32.503718 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 967/1949] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:32.510676 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1132998-936b-4960-869d-bc3feca7e76a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:32.512156 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d1132998-936b-4960-869d-bc3feca7e76a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:32.580839 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1132998-936b-4960-869d-bc3feca7e76a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:32.586218 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd03ba1-0ae9-4c93-8f05-2d76f30e184c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:32.587858 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd03ba1-0ae9-4c93-8f05-2d76f30e184c service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:32.588207 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd03ba1-0ae9-4c93-8f05-2d76f30e184c service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:32.588551 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd03ba1-0ae9-4c93-8f05-2d76f30e184c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:32.601217 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd03ba1-0ae9-4c93-8f05-2d76f30e184c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:32.603089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd03ba1-0ae9-4c93-8f05-2d76f30e184c service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:32.616167 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 983/1950] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:33.022587 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c64e6c-3d5e-4229-a555-e4e94d9fb292 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:33.024478 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-91c64e6c-3d5e-4229-a555-e4e94d9fb292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:33.038964 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c64e6c-3d5e-4229-a555-e4e94d9fb292 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:33.045524 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a2109-d075-4f71-99fd-1af1cb3024b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:33.046670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a2109-d075-4f71-99fd-1af1cb3024b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:33.046819 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a2109-d075-4f71-99fd-1af1cb3024b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:33.047632 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a2109-d075-4f71-99fd-1af1cb3024b2 admin admin] PATH_INFO: `/v3/projects/ee6b818bdc0f43a9a0e06577c01dd383` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:33.049900 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a2109-d075-4f71-99fd-1af1cb3024b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee6b818bdc0f43a9a0e06577c01dd383)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:33.052109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a2109-d075-4f71-99fd-1af1cb3024b2 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:33.106721 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-7c5a2109-d075-4f71-99fd-1af1cb3024b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee6b818bdc0f43a9a0e06577c01dd383', 'request_id': 'req-7c5a2109-d075-4f71-99fd-1af1cb3024b2'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:33.113717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-7c5a2109-d075-4f71-99fd-1af1cb3024b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee6b818bdc0f43a9a0e06577c01dd383', 'request_id': 'req-7c5a2109-d075-4f71-99fd-1af1cb3024b2'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:33.119564 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-7c5a2109-d075-4f71-99fd-1af1cb3024b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee6b818bdc0f43a9a0e06577c01dd383', 'request_id': 'req-7c5a2109-d075-4f71-99fd-1af1cb3024b2'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:33.133641 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-7c5a2109-d075-4f71-99fd-1af1cb3024b2 admin admin] The token cache is being invalidate because project ee6b818bdc0f43a9a0e06577c01dd383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:33.134173 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-7c5a2109-d075-4f71-99fd-1af1cb3024b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:33.135105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-7c5a2109-d075-4f71-99fd-1af1cb3024b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:33.136709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 968/1951] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:33 2022] DELETE /identity/v3/projects/ee6b818bdc0f43a9a0e06577c01dd383 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:33.140830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd03ba1-0ae9-4c93-8f05-2d76f30e184c service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:33.150958 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd03ba1-0ae9-4c93-8f05-2d76f30e184c service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:33.229653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb36e2e-916a-4551-b989-7179b071525a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:33.230581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb36e2e-916a-4551-b989-7179b071525a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:33.230867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb36e2e-916a-4551-b989-7179b071525a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:33.231143 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb36e2e-916a-4551-b989-7179b071525a admin admin] PATH_INFO: `/v3/users/c09c454090d04a47b23acdc75bc02297` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:33.236820 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb36e2e-916a-4551-b989-7179b071525a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c09c454090d04a47b23acdc75bc02297)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:33.241905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb36e2e-916a-4551-b989-7179b071525a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:33.317460 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4bb36e2e-916a-4551-b989-7179b071525a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c09c454090d04a47b23acdc75bc02297'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:33.321847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:33.326177 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4bb36e2e-916a-4551-b989-7179b071525a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c09c454090d04a47b23acdc75bc02297'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:33.337038 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4bb36e2e-916a-4551-b989-7179b071525a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c09c454090d04a47b23acdc75bc02297'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:33.367352 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4bb36e2e-916a-4551-b989-7179b071525a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c09c454090d04a47b23acdc75bc02297'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:33.369886 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4bb36e2e-916a-4551-b989-7179b071525a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c09c454090d04a47b23acdc75bc02297'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:33.383170 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 984/1952] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:33 2022] DELETE /identity/v3/users/c09c454090d04a47b23acdc75bc02297 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:33.930677 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a2109-d075-4f71-99fd-1af1cb3024b2 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:33.933170 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-7c5a2109-d075-4f71-99fd-1af1cb3024b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:33.955775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a2109-d075-4f71-99fd-1af1cb3024b2 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:34.072172 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:34.107613 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeba979-a6e1-492f-a6bb-b264e159577a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:34.109934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeba979-a6e1-492f-a6bb-b264e159577a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:34.110468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeba979-a6e1-492f-a6bb-b264e159577a admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:34.110916 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeba979-a6e1-492f-a6bb-b264e159577a admin admin] PATH_INFO: `/v3/projects/12d5323d824f483eb6d41958a94759ac` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:34.113183 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeba979-a6e1-492f-a6bb-b264e159577a admin admin] RBAC: Authorizing `identity:delete_project(project_id=12d5323d824f483eb6d41958a94759ac)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:34.115691 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeba979-a6e1-492f-a6bb-b264e159577a admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:34.118958 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb36e2e-916a-4551-b989-7179b071525a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:34.121021 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4bb36e2e-916a-4551-b989-7179b071525a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:34.197754 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-baeba979-a6e1-492f-a6bb-b264e159577a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12d5323d824f483eb6d41958a94759ac', 'request_id': 'req-baeba979-a6e1-492f-a6bb-b264e159577a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:34.207339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-baeba979-a6e1-492f-a6bb-b264e159577a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12d5323d824f483eb6d41958a94759ac', 'request_id': 'req-baeba979-a6e1-492f-a6bb-b264e159577a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:34.217256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-baeba979-a6e1-492f-a6bb-b264e159577a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12d5323d824f483eb6d41958a94759ac', 'request_id': 'req-baeba979-a6e1-492f-a6bb-b264e159577a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:34.236767 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb36e2e-916a-4551-b989-7179b071525a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:34.243148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-baeba979-a6e1-492f-a6bb-b264e159577a admin admin] The token cache is being invalidate because project 12d5323d824f483eb6d41958a94759ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:34.244148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-baeba979-a6e1-492f-a6bb-b264e159577a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:34.246059 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-baeba979-a6e1-492f-a6bb-b264e159577a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:34.252787 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 969/1953] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:33 2022] DELETE /identity/v3/projects/12d5323d824f483eb6d41958a94759ac => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:34.254930 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de47f3-577d-4fda-8186-6e32ab0edebf None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:34.255232 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de47f3-577d-4fda-8186-6e32ab0edebf None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:34.255521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de47f3-577d-4fda-8186-6e32ab0edebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:34.319054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-66de47f3-577d-4fda-8186-6e32ab0edebf None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:34.320326 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-66de47f3-577d-4fda-8186-6e32ab0edebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:34.322904 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f093413-566a-44bc-b178-49d4f2fb503b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:34.324402 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f093413-566a-44bc-b178-49d4f2fb503b service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:34.324897 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f093413-566a-44bc-b178-49d4f2fb503b service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:34.325322 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f093413-566a-44bc-b178-49d4f2fb503b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:34.328102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6f093413-566a-44bc-b178-49d4f2fb503b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:34.443911 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f093413-566a-44bc-b178-49d4f2fb503b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:34.445377 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f093413-566a-44bc-b178-49d4f2fb503b service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:34.462250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 985/1954] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:09:34.464673 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 970/1955] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:09:34.473506 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb86ff3-48d3-49d6-8bb5-aa6d804c72fe None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:34.473795 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb86ff3-48d3-49d6-8bb5-aa6d804c72fe None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:34.474074 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb86ff3-48d3-49d6-8bb5-aa6d804c72fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:34.561725 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-bcb86ff3-48d3-49d6-8bb5-aa6d804c72fe None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:34.563902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-bcb86ff3-48d3-49d6-8bb5-aa6d804c72fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:34.584485 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 986/1956] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:34.585628 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de47f3-577d-4fda-8186-6e32ab0edebf None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:34.598774 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de47f3-577d-4fda-8186-6e32ab0edebf None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:34.608228 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2ff61-3485-4a36-98f0-8ca6d68b56a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:34.608918 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2ff61-3485-4a36-98f0-8ca6d68b56a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:34.612906 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2ff61-3485-4a36-98f0-8ca6d68b56a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:34.612906 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2ff61-3485-4a36-98f0-8ca6d68b56a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:34.613308 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2ff61-3485-4a36-98f0-8ca6d68b56a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:09:34.613626 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2ff61-3485-4a36-98f0-8ca6d68b56a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:34.615422 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2ff61-3485-4a36-98f0-8ca6d68b56a4 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:34.648347 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 971/1957] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:09:34.652533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb86ff3-48d3-49d6-8bb5-aa6d804c72fe None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:34.668499 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb86ff3-48d3-49d6-8bb5-aa6d804c72fe None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:34.681243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a6308-7f99-4460-a469-b599602a2422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:34.683034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a6308-7f99-4460-a469-b599602a2422 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:34.683034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a6308-7f99-4460-a469-b599602a2422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:34.683356 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a6308-7f99-4460-a469-b599602a2422 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:34.686015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a6308-7f99-4460-a469-b599602a2422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:34.690036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a6308-7f99-4460-a469-b599602a2422 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:34.757619 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 987/1958] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:34 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:09:34.761408 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2ff61-3485-4a36-98f0-8ca6d68b56a4 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:34.774194 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2ff61-3485-4a36-98f0-8ca6d68b56a4 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:34.908065 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6279b0-2afb-4952-b209-8a3d43ac50b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:34.912616 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6279b0-2afb-4952-b209-8a3d43ac50b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:34.912942 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6279b0-2afb-4952-b209-8a3d43ac50b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:34.913255 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6279b0-2afb-4952-b209-8a3d43ac50b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:34.915918 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6279b0-2afb-4952-b209-8a3d43ac50b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:34.920280 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6279b0-2afb-4952-b209-8a3d43ac50b9 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:34.934090 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:34.953689 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 972/1959] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:34 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:34.956889 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a6308-7f99-4460-a469-b599602a2422 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:34.969622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a6308-7f99-4460-a469-b599602a2422 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:34.976788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8c136-3e18-41c8-940f-bdede2a5a2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:34.977798 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8c136-3e18-41c8-940f-bdede2a5a2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:34.978158 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8c136-3e18-41c8-940f-bdede2a5a2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:34.978485 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8c136-3e18-41c8-940f-bdede2a5a2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:34.979443 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8c136-3e18-41c8-940f-bdede2a5a2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:34.981239 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8c136-3e18-41c8-940f-bdede2a5a2c3 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:34.988911 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:34.996427 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 988/1960] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:09:35.000981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6279b0-2afb-4952-b209-8a3d43ac50b9 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:35.015849 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6279b0-2afb-4952-b209-8a3d43ac50b9 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:35.021264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33915aa1-c34d-4628-90b0-cd0c26aaa5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:35.022097 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33915aa1-c34d-4628-90b0-cd0c26aaa5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:35.022454 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33915aa1-c34d-4628-90b0-cd0c26aaa5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:35.022930 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33915aa1-c34d-4628-90b0-cd0c26aaa5a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:35.023676 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33915aa1-c34d-4628-90b0-cd0c26aaa5a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:35.025431 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33915aa1-c34d-4628-90b0-cd0c26aaa5a4 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:35.037449 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 973/1961] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:35.041370 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8c136-3e18-41c8-940f-bdede2a5a2c3 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:35.052861 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8c136-3e18-41c8-940f-bdede2a5a2c3 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:35.057736 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac74119-9847-4fdb-9e8c-8c6d7d3ce36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:35.058687 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac74119-9847-4fdb-9e8c-8c6d7d3ce36b admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:35.058979 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac74119-9847-4fdb-9e8c-8c6d7d3ce36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:35.059261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac74119-9847-4fdb-9e8c-8c6d7d3ce36b admin admin] PATH_INFO: `/v3/projects/bfb03aaeebbf4584a7d590d9561ebf31/users/0e68e3670e3a46e7b042c20b38ebd19b/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:35.076721 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac74119-9847-4fdb-9e8c-8c6d7d3ce36b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb03aaeebbf4584a7d590d9561ebf31, user_id=0e68e3670e3a46e7b042c20b38ebd19b, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:35.079350 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac74119-9847-4fdb-9e8c-8c6d7d3ce36b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:35.095558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 989/1962] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:35 2022] PUT /identity/v3/projects/bfb03aaeebbf4584a7d590d9561ebf31/users/0e68e3670e3a46e7b042c20b38ebd19b/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:35.106929 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50950d-7ca6-43bd-b1e9-de930b0116b2 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:35.107274 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50950d-7ca6-43bd-b1e9-de930b0116b2 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:35.107556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50950d-7ca6-43bd-b1e9-de930b0116b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:35.148131 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-ca50950d-7ca6-43bd-b1e9-de930b0116b2 None None] MFA Rules not processed for user `0e68e3670e3a46e7b042c20b38ebd19b`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:35.150626 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ca50950d-7ca6-43bd-b1e9-de930b0116b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:35.255606 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 974/1963] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:35.256804 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac74119-9847-4fdb-9e8c-8c6d7d3ce36b admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:35.337821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac74119-9847-4fdb-9e8c-8c6d7d3ce36b admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:35.344427 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dedada-af30-4eea-91ed-f4b6b18a33cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:35.346188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dedada-af30-4eea-91ed-f4b6b18a33cc admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:35.346681 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dedada-af30-4eea-91ed-f4b6b18a33cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:35.347148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dedada-af30-4eea-91ed-f4b6b18a33cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:35.348613 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dedada-af30-4eea-91ed-f4b6b18a33cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:35.351076 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dedada-af30-4eea-91ed-f4b6b18a33cc admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:35.389544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 990/1964] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:35 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:09:35.393651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50950d-7ca6-43bd-b1e9-de930b0116b2 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:35.408062 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50950d-7ca6-43bd-b1e9-de930b0116b2 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:35.530309 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0e09a-33e3-4f71-8d49-c30e42368f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:35.531860 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0e09a-33e3-4f71-8d49-c30e42368f6e admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:35.532398 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0e09a-33e3-4f71-8d49-c30e42368f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:35.533068 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0e09a-33e3-4f71-8d49-c30e42368f6e admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:35.534519 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0e09a-33e3-4f71-8d49-c30e42368f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:35.537269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0e09a-33e3-4f71-8d49-c30e42368f6e admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:35.585724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 975/1965] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:35 2022] POST /identity/v3/users => generated 298 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:35.589657 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dedada-af30-4eea-91ed-f4b6b18a33cc admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:35.606890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dedada-af30-4eea-91ed-f4b6b18a33cc admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:35.613369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2c237-6ea2-49d5-829d-fbb6e9ff30ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:35.615131 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2c237-6ea2-49d5-829d-fbb6e9ff30ff admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:35.615651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2c237-6ea2-49d5-829d-fbb6e9ff30ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:35.616341 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2c237-6ea2-49d5-829d-fbb6e9ff30ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:35.617296 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2c237-6ea2-49d5-829d-fbb6e9ff30ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:35.619931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2c237-6ea2-49d5-829d-fbb6e9ff30ff admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:35.636595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 991/1966] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:09:35.640364 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0e09a-33e3-4f71-8d49-c30e42368f6e admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:35.657288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0e09a-33e3-4f71-8d49-c30e42368f6e admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:35.664150 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a29d45-42a8-41ce-85b7-9317db4ca59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:35.665761 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a29d45-42a8-41ce-85b7-9317db4ca59c admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:35.666273 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a29d45-42a8-41ce-85b7-9317db4ca59c admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:35.666852 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a29d45-42a8-41ce-85b7-9317db4ca59c admin admin] PATH_INFO: `/v3/projects/908584799c314569bba50a1fd5cff139/users/7af0f524537b4c2a829c9e736d994ed9/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:35.700120 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a29d45-42a8-41ce-85b7-9317db4ca59c admin admin] RBAC: Authorizing `identity:create_grant(project_id=908584799c314569bba50a1fd5cff139, user_id=7af0f524537b4c2a829c9e736d994ed9, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:35.703671 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a29d45-42a8-41ce-85b7-9317db4ca59c admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:35.725657 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 976/1967] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:35 2022] PUT /identity/v3/projects/908584799c314569bba50a1fd5cff139/users/7af0f524537b4c2a829c9e736d994ed9/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:35.729439 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2c237-6ea2-49d5-829d-fbb6e9ff30ff admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:35.746228 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2c237-6ea2-49d5-829d-fbb6e9ff30ff admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:35.822485 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a99a5-7a4b-4d63-9575-dcf3d74b31ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:35.823290 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a99a5-7a4b-4d63-9575-dcf3d74b31ae admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:35.823651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a99a5-7a4b-4d63-9575-dcf3d74b31ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:35.824019 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a99a5-7a4b-4d63-9575-dcf3d74b31ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:35.824835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a99a5-7a4b-4d63-9575-dcf3d74b31ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:35.828029 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a99a5-7a4b-4d63-9575-dcf3d74b31ae admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:35.839124 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 992/1968] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:35.843877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a29d45-42a8-41ce-85b7-9317db4ca59c admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:35.854082 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a29d45-42a8-41ce-85b7-9317db4ca59c admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:35.858751 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae7127-c16c-47c5-9c6d-f818c1df9f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:35.859633 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae7127-c16c-47c5-9c6d-f818c1df9f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:35.859916 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae7127-c16c-47c5-9c6d-f818c1df9f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:35.860195 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae7127-c16c-47c5-9c6d-f818c1df9f89 admin admin] PATH_INFO: `/v3/projects/908584799c314569bba50a1fd5cff139/users/7af0f524537b4c2a829c9e736d994ed9/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:35.862164 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae7127-c16c-47c5-9c6d-f818c1df9f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=908584799c314569bba50a1fd5cff139, user_id=7af0f524537b4c2a829c9e736d994ed9, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:35.864866 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae7127-c16c-47c5-9c6d-f818c1df9f89 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:35.876754 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 977/1969] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:35 2022] PUT /identity/v3/projects/908584799c314569bba50a1fd5cff139/users/7af0f524537b4c2a829c9e736d994ed9/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:35.887273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57969c69-a6fe-4409-9c62-180f28ae6d52 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:35.887574 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57969c69-a6fe-4409-9c62-180f28ae6d52 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:35.887861 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57969c69-a6fe-4409-9c62-180f28ae6d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:35.919670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-57969c69-a6fe-4409-9c62-180f28ae6d52 None None] MFA Rules not processed for user `7af0f524537b4c2a829c9e736d994ed9`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:35.920909 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-57969c69-a6fe-4409-9c62-180f28ae6d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:35.957393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:36.003812 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 993/1970] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:36.025302 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae7127-c16c-47c5-9c6d-f818c1df9f89 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:36.027493 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-8eae7127-c16c-47c5-9c6d-f818c1df9f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:36.075589 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:36.112512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae7127-c16c-47c5-9c6d-f818c1df9f89 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:36.116319 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7147b81-6f2e-47bf-b9ec-d571ab16f5ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:36.116980 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7147b81-6f2e-47bf-b9ec-d571ab16f5ad service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:36.117297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7147b81-6f2e-47bf-b9ec-d571ab16f5ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:36.117579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7147b81-6f2e-47bf-b9ec-d571ab16f5ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:36.128116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7147b81-6f2e-47bf-b9ec-d571ab16f5ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:36.129637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7147b81-6f2e-47bf-b9ec-d571ab16f5ad service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:36.140414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 978/1971] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:36.240263 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57969c69-a6fe-4409-9c62-180f28ae6d52 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:36.250422 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57969c69-a6fe-4409-9c62-180f28ae6d52 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:36.254062 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49405143-1ff9-49b7-b6c5-36daada3bc73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:36.254757 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49405143-1ff9-49b7-b6c5-36daada3bc73 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:36.255047 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49405143-1ff9-49b7-b6c5-36daada3bc73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:36.255328 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49405143-1ff9-49b7-b6c5-36daada3bc73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:36.311735 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49405143-1ff9-49b7-b6c5-36daada3bc73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:36.313166 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49405143-1ff9-49b7-b6c5-36daada3bc73 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:36.322103 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 994/1972] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:37.255824 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7147b81-6f2e-47bf-b9ec-d571ab16f5ad service cinder] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:37.257319 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a7147b81-6f2e-47bf-b9ec-d571ab16f5ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:37.321049 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7147b81-6f2e-47bf-b9ec-d571ab16f5ad service cinder] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:37.325631 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc5886-0909-458c-899e-78471a46f7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:37.327021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc5886-0909-458c-899e-78471a46f7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:37.327306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc5886-0909-458c-899e-78471a46f7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:37.327578 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc5886-0909-458c-899e-78471a46f7e1 admin admin] PATH_INFO: `/v3/users/811ef89925da46338a466e5b2f104932` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:37.328753 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc5886-0909-458c-899e-78471a46f7e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=811ef89925da46338a466e5b2f104932)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:37.330698 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc5886-0909-458c-899e-78471a46f7e1 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:37.376758 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-b9bc5886-0909-458c-899e-78471a46f7e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '811ef89925da46338a466e5b2f104932'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:37.383685 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-b9bc5886-0909-458c-899e-78471a46f7e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '811ef89925da46338a466e5b2f104932'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:37.384331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-b9bc5886-0909-458c-899e-78471a46f7e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '811ef89925da46338a466e5b2f104932'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:37.397394 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-b9bc5886-0909-458c-899e-78471a46f7e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '811ef89925da46338a466e5b2f104932'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:37.398068 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-b9bc5886-0909-458c-899e-78471a46f7e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '811ef89925da46338a466e5b2f104932'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:37.410937 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 979/1973] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:37 2022] DELETE /identity/v3/users/811ef89925da46338a466e5b2f104932 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:37.415459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c9184-7570-4995-b0db-9fd67b907aa2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:37.415941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c9184-7570-4995-b0db-9fd67b907aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:37.416030 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c9184-7570-4995-b0db-9fd67b907aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:37.434260 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-930c9184-7570-4995-b0db-9fd67b907aa2 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:37.435558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-930c9184-7570-4995-b0db-9fd67b907aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:37.497755 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 995/1974] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:37.507342 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc5886-0909-458c-899e-78471a46f7e1 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:37.508754 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b9bc5886-0909-458c-899e-78471a46f7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:37.561893 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:37.566329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc5886-0909-458c-899e-78471a46f7e1 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:37.571196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca8cd9-55e1-479d-917f-dfe85398ffff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:37.571978 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca8cd9-55e1-479d-917f-dfe85398ffff service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:37.572483 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca8cd9-55e1-479d-917f-dfe85398ffff service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:37.572788 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca8cd9-55e1-479d-917f-dfe85398ffff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:37.583540 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca8cd9-55e1-479d-917f-dfe85398ffff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:37.584989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca8cd9-55e1-479d-917f-dfe85398ffff service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:37.595495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 980/1975] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:37.986938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c9184-7570-4995-b0db-9fd67b907aa2 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:37.988410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-930c9184-7570-4995-b0db-9fd67b907aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:38.001366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c9184-7570-4995-b0db-9fd67b907aa2 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:38.006115 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bdf987-d57f-4855-82bf-d32aa27acf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:38.007108 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdf987-d57f-4855-82bf-d32aa27acf85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:38.007458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdf987-d57f-4855-82bf-d32aa27acf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:38.007802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdf987-d57f-4855-82bf-d32aa27acf85 admin admin] PATH_INFO: `/v3/projects/4fca784997a445da93bf6b1fc0cdbc3f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:38.009189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bdf987-d57f-4855-82bf-d32aa27acf85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fca784997a445da93bf6b1fc0cdbc3f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:38.011217 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bdf987-d57f-4855-82bf-d32aa27acf85 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:38.065854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a9bdf987-d57f-4855-82bf-d32aa27acf85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fca784997a445da93bf6b1fc0cdbc3f', 'request_id': 'req-a9bdf987-d57f-4855-82bf-d32aa27acf85'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:38.072716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a9bdf987-d57f-4855-82bf-d32aa27acf85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fca784997a445da93bf6b1fc0cdbc3f', 'request_id': 'req-a9bdf987-d57f-4855-82bf-d32aa27acf85'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:38.081216 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a9bdf987-d57f-4855-82bf-d32aa27acf85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fca784997a445da93bf6b1fc0cdbc3f', 'request_id': 'req-a9bdf987-d57f-4855-82bf-d32aa27acf85'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:38.084052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:38.098582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a9bdf987-d57f-4855-82bf-d32aa27acf85 admin admin] The token cache is being invalidate because project 4fca784997a445da93bf6b1fc0cdbc3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:38.099137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a9bdf987-d57f-4855-82bf-d32aa27acf85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:38.099950 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a9bdf987-d57f-4855-82bf-d32aa27acf85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:38.102536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 996/1976] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:37 2022] DELETE /identity/v3/projects/4fca784997a445da93bf6b1fc0cdbc3f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:38.106783 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca8cd9-55e1-479d-917f-dfe85398ffff service neutron] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:38.118177 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca8cd9-55e1-479d-917f-dfe85398ffff service neutron] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:38.182188 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874beccd-5088-41d9-9b2f-e4be53565676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:38.183134 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874beccd-5088-41d9-9b2f-e4be53565676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:38.183423 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874beccd-5088-41d9-9b2f-e4be53565676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:38.183700 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874beccd-5088-41d9-9b2f-e4be53565676 admin admin] PATH_INFO: `/v3/users/e5d50896d80f4df4abe02ee00a054a75` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:38.185256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874beccd-5088-41d9-9b2f-e4be53565676 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d50896d80f4df4abe02ee00a054a75)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:38.187362 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874beccd-5088-41d9-9b2f-e4be53565676 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:38.240591 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-874beccd-5088-41d9-9b2f-e4be53565676 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d50896d80f4df4abe02ee00a054a75'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:38.253177 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-874beccd-5088-41d9-9b2f-e4be53565676 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d50896d80f4df4abe02ee00a054a75'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:38.253934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-874beccd-5088-41d9-9b2f-e4be53565676 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d50896d80f4df4abe02ee00a054a75'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:38.270353 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-874beccd-5088-41d9-9b2f-e4be53565676 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d50896d80f4df4abe02ee00a054a75'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:38.271234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-874beccd-5088-41d9-9b2f-e4be53565676 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d50896d80f4df4abe02ee00a054a75'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:38.285754 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 981/1977] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:38 2022] DELETE /identity/v3/users/e5d50896d80f4df4abe02ee00a054a75 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:38.568671 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bdf987-d57f-4855-82bf-d32aa27acf85 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:38.570232 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a9bdf987-d57f-4855-82bf-d32aa27acf85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:38.585873 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bdf987-d57f-4855-82bf-d32aa27acf85 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:38.644949 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72b0ce-6db0-4457-9b31-716b041deb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:38.645830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72b0ce-6db0-4457-9b31-716b041deb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:38.646115 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72b0ce-6db0-4457-9b31-716b041deb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:38.646439 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72b0ce-6db0-4457-9b31-716b041deb29 admin admin] PATH_INFO: `/v3/projects/a67e868594fa4805aeba01f5ed784234` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:38.647673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72b0ce-6db0-4457-9b31-716b041deb29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a67e868594fa4805aeba01f5ed784234)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:38.649607 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72b0ce-6db0-4457-9b31-716b041deb29 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:38.699438 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-3c72b0ce-6db0-4457-9b31-716b041deb29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a67e868594fa4805aeba01f5ed784234', 'request_id': 'req-3c72b0ce-6db0-4457-9b31-716b041deb29'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:38.705982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-3c72b0ce-6db0-4457-9b31-716b041deb29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a67e868594fa4805aeba01f5ed784234', 'request_id': 'req-3c72b0ce-6db0-4457-9b31-716b041deb29'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:38.711588 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-3c72b0ce-6db0-4457-9b31-716b041deb29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a67e868594fa4805aeba01f5ed784234', 'request_id': 'req-3c72b0ce-6db0-4457-9b31-716b041deb29'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:38.723858 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-3c72b0ce-6db0-4457-9b31-716b041deb29 admin admin] The token cache is being invalidate because project a67e868594fa4805aeba01f5ed784234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:38.724145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-3c72b0ce-6db0-4457-9b31-716b041deb29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:38.724873 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-3c72b0ce-6db0-4457-9b31-716b041deb29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:38.726721 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 997/1978] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:38 2022] DELETE /identity/v3/projects/a67e868594fa4805aeba01f5ed784234 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:09:38.730644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874beccd-5088-41d9-9b2f-e4be53565676 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:38.732565 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-874beccd-5088-41d9-9b2f-e4be53565676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:38.745528 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874beccd-5088-41d9-9b2f-e4be53565676 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:38.803636 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4354c-91be-4465-a236-c81018c79e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:38.804502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4354c-91be-4465-a236-c81018c79e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:38.804809 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4354c-91be-4465-a236-c81018c79e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:38.805084 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4354c-91be-4465-a236-c81018c79e91 admin admin] PATH_INFO: `/v3/users/4039c37f0cf04d7f9ed3e20bb289cd11` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:38.806256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4354c-91be-4465-a236-c81018c79e91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4039c37f0cf04d7f9ed3e20bb289cd11)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:38.808212 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4354c-91be-4465-a236-c81018c79e91 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:38.821414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:38.858302 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-82e4354c-91be-4465-a236-c81018c79e91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4039c37f0cf04d7f9ed3e20bb289cd11'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:38.865201 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-82e4354c-91be-4465-a236-c81018c79e91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4039c37f0cf04d7f9ed3e20bb289cd11'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:38.865844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-82e4354c-91be-4465-a236-c81018c79e91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4039c37f0cf04d7f9ed3e20bb289cd11'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:38.877820 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-82e4354c-91be-4465-a236-c81018c79e91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4039c37f0cf04d7f9ed3e20bb289cd11'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:38.878543 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-82e4354c-91be-4465-a236-c81018c79e91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4039c37f0cf04d7f9ed3e20bb289cd11'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:38.892516 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 982/1979] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:38 2022] DELETE /identity/v3/users/4039c37f0cf04d7f9ed3e20bb289cd11 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:38.954808 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72b0ce-6db0-4457-9b31-716b041deb29 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:38.956594 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3c72b0ce-6db0-4457-9b31-716b041deb29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:38.994841 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72b0ce-6db0-4457-9b31-716b041deb29 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:39.061925 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1d5f5-f994-44df-86a6-f3743f3703af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:39.062858 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1d5f5-f994-44df-86a6-f3743f3703af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:39.063784 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1d5f5-f994-44df-86a6-f3743f3703af admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:39.064129 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1d5f5-f994-44df-86a6-f3743f3703af admin admin] PATH_INFO: `/v3/users/0e68e3670e3a46e7b042c20b38ebd19b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:39.065715 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1d5f5-f994-44df-86a6-f3743f3703af admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e68e3670e3a46e7b042c20b38ebd19b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:39.067701 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1d5f5-f994-44df-86a6-f3743f3703af admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:39.107720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:39.142790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d7c1d5f5-f994-44df-86a6-f3743f3703af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e68e3670e3a46e7b042c20b38ebd19b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:39.152590 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d7c1d5f5-f994-44df-86a6-f3743f3703af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e68e3670e3a46e7b042c20b38ebd19b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:39.162044 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d7c1d5f5-f994-44df-86a6-f3743f3703af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e68e3670e3a46e7b042c20b38ebd19b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:39.181243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d7c1d5f5-f994-44df-86a6-f3743f3703af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e68e3670e3a46e7b042c20b38ebd19b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:39.183337 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d7c1d5f5-f994-44df-86a6-f3743f3703af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e68e3670e3a46e7b042c20b38ebd19b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:39.191048 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 998/1980] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:38 2022] DELETE /identity/v3/users/0e68e3670e3a46e7b042c20b38ebd19b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:39.195395 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15352ee-f12e-4a2b-954a-c7e362946274 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:39.195682 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15352ee-f12e-4a2b-954a-c7e362946274 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:39.195956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15352ee-f12e-4a2b-954a-c7e362946274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:39.222055 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-e15352ee-f12e-4a2b-954a-c7e362946274 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:39.224028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e15352ee-f12e-4a2b-954a-c7e362946274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:39.282010 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1d5f5-f994-44df-86a6-f3743f3703af admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:39.285949 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d7c1d5f5-f994-44df-86a6-f3743f3703af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:39.328459 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 983/1981] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:39.338392 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15352ee-f12e-4a2b-954a-c7e362946274 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:39.339826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e15352ee-f12e-4a2b-954a-c7e362946274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:39.369126 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1d5f5-f994-44df-86a6-f3743f3703af admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:39.374457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d51e65-6fc1-417d-b3e5-840471f40f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:39.375357 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d51e65-6fc1-417d-b3e5-840471f40f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:39.375659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d51e65-6fc1-417d-b3e5-840471f40f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:39.375934 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d51e65-6fc1-417d-b3e5-840471f40f5b admin admin] PATH_INFO: `/v3/projects/63a9a594be64400ba2b9d28689b08393` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:39.377415 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d51e65-6fc1-417d-b3e5-840471f40f5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=63a9a594be64400ba2b9d28689b08393)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:39.380160 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d51e65-6fc1-417d-b3e5-840471f40f5b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:39.403770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15352ee-f12e-4a2b-954a-c7e362946274 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:39.408511 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a71be-87e3-47e8-98de-88b8893cba1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:39.409154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a71be-87e3-47e8-98de-88b8893cba1d service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:39.409441 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a71be-87e3-47e8-98de-88b8893cba1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:39.409730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a71be-87e3-47e8-98de-88b8893cba1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:39.427015 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a71be-87e3-47e8-98de-88b8893cba1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:39.428628 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a71be-87e3-47e8-98de-88b8893cba1d service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:39.439650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 984/1982] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:39.439867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-46d51e65-6fc1-417d-b3e5-840471f40f5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63a9a594be64400ba2b9d28689b08393', 'request_id': 'req-46d51e65-6fc1-417d-b3e5-840471f40f5b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:39.446467 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-46d51e65-6fc1-417d-b3e5-840471f40f5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63a9a594be64400ba2b9d28689b08393', 'request_id': 'req-46d51e65-6fc1-417d-b3e5-840471f40f5b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:39.452877 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-46d51e65-6fc1-417d-b3e5-840471f40f5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63a9a594be64400ba2b9d28689b08393', 'request_id': 'req-46d51e65-6fc1-417d-b3e5-840471f40f5b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:39.469955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-46d51e65-6fc1-417d-b3e5-840471f40f5b admin admin] The token cache is being invalidate because project 63a9a594be64400ba2b9d28689b08393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:39.470338 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-46d51e65-6fc1-417d-b3e5-840471f40f5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:39.471095 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-46d51e65-6fc1-417d-b3e5-840471f40f5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:39.473026 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 999/1983] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:39 2022] DELETE /identity/v3/projects/63a9a594be64400ba2b9d28689b08393 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:39.478736 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38d509-97b5-49d1-a92a-ada1c87bf891 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:39.479254 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38d509-97b5-49d1-a92a-ada1c87bf891 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:39.479655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38d509-97b5-49d1-a92a-ada1c87bf891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:39.514521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-8d38d509-97b5-49d1-a92a-ada1c87bf891 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:39.515863 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-8d38d509-97b5-49d1-a92a-ada1c87bf891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:39.559225 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:39.601328 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 985/1984] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:39.610852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92977fc0-1016-48a7-b6ce-83355beb76b7 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:39.611388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92977fc0-1016-48a7-b6ce-83355beb76b7 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:39.611482 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92977fc0-1016-48a7-b6ce-83355beb76b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:39.634407 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-92977fc0-1016-48a7-b6ce-83355beb76b7 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:39.635969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-92977fc0-1016-48a7-b6ce-83355beb76b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:39.644320 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1000/1985] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:39.648701 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38d509-97b5-49d1-a92a-ada1c87bf891 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:39.660661 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38d509-97b5-49d1-a92a-ada1c87bf891 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:39.665813 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fcf45-42af-42c5-9d32-32ec86f64a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:39.666480 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fcf45-42af-42c5-9d32-32ec86f64a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:39.666796 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fcf45-42af-42c5-9d32-32ec86f64a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:39.667072 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fcf45-42af-42c5-9d32-32ec86f64a87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:39.668196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fcf45-42af-42c5-9d32-32ec86f64a87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:09:39.668498 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fcf45-42af-42c5-9d32-32ec86f64a87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:39.671158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fcf45-42af-42c5-9d32-32ec86f64a87 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:39.689676 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 986/1986] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:09:39.693818 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92977fc0-1016-48a7-b6ce-83355beb76b7 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:39.705701 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92977fc0-1016-48a7-b6ce-83355beb76b7 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:39.712371 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fc318-f7c8-4278-8880-82d1dbc823cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:39.713468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fc318-f7c8-4278-8880-82d1dbc823cc admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:39.714038 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fc318-f7c8-4278-8880-82d1dbc823cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:39.714324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fc318-f7c8-4278-8880-82d1dbc823cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:39.715140 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3fc318-f7c8-4278-8880-82d1dbc823cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:39.717879 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3fc318-f7c8-4278-8880-82d1dbc823cc admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:39.768340 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1001/1987] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:39 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:39.772490 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fcf45-42af-42c5-9d32-32ec86f64a87 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:39.784073 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fcf45-42af-42c5-9d32-32ec86f64a87 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:39.876233 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c8495-652f-4057-8857-946e95e4d1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:39.876927 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c8495-652f-4057-8857-946e95e4d1f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:39.877561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c8495-652f-4057-8857-946e95e4d1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:39.877862 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c8495-652f-4057-8857-946e95e4d1f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:39.878614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c8495-652f-4057-8857-946e95e4d1f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:39.881003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c8495-652f-4057-8857-946e95e4d1f5 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:39.908061 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 987/1988] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:39 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:39.912145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fc318-f7c8-4278-8880-82d1dbc823cc admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:39.920569 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:39.926701 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fc318-f7c8-4278-8880-82d1dbc823cc admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:39.934535 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9e841-105a-4a04-ab98-e8eb75292876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:39.935312 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9e841-105a-4a04-ab98-e8eb75292876 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:39.936005 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9e841-105a-4a04-ab98-e8eb75292876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:39.936520 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9e841-105a-4a04-ab98-e8eb75292876 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:39.937439 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9e841-105a-4a04-ab98-e8eb75292876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:39.939243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9e841-105a-4a04-ab98-e8eb75292876 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:39.950978 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1002/1989] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:09:39.955253 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c8495-652f-4057-8857-946e95e4d1f5 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:39.965840 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c8495-652f-4057-8857-946e95e4d1f5 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:39.971420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55005a8-8d3e-42aa-ad11-ed8680c37158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:39.972179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55005a8-8d3e-42aa-ad11-ed8680c37158 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:39.972554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55005a8-8d3e-42aa-ad11-ed8680c37158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:39.972900 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55005a8-8d3e-42aa-ad11-ed8680c37158 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:39.973735 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55005a8-8d3e-42aa-ad11-ed8680c37158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:39.975666 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55005a8-8d3e-42aa-ad11-ed8680c37158 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:39.991423 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 988/1990] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:39.992841 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9e841-105a-4a04-ab98-e8eb75292876 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:40.005285 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9e841-105a-4a04-ab98-e8eb75292876 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:40.007193 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55005a8-8d3e-42aa-ad11-ed8680c37158 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:40.010969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b55005a8-8d3e-42aa-ad11-ed8680c37158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:40.011963 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03ef37-e939-402a-93ff-9309afb71148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:40.013497 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03ef37-e939-402a-93ff-9309afb71148 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:40.013933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03ef37-e939-402a-93ff-9309afb71148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:40.014235 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03ef37-e939-402a-93ff-9309afb71148 admin admin] PATH_INFO: `/v3/projects/2fa89bb4530647a3a87c3f92c421df62/users/31f2b56b68464450bff5b6e68ab1bfb4/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:40.035937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03ef37-e939-402a-93ff-9309afb71148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa89bb4530647a3a87c3f92c421df62, user_id=31f2b56b68464450bff5b6e68ab1bfb4, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:40.038803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03ef37-e939-402a-93ff-9309afb71148 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:40.042797 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55005a8-8d3e-42aa-ad11-ed8680c37158 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:40.051449 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61fba7-5001-4e40-a7b0-a6cf622b79c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:40.052404 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61fba7-5001-4e40-a7b0-a6cf622b79c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:40.052731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61fba7-5001-4e40-a7b0-a6cf622b79c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:40.053130 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61fba7-5001-4e40-a7b0-a6cf622b79c4 admin admin] PATH_INFO: `/v3/projects/bfb03aaeebbf4584a7d590d9561ebf31` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:40.055200 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61fba7-5001-4e40-a7b0-a6cf622b79c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfb03aaeebbf4584a7d590d9561ebf31)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:40.057525 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61fba7-5001-4e40-a7b0-a6cf622b79c4 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:40.059956 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1003/1991] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:39 2022] PUT /identity/v3/projects/2fa89bb4530647a3a87c3f92c421df62/users/31f2b56b68464450bff5b6e68ab1bfb4/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:40.073632 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166b045-50a5-4558-811a-591b3932100c None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:40.074022 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166b045-50a5-4558-811a-591b3932100c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:40.074397 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166b045-50a5-4558-811a-591b3932100c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:40.108855 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6166b045-50a5-4558-811a-591b3932100c None None] MFA Rules not processed for user `31f2b56b68464450bff5b6e68ab1bfb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:40.110189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6166b045-50a5-4558-811a-591b3932100c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:40.131075 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1b61fba7-5001-4e40-a7b0-a6cf622b79c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfb03aaeebbf4584a7d590d9561ebf31', 'request_id': 'req-1b61fba7-5001-4e40-a7b0-a6cf622b79c4'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:40.139776 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1b61fba7-5001-4e40-a7b0-a6cf622b79c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfb03aaeebbf4584a7d590d9561ebf31', 'request_id': 'req-1b61fba7-5001-4e40-a7b0-a6cf622b79c4'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:40.145761 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1b61fba7-5001-4e40-a7b0-a6cf622b79c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfb03aaeebbf4584a7d590d9561ebf31', 'request_id': 'req-1b61fba7-5001-4e40-a7b0-a6cf622b79c4'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:40.163456 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1b61fba7-5001-4e40-a7b0-a6cf622b79c4 admin admin] The token cache is being invalidate because project bfb03aaeebbf4584a7d590d9561ebf31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:40.163761 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1b61fba7-5001-4e40-a7b0-a6cf622b79c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:40.164437 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1b61fba7-5001-4e40-a7b0-a6cf622b79c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:40.170546 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 989/1992] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:40 2022] DELETE /identity/v3/projects/bfb03aaeebbf4584a7d590d9561ebf31 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:40.171523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61fba7-5001-4e40-a7b0-a6cf622b79c4 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:40.173638 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-1b61fba7-5001-4e40-a7b0-a6cf622b79c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:40.202150 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1004/1993] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:40.207326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166b045-50a5-4558-811a-591b3932100c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:40.209090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6166b045-50a5-4558-811a-591b3932100c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:40.212559 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:40.274391 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61fba7-5001-4e40-a7b0-a6cf622b79c4 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:40.280887 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be73b47-e3c6-489c-a9fe-0d17f8405e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:40.282066 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be73b47-e3c6-489c-a9fe-0d17f8405e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:40.282413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be73b47-e3c6-489c-a9fe-0d17f8405e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:40.282794 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be73b47-e3c6-489c-a9fe-0d17f8405e9c admin admin] PATH_INFO: `/v3/users/7af0f524537b4c2a829c9e736d994ed9` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:40.284101 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be73b47-e3c6-489c-a9fe-0d17f8405e9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7af0f524537b4c2a829c9e736d994ed9)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:40.286539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be73b47-e3c6-489c-a9fe-0d17f8405e9c admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:40.314611 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166b045-50a5-4558-811a-591b3932100c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:40.320794 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af11685-a233-4130-b93f-8642e01845e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:40.321597 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af11685-a233-4130-b93f-8642e01845e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:40.322015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af11685-a233-4130-b93f-8642e01845e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:40.322246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af11685-a233-4130-b93f-8642e01845e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:40.323344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af11685-a233-4130-b93f-8642e01845e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:40.325596 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af11685-a233-4130-b93f-8642e01845e3 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:40.357978 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1005/1994] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:40 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:40.362254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af11685-a233-4130-b93f-8642e01845e3 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:40.378939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-7be73b47-e3c6-489c-a9fe-0d17f8405e9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7af0f524537b4c2a829c9e736d994ed9'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:40.388037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-7be73b47-e3c6-489c-a9fe-0d17f8405e9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7af0f524537b4c2a829c9e736d994ed9'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:40.389447 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-7be73b47-e3c6-489c-a9fe-0d17f8405e9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7af0f524537b4c2a829c9e736d994ed9'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:40.416614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-7be73b47-e3c6-489c-a9fe-0d17f8405e9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7af0f524537b4c2a829c9e736d994ed9'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:40.419005 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-7be73b47-e3c6-489c-a9fe-0d17f8405e9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7af0f524537b4c2a829c9e736d994ed9'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:40.430723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:40.438797 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 990/1995] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:40 2022] DELETE /identity/v3/users/7af0f524537b4c2a829c9e736d994ed9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:40.451808 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af11685-a233-4130-b93f-8642e01845e3 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:40.524655 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f567bf0-afd3-4d26-a74b-ada403f96ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:40.525418 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f567bf0-afd3-4d26-a74b-ada403f96ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:40.525732 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f567bf0-afd3-4d26-a74b-ada403f96ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:40.526029 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f567bf0-afd3-4d26-a74b-ada403f96ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:40.526852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f567bf0-afd3-4d26-a74b-ada403f96ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:40.529461 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f567bf0-afd3-4d26-a74b-ada403f96ce9 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:40.550354 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1006/1996] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:40 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:40.554414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be73b47-e3c6-489c-a9fe-0d17f8405e9c admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:40.556340 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-7be73b47-e3c6-489c-a9fe-0d17f8405e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:40.569841 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be73b47-e3c6-489c-a9fe-0d17f8405e9c admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:40.574557 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2525367-3d2d-4826-9546-2404df9fb772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:40.575237 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2525367-3d2d-4826-9546-2404df9fb772 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:40.575523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2525367-3d2d-4826-9546-2404df9fb772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:40.576454 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2525367-3d2d-4826-9546-2404df9fb772 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:40.577192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2525367-3d2d-4826-9546-2404df9fb772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:40.578838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2525367-3d2d-4826-9546-2404df9fb772 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:40.591119 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 991/1997] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:40.595149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f567bf0-afd3-4d26-a74b-ada403f96ce9 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:40.605566 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f567bf0-afd3-4d26-a74b-ada403f96ce9 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:40.610693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8f2e4-63e6-45c3-aa84-ece54dd05544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:40.611376 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8f2e4-63e6-45c3-aa84-ece54dd05544 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:40.611927 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8f2e4-63e6-45c3-aa84-ece54dd05544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:40.611927 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8f2e4-63e6-45c3-aa84-ece54dd05544 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:40.612641 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8f2e4-63e6-45c3-aa84-ece54dd05544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:40.614370 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8f2e4-63e6-45c3-aa84-ece54dd05544 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:40.625915 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1007/1998] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:40.630338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2525367-3d2d-4826-9546-2404df9fb772 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:40.648938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2525367-3d2d-4826-9546-2404df9fb772 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:40.654974 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48f083-508a-4652-8494-c5a1cabd62e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:40.656006 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48f083-508a-4652-8494-c5a1cabd62e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:40.656299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48f083-508a-4652-8494-c5a1cabd62e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:40.656576 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48f083-508a-4652-8494-c5a1cabd62e7 admin admin] PATH_INFO: `/v3/projects/4cb9353f809a46ec9a7990c960cc284a/users/77e6cdbb4b294a449454bb9f09852000/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:40.672338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48f083-508a-4652-8494-c5a1cabd62e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb9353f809a46ec9a7990c960cc284a, user_id=77e6cdbb4b294a449454bb9f09852000, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:40.675044 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48f083-508a-4652-8494-c5a1cabd62e7 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:40.690224 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 992/1999] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:40 2022] PUT /identity/v3/projects/4cb9353f809a46ec9a7990c960cc284a/users/77e6cdbb4b294a449454bb9f09852000/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:40.700416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9897d1a-b781-4329-ba8a-881c1afbf508 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:40.701330 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9897d1a-b781-4329-ba8a-881c1afbf508 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:40.701611 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9897d1a-b781-4329-ba8a-881c1afbf508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:40.733314 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f9897d1a-b781-4329-ba8a-881c1afbf508 None None] MFA Rules not processed for user `77e6cdbb4b294a449454bb9f09852000`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:40.734895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f9897d1a-b781-4329-ba8a-881c1afbf508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:40.812230 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48f083-508a-4652-8494-c5a1cabd62e7 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:40.813908 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-4c48f083-508a-4652-8494-c5a1cabd62e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:40.843985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1008/2000] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:40.844862 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9897d1a-b781-4329-ba8a-881c1afbf508 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:40.891333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48f083-508a-4652-8494-c5a1cabd62e7 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:40.894048 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068100a-a1b3-4c63-8c5f-182a8f9bf30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:40.895067 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068100a-a1b3-4c63-8c5f-182a8f9bf30c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:40.895446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068100a-a1b3-4c63-8c5f-182a8f9bf30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:40.895871 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068100a-a1b3-4c63-8c5f-182a8f9bf30c admin admin] PATH_INFO: `/v3/projects/908584799c314569bba50a1fd5cff139` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:40.897137 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068100a-a1b3-4c63-8c5f-182a8f9bf30c admin admin] RBAC: Authorizing `identity:delete_project(project_id=908584799c314569bba50a1fd5cff139)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:40.899512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068100a-a1b3-4c63-8c5f-182a8f9bf30c admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:40.911489 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:40.915975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9897d1a-b781-4329-ba8a-881c1afbf508 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:40.923271 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877c9a4-8d3c-4c62-a61a-10ffc31c7e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:40.924143 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877c9a4-8d3c-4c62-a61a-10ffc31c7e1e admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:40.924526 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877c9a4-8d3c-4c62-a61a-10ffc31c7e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:40.924840 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877c9a4-8d3c-4c62-a61a-10ffc31c7e1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:40.925611 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877c9a4-8d3c-4c62-a61a-10ffc31c7e1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:40.927601 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877c9a4-8d3c-4c62-a61a-10ffc31c7e1e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:40.939566 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:40.969079 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1009/2001] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:40 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:09:40.973440 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877c9a4-8d3c-4c62-a61a-10ffc31c7e1e admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:40.973970 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0068100a-a1b3-4c63-8c5f-182a8f9bf30c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '908584799c314569bba50a1fd5cff139', 'request_id': 'req-0068100a-a1b3-4c63-8c5f-182a8f9bf30c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:40.981176 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0068100a-a1b3-4c63-8c5f-182a8f9bf30c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '908584799c314569bba50a1fd5cff139', 'request_id': 'req-0068100a-a1b3-4c63-8c5f-182a8f9bf30c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:40.995482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0068100a-a1b3-4c63-8c5f-182a8f9bf30c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '908584799c314569bba50a1fd5cff139', 'request_id': 'req-0068100a-a1b3-4c63-8c5f-182a8f9bf30c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:41.012918 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0068100a-a1b3-4c63-8c5f-182a8f9bf30c admin admin] The token cache is being invalidate because project 908584799c314569bba50a1fd5cff139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:41.013473 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0068100a-a1b3-4c63-8c5f-182a8f9bf30c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:41.014170 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0068100a-a1b3-4c63-8c5f-182a8f9bf30c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:41.015818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 993/2002] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:40 2022] DELETE /identity/v3/projects/908584799c314569bba50a1fd5cff139 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:09:41.021101 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25da615-59a1-4b17-a577-d17dc00417cc None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:41.021623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25da615-59a1-4b17-a577-d17dc00417cc None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:41.022460 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25da615-59a1-4b17-a577-d17dc00417cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:41.043466 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-b25da615-59a1-4b17-a577-d17dc00417cc None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:41.045235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b25da615-59a1-4b17-a577-d17dc00417cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:41.046393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877c9a4-8d3c-4c62-a61a-10ffc31c7e1e admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:41.051407 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a5906-e3a7-4827-aca6-4ffd67047033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:41.052241 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a5906-e3a7-4827-aca6-4ffd67047033 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:41.052611 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a5906-e3a7-4827-aca6-4ffd67047033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:41.053030 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a5906-e3a7-4827-aca6-4ffd67047033 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:41.053890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a5906-e3a7-4827-aca6-4ffd67047033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:41.054120 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 994/2003] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:09:41.061159 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a5906-e3a7-4827-aca6-4ffd67047033 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:41.063800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3631211-fbef-45e1-8e31-2d9ed97405df None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:41.064096 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3631211-fbef-45e1-8e31-2d9ed97405df None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:41.064415 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3631211-fbef-45e1-8e31-2d9ed97405df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:41.088428 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-b3631211-fbef-45e1-8e31-2d9ed97405df None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:41.089653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b3631211-fbef-45e1-8e31-2d9ed97405df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:41.092799 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1010/2004] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:40 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:09:41.096724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a5906-e3a7-4827-aca6-4ffd67047033 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:41.098486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-030a5906-e3a7-4827-aca6-4ffd67047033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:41.101764 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 995/2005] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:09:41.108160 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3631211-fbef-45e1-8e31-2d9ed97405df None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:41.114011 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a5906-e3a7-4827-aca6-4ffd67047033 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:41.120084 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57557aec-a2cc-4d9d-a1bd-4bb6b661c0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:41.120853 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57557aec-a2cc-4d9d-a1bd-4bb6b661c0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:41.120968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3631211-fbef-45e1-8e31-2d9ed97405df None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:41.121270 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57557aec-a2cc-4d9d-a1bd-4bb6b661c0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:41.121617 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57557aec-a2cc-4d9d-a1bd-4bb6b661c0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:41.122427 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57557aec-a2cc-4d9d-a1bd-4bb6b661c0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:41.124658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57557aec-a2cc-4d9d-a1bd-4bb6b661c0c2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:41.126780 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eddb87-c47e-4c05-9425-d059a711642c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:41.127980 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eddb87-c47e-4c05-9425-d059a711642c admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:41.128304 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eddb87-c47e-4c05-9425-d059a711642c admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:41.128593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eddb87-c47e-4c05-9425-d059a711642c admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:41.129396 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eddb87-c47e-4c05-9425-d059a711642c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:09:41.129727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eddb87-c47e-4c05-9425-d059a711642c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:41.131905 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eddb87-c47e-4c05-9425-d059a711642c admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:41.139635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1011/2006] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:09:41.140801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57557aec-a2cc-4d9d-a1bd-4bb6b661c0c2 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:41.144845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 996/2007] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:09:41.149334 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eddb87-c47e-4c05-9425-d059a711642c admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:41.152042 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57557aec-a2cc-4d9d-a1bd-4bb6b661c0c2 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:41.157561 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be994b-7d87-4110-8856-4eba87b45d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:41.158646 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be994b-7d87-4110-8856-4eba87b45d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:41.158933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be994b-7d87-4110-8856-4eba87b45d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:41.159207 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be994b-7d87-4110-8856-4eba87b45d5e admin admin] PATH_INFO: `/v3/projects/e8b5929936e4420ab8a047527bf2b46e/users/a9c934bd3ed14e8e92bbd4dfe8c4f76c/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:41.160455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eddb87-c47e-4c05-9425-d059a711642c admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:41.166357 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174961fb-b2ef-4a58-9620-749fb18a380f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:41.167065 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174961fb-b2ef-4a58-9620-749fb18a380f admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:41.167600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174961fb-b2ef-4a58-9620-749fb18a380f admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:41.168091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174961fb-b2ef-4a58-9620-749fb18a380f admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:41.168798 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174961fb-b2ef-4a58-9620-749fb18a380f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:41.171976 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174961fb-b2ef-4a58-9620-749fb18a380f admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:41.180335 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be994b-7d87-4110-8856-4eba87b45d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8b5929936e4420ab8a047527bf2b46e, user_id=a9c934bd3ed14e8e92bbd4dfe8c4f76c, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:41.183913 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be994b-7d87-4110-8856-4eba87b45d5e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:41.199332 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1012/2008] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:41 2022] PUT /identity/v3/projects/e8b5929936e4420ab8a047527bf2b46e/users/a9c934bd3ed14e8e92bbd4dfe8c4f76c/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:09:41.203210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be994b-7d87-4110-8856-4eba87b45d5e admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:41.206517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 997/2009] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:41 2022] POST /identity/v3/projects => generated 389 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:41.214282 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174961fb-b2ef-4a58-9620-749fb18a380f admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:41.291464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be994b-7d87-4110-8856-4eba87b45d5e admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:41.298194 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174961fb-b2ef-4a58-9620-749fb18a380f admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:41.299996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea37309-6b5f-4f51-b42b-da8992a6325e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:41.301158 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea37309-6b5f-4f51-b42b-da8992a6325e admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:41.301672 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea37309-6b5f-4f51-b42b-da8992a6325e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:41.302177 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea37309-6b5f-4f51-b42b-da8992a6325e admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:41.303307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea37309-6b5f-4f51-b42b-da8992a6325e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:41.303786 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cf7ba-56db-4fbc-8630-513dee60c411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:41.304563 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cf7ba-56db-4fbc-8630-513dee60c411 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:41.304926 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cf7ba-56db-4fbc-8630-513dee60c411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:41.305052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea37309-6b5f-4f51-b42b-da8992a6325e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:41.305429 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cf7ba-56db-4fbc-8630-513dee60c411 admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:41.306266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16cf7ba-56db-4fbc-8630-513dee60c411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:41.308461 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16cf7ba-56db-4fbc-8630-513dee60c411 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:41.318986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1013/2010] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:41.320249 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea37309-6b5f-4f51-b42b-da8992a6325e admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:41.332144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 998/2011] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:41 2022] POST /identity/v3/users => generated 295 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:09:41.332305 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea37309-6b5f-4f51-b42b-da8992a6325e admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:41.333446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cf7ba-56db-4fbc-8630-513dee60c411 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:41.334628 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436174a-f00a-47b3-ac0c-de2f9122cf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:41.335517 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436174a-f00a-47b3-ac0c-de2f9122cf4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:41.335781 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436174a-f00a-47b3-ac0c-de2f9122cf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:41.336051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436174a-f00a-47b3-ac0c-de2f9122cf4b admin admin] PATH_INFO: `/v3/projects/e8b5929936e4420ab8a047527bf2b46e/users/a9c934bd3ed14e8e92bbd4dfe8c4f76c/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:41.338045 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436174a-f00a-47b3-ac0c-de2f9122cf4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8b5929936e4420ab8a047527bf2b46e, user_id=a9c934bd3ed14e8e92bbd4dfe8c4f76c, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:41.340695 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436174a-f00a-47b3-ac0c-de2f9122cf4b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:41.343766 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cf7ba-56db-4fbc-8630-513dee60c411 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:41.348432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bfa66-769c-46bb-bc19-114e12797bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:41.349085 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bfa66-769c-46bb-bc19-114e12797bce admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:41.349371 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bfa66-769c-46bb-bc19-114e12797bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:41.349651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bfa66-769c-46bb-bc19-114e12797bce admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:41.350411 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7bfa66-769c-46bb-bc19-114e12797bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:41.351912 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1014/2012] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:41 2022] PUT /identity/v3/projects/e8b5929936e4420ab8a047527bf2b46e/users/a9c934bd3ed14e8e92bbd4dfe8c4f76c/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:09:41.352039 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7bfa66-769c-46bb-bc19-114e12797bce admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:41.363145 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 999/2013] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:09:41.363938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e61c7c-bc56-469c-a07a-29a95e246711 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:41.364264 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e61c7c-bc56-469c-a07a-29a95e246711 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:41.364567 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e61c7c-bc56-469c-a07a-29a95e246711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:41.367321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bfa66-769c-46bb-bc19-114e12797bce admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:41.376918 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bfa66-769c-46bb-bc19-114e12797bce admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:41.393943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-43e61c7c-bc56-469c-a07a-29a95e246711 None None] MFA Rules not processed for user `a9c934bd3ed14e8e92bbd4dfe8c4f76c`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:41.395550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-43e61c7c-bc56-469c-a07a-29a95e246711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:41.404877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:41.407143 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:41.441939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba32bd-3bae-45ae-8382-efecc8f63936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:41.442655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba32bd-3bae-45ae-8382-efecc8f63936 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:41.442932 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba32bd-3bae-45ae-8382-efecc8f63936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:41.443236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba32bd-3bae-45ae-8382-efecc8f63936 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:41.443956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba32bd-3bae-45ae-8382-efecc8f63936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:41.445548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba32bd-3bae-45ae-8382-efecc8f63936 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:41.455474 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1000/2014] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:09:41.459697 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba32bd-3bae-45ae-8382-efecc8f63936 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:41.469842 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba32bd-3bae-45ae-8382-efecc8f63936 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:41.472157 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1015/2015] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:09:41.474982 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5c425-2787-476c-a2e7-46529a6fbb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:41.475745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5c425-2787-476c-a2e7-46529a6fbb76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:41.476033 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5c425-2787-476c-a2e7-46529a6fbb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:41.476313 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5c425-2787-476c-a2e7-46529a6fbb76 admin admin] PATH_INFO: `/v3/projects/3be0c0ec07d6422c97a72a8c88462fa7/users/284417a4e71f4407ad502473eb516b8b/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:41.486590 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e61c7c-bc56-469c-a07a-29a95e246711 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:41.488519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-43e61c7c-bc56-469c-a07a-29a95e246711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:41.492051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5c425-2787-476c-a2e7-46529a6fbb76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be0c0ec07d6422c97a72a8c88462fa7, user_id=284417a4e71f4407ad502473eb516b8b, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:41.494752 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5c425-2787-476c-a2e7-46529a6fbb76 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:41.520299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1001/2016] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:41 2022] PUT /identity/v3/projects/3be0c0ec07d6422c97a72a8c88462fa7/users/284417a4e71f4407ad502473eb516b8b/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:09:41.522097 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7de3d-8480-49ab-afc1-019cc9ece4ea None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:41.522406 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7de3d-8480-49ab-afc1-019cc9ece4ea None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:41.522721 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7de3d-8480-49ab-afc1-019cc9ece4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:41.576790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e61c7c-bc56-469c-a07a-29a95e246711 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:41.585616 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-5fd7de3d-8480-49ab-afc1-019cc9ece4ea None None] MFA Rules not processed for user `284417a4e71f4407ad502473eb516b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:41.593090 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5fd7de3d-8480-49ab-afc1-019cc9ece4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:41.642205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6a5b8-7ff8-48b7-8a4f-f8d93d77ffad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:41.643053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6a5b8-7ff8-48b7-8a4f-f8d93d77ffad service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:41.643406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6a5b8-7ff8-48b7-8a4f-f8d93d77ffad service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:41.643763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6a5b8-7ff8-48b7-8a4f-f8d93d77ffad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:41.645678 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-13f6a5b8-7ff8-48b7-8a4f-f8d93d77ffad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:41.695350 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1002/2017] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:09:41.699788 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7de3d-8480-49ab-afc1-019cc9ece4ea None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:41.727067 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6a5b8-7ff8-48b7-8a4f-f8d93d77ffad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:41.733109 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6a5b8-7ff8-48b7-8a4f-f8d93d77ffad service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:41.752199 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1016/2018] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:41.783205 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7de3d-8480-49ab-afc1-019cc9ece4ea None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:41.787848 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71f63b-a7c7-415d-9311-b9866962ff0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:41.788512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71f63b-a7c7-415d-9311-b9866962ff0c admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:41.788795 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71f63b-a7c7-415d-9311-b9866962ff0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:41.789068 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71f63b-a7c7-415d-9311-b9866962ff0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:41.789755 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71f63b-a7c7-415d-9311-b9866962ff0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:41.791730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71f63b-a7c7-415d-9311-b9866962ff0c admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:41.821399 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1003/2019] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:41 2022] POST /identity/v3/projects => generated 389 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:09:41.825420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6a5b8-7ff8-48b7-8a4f-f8d93d77ffad service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:41.853705 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6a5b8-7ff8-48b7-8a4f-f8d93d77ffad service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:41.876759 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:41.934262 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d5a3a-4824-4111-a224-9b242a7ab922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:41.935233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d5a3a-4824-4111-a224-9b242a7ab922 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:41.935606 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d5a3a-4824-4111-a224-9b242a7ab922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:41.935957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d5a3a-4824-4111-a224-9b242a7ab922 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:41.936703 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d5a3a-4824-4111-a224-9b242a7ab922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:41.939769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d5a3a-4824-4111-a224-9b242a7ab922 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:41.965400 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1017/2020] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:41 2022] POST /identity/v3/users => generated 301 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:41.970349 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71f63b-a7c7-415d-9311-b9866962ff0c admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:41.983005 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71f63b-a7c7-415d-9311-b9866962ff0c admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:41.989053 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545f94c-17d8-41e3-be5b-0dfa20767cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:41.989689 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545f94c-17d8-41e3-be5b-0dfa20767cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:41.990023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545f94c-17d8-41e3-be5b-0dfa20767cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:41.990253 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545f94c-17d8-41e3-be5b-0dfa20767cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:41.991026 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545f94c-17d8-41e3-be5b-0dfa20767cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:41.992656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545f94c-17d8-41e3-be5b-0dfa20767cb8 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:42.020240 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1004/2021] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:42.025587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d5a3a-4824-4111-a224-9b242a7ab922 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:42.038867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d5a3a-4824-4111-a224-9b242a7ab922 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:42.044517 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142d0a0-2a86-4187-a313-97393d5d6911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:42.045559 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142d0a0-2a86-4187-a313-97393d5d6911 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:42.045871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142d0a0-2a86-4187-a313-97393d5d6911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:42.046200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142d0a0-2a86-4187-a313-97393d5d6911 admin admin] PATH_INFO: `/v3/projects/dcec40ebf584436db8833e7b8f7d610e/users/d2a4fa1f8b284da586207aeaf360ee33/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:42.080112 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142d0a0-2a86-4187-a313-97393d5d6911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcec40ebf584436db8833e7b8f7d610e, user_id=d2a4fa1f8b284da586207aeaf360ee33, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:42.083214 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142d0a0-2a86-4187-a313-97393d5d6911 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:42.118935 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1018/2022] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:42 2022] PUT /identity/v3/projects/dcec40ebf584436db8833e7b8f7d610e/users/d2a4fa1f8b284da586207aeaf360ee33/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:42.119149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545f94c-17d8-41e3-be5b-0dfa20767cb8 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:42.124897 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:42.135116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545f94c-17d8-41e3-be5b-0dfa20767cb8 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:42.221385 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde29ba-302a-44a5-b614-e03c9a994d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:42.222207 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde29ba-302a-44a5-b614-e03c9a994d8f admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:42.222524 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde29ba-302a-44a5-b614-e03c9a994d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:42.223268 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde29ba-302a-44a5-b614-e03c9a994d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:42.223581 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde29ba-302a-44a5-b614-e03c9a994d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:42.225587 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde29ba-302a-44a5-b614-e03c9a994d8f admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:42.236998 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1005/2023] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:42.241282 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142d0a0-2a86-4187-a313-97393d5d6911 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:42.252880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142d0a0-2a86-4187-a313-97393d5d6911 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:42.258640 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdbe42-7dab-45bf-886b-9cf7cc73d72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:42.259893 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdbe42-7dab-45bf-886b-9cf7cc73d72b admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:42.260189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdbe42-7dab-45bf-886b-9cf7cc73d72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:42.260577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdbe42-7dab-45bf-886b-9cf7cc73d72b admin admin] PATH_INFO: `/v3/projects/dcec40ebf584436db8833e7b8f7d610e/users/d2a4fa1f8b284da586207aeaf360ee33/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:42.262828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdbe42-7dab-45bf-886b-9cf7cc73d72b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcec40ebf584436db8833e7b8f7d610e, user_id=d2a4fa1f8b284da586207aeaf360ee33, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:42.266195 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdbe42-7dab-45bf-886b-9cf7cc73d72b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:42.277216 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1019/2024] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:42 2022] PUT /identity/v3/projects/dcec40ebf584436db8833e7b8f7d610e/users/d2a4fa1f8b284da586207aeaf360ee33/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:09:42.288642 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548662d5-5ba0-47ab-960e-57a16ff0d315 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:42.288941 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548662d5-5ba0-47ab-960e-57a16ff0d315 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:42.289230 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548662d5-5ba0-47ab-960e-57a16ff0d315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:42.316092 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-548662d5-5ba0-47ab-960e-57a16ff0d315 None None] MFA Rules not processed for user `d2a4fa1f8b284da586207aeaf360ee33`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:42.317304 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-548662d5-5ba0-47ab-960e-57a16ff0d315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:42.389003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1006/2025] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:42.399791 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdbe42-7dab-45bf-886b-9cf7cc73d72b admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:42.459531 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdbe42-7dab-45bf-886b-9cf7cc73d72b admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:42.463296 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa26473-8a59-4bbb-a4dc-517d8ece6a7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:42.463942 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa26473-8a59-4bbb-a4dc-517d8ece6a7b service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:42.464224 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa26473-8a59-4bbb-a4dc-517d8ece6a7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:42.464501 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa26473-8a59-4bbb-a4dc-517d8ece6a7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:42.474450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa26473-8a59-4bbb-a4dc-517d8ece6a7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:42.475913 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa26473-8a59-4bbb-a4dc-517d8ece6a7b service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:42.487188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1020/2026] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:42.618984 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548662d5-5ba0-47ab-960e-57a16ff0d315 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:42.688269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548662d5-5ba0-47ab-960e-57a16ff0d315 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:42.693054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0714b73-672e-43e6-86a4-2925d8faa77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:42.693930 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0714b73-672e-43e6-86a4-2925d8faa77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:42.694214 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0714b73-672e-43e6-86a4-2925d8faa77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:42.694505 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0714b73-672e-43e6-86a4-2925d8faa77e admin admin] PATH_INFO: `/v3/users/284417a4e71f4407ad502473eb516b8b` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:42.695804 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0714b73-672e-43e6-86a4-2925d8faa77e admin admin] RBAC: Authorizing `identity:delete_user(user_id=284417a4e71f4407ad502473eb516b8b)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:42.697765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0714b73-672e-43e6-86a4-2925d8faa77e admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:42.732841 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:42.753959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-c0714b73-672e-43e6-86a4-2925d8faa77e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '284417a4e71f4407ad502473eb516b8b'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:42.762236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-c0714b73-672e-43e6-86a4-2925d8faa77e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '284417a4e71f4407ad502473eb516b8b'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:42.763000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-c0714b73-672e-43e6-86a4-2925d8faa77e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '284417a4e71f4407ad502473eb516b8b'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:42.782056 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-c0714b73-672e-43e6-86a4-2925d8faa77e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '284417a4e71f4407ad502473eb516b8b'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:42.782791 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-c0714b73-672e-43e6-86a4-2925d8faa77e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '284417a4e71f4407ad502473eb516b8b'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:42.795567 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1007/2027] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:42 2022] DELETE /identity/v3/users/284417a4e71f4407ad502473eb516b8b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:42.800631 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab89310-07e8-423a-a1da-d1b38b027320 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:42.801113 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab89310-07e8-423a-a1da-d1b38b027320 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:42.801212 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab89310-07e8-423a-a1da-d1b38b027320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:42.818905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-8ab89310-07e8-423a-a1da-d1b38b027320 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:42.820098 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8ab89310-07e8-423a-a1da-d1b38b027320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:42.886412 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1021/2028] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:42.896805 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0714b73-672e-43e6-86a4-2925d8faa77e admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:42.898540 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-c0714b73-672e-43e6-86a4-2925d8faa77e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:42.961736 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0714b73-672e-43e6-86a4-2925d8faa77e admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:42.966405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac67df-cde8-4149-a6ff-2b9fe01cd1ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:42.967213 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac67df-cde8-4149-a6ff-2b9fe01cd1ed service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:42.967514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac67df-cde8-4149-a6ff-2b9fe01cd1ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:42.967841 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac67df-cde8-4149-a6ff-2b9fe01cd1ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:42.978286 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac67df-cde8-4149-a6ff-2b9fe01cd1ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:42.979748 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac67df-cde8-4149-a6ff-2b9fe01cd1ed service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:42.990459 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1008/2029] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:43.267966 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab89310-07e8-423a-a1da-d1b38b027320 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:43.269532 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8ab89310-07e8-423a-a1da-d1b38b027320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:43.282646 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab89310-07e8-423a-a1da-d1b38b027320 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:43.287632 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283e60d-9ec7-4de9-aba0-3c89ace4c4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:43.288563 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283e60d-9ec7-4de9-aba0-3c89ace4c4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:43.288850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283e60d-9ec7-4de9-aba0-3c89ace4c4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:43.289129 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283e60d-9ec7-4de9-aba0-3c89ace4c4d4 admin admin] PATH_INFO: `/v3/projects/3be0c0ec07d6422c97a72a8c88462fa7` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:43.290367 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283e60d-9ec7-4de9-aba0-3c89ace4c4d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3be0c0ec07d6422c97a72a8c88462fa7)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:43.292611 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283e60d-9ec7-4de9-aba0-3c89ace4c4d4 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:43.302893 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:43.341846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4283e60d-9ec7-4de9-aba0-3c89ace4c4d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3be0c0ec07d6422c97a72a8c88462fa7', 'request_id': 'req-4283e60d-9ec7-4de9-aba0-3c89ace4c4d4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:43.348147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4283e60d-9ec7-4de9-aba0-3c89ace4c4d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3be0c0ec07d6422c97a72a8c88462fa7', 'request_id': 'req-4283e60d-9ec7-4de9-aba0-3c89ace4c4d4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:43.353582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4283e60d-9ec7-4de9-aba0-3c89ace4c4d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3be0c0ec07d6422c97a72a8c88462fa7', 'request_id': 'req-4283e60d-9ec7-4de9-aba0-3c89ace4c4d4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:43.367019 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4283e60d-9ec7-4de9-aba0-3c89ace4c4d4 admin admin] The token cache is being invalidate because project 3be0c0ec07d6422c97a72a8c88462fa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:43.367306 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4283e60d-9ec7-4de9-aba0-3c89ace4c4d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:43.367928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4283e60d-9ec7-4de9-aba0-3c89ace4c4d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:43.369470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1022/2030] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:43 2022] DELETE /identity/v3/projects/3be0c0ec07d6422c97a72a8c88462fa7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:43.374024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac67df-cde8-4149-a6ff-2b9fe01cd1ed service neutron] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:43.384182 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac67df-cde8-4149-a6ff-2b9fe01cd1ed service neutron] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:43.441283 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a17c55-c610-470e-8afb-fc3f5d325c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:43.442155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a17c55-c610-470e-8afb-fc3f5d325c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:43.442738 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a17c55-c610-470e-8afb-fc3f5d325c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:43.442933 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a17c55-c610-470e-8afb-fc3f5d325c14 admin admin] PATH_INFO: `/v3/users/d2a4fa1f8b284da586207aeaf360ee33` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:43.444264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a17c55-c610-470e-8afb-fc3f5d325c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2a4fa1f8b284da586207aeaf360ee33)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:43.446816 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a17c55-c610-470e-8afb-fc3f5d325c14 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:43.494217 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-36a17c55-c610-470e-8afb-fc3f5d325c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2a4fa1f8b284da586207aeaf360ee33'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:43.495947 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:43.503443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-36a17c55-c610-470e-8afb-fc3f5d325c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2a4fa1f8b284da586207aeaf360ee33'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:43.504537 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-36a17c55-c610-470e-8afb-fc3f5d325c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2a4fa1f8b284da586207aeaf360ee33'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:43.517151 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-36a17c55-c610-470e-8afb-fc3f5d325c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2a4fa1f8b284da586207aeaf360ee33'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:43.517731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-36a17c55-c610-470e-8afb-fc3f5d325c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2a4fa1f8b284da586207aeaf360ee33'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:43.530271 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1009/2031] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:43 2022] DELETE /identity/v3/users/d2a4fa1f8b284da586207aeaf360ee33 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:43.816980 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283e60d-9ec7-4de9-aba0-3c89ace4c4d4 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:43.818478 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4283e60d-9ec7-4de9-aba0-3c89ace4c4d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:43.837130 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283e60d-9ec7-4de9-aba0-3c89ace4c4d4 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:43.898434 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee00cf5-4237-4c8c-8c97-9823980660c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:43.899636 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee00cf5-4237-4c8c-8c97-9823980660c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:43.900044 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee00cf5-4237-4c8c-8c97-9823980660c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:43.900470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee00cf5-4237-4c8c-8c97-9823980660c0 admin admin] PATH_INFO: `/v3/projects/dcec40ebf584436db8833e7b8f7d610e` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:43.902148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee00cf5-4237-4c8c-8c97-9823980660c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcec40ebf584436db8833e7b8f7d610e)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:43.905007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee00cf5-4237-4c8c-8c97-9823980660c0 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:43.955791 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-bee00cf5-4237-4c8c-8c97-9823980660c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcec40ebf584436db8833e7b8f7d610e', 'request_id': 'req-bee00cf5-4237-4c8c-8c97-9823980660c0'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:43.963561 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-bee00cf5-4237-4c8c-8c97-9823980660c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcec40ebf584436db8833e7b8f7d610e', 'request_id': 'req-bee00cf5-4237-4c8c-8c97-9823980660c0'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:43.970382 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-bee00cf5-4237-4c8c-8c97-9823980660c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcec40ebf584436db8833e7b8f7d610e', 'request_id': 'req-bee00cf5-4237-4c8c-8c97-9823980660c0'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:43.983940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-bee00cf5-4237-4c8c-8c97-9823980660c0 admin admin] The token cache is being invalidate because project dcec40ebf584436db8833e7b8f7d610e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:43.984231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-bee00cf5-4237-4c8c-8c97-9823980660c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:43.984869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-bee00cf5-4237-4c8c-8c97-9823980660c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:43.986460 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1023/2032] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:43 2022] DELETE /identity/v3/projects/dcec40ebf584436db8833e7b8f7d610e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:43.991459 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4148aa-2c18-4a6a-b331-5248b79d7cf0 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:43.991933 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4148aa-2c18-4a6a-b331-5248b79d7cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:43.992022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4148aa-2c18-4a6a-b331-5248b79d7cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:44.009582 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-ef4148aa-2c18-4a6a-b331-5248b79d7cf0 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:44.010826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ef4148aa-2c18-4a6a-b331-5248b79d7cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:44.082122 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1010/2033] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:44.085273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aec39e-7ede-4896-af63-beca6b97afa2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:44.085273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aec39e-7ede-4896-af63-beca6b97afa2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:44.085273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aec39e-7ede-4896-af63-beca6b97afa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:44.105840 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e5aec39e-7ede-4896-af63-beca6b97afa2 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:44.107116 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e5aec39e-7ede-4896-af63-beca6b97afa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:44.115387 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1024/2034] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:44.120781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4148aa-2c18-4a6a-b331-5248b79d7cf0 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:44.130165 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4148aa-2c18-4a6a-b331-5248b79d7cf0 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:44.135603 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51352d-58b5-407f-bed6-0108fcaad088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:44.136277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51352d-58b5-407f-bed6-0108fcaad088 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:44.136562 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51352d-58b5-407f-bed6-0108fcaad088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:44.136839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51352d-58b5-407f-bed6-0108fcaad088 admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:44.137566 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51352d-58b5-407f-bed6-0108fcaad088 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:09:44.137881 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51352d-58b5-407f-bed6-0108fcaad088 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:44.140015 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51352d-58b5-407f-bed6-0108fcaad088 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:44.152373 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1011/2035] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:09:44.157205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aec39e-7ede-4896-af63-beca6b97afa2 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:44.166355 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aec39e-7ede-4896-af63-beca6b97afa2 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:44.171417 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7232e9-62e7-4d19-b350-389dce6caff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:44.172082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7232e9-62e7-4d19-b350-389dce6caff6 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:44.172374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7232e9-62e7-4d19-b350-389dce6caff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:44.172650 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7232e9-62e7-4d19-b350-389dce6caff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:44.173343 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7232e9-62e7-4d19-b350-389dce6caff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:44.175284 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7232e9-62e7-4d19-b350-389dce6caff6 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:44.195704 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:44.207423 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1025/2036] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:44 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:44.208630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51352d-58b5-407f-bed6-0108fcaad088 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:44.221831 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51352d-58b5-407f-bed6-0108fcaad088 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:44.313880 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6233d13-7b78-49c5-98c8-fc1386dae0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:44.314754 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6233d13-7b78-49c5-98c8-fc1386dae0ec admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:44.315044 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6233d13-7b78-49c5-98c8-fc1386dae0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:44.315314 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6233d13-7b78-49c5-98c8-fc1386dae0ec admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:44.316388 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6233d13-7b78-49c5-98c8-fc1386dae0ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:44.322061 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6233d13-7b78-49c5-98c8-fc1386dae0ec admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:44.345306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1012/2037] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:44 2022] POST /identity/v3/users => generated 287 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:44.346470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7232e9-62e7-4d19-b350-389dce6caff6 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:44.360082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7232e9-62e7-4d19-b350-389dce6caff6 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:44.369386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3520ef9-9801-4d92-bb1d-e573e7cfba54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:44.370380 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3520ef9-9801-4d92-bb1d-e573e7cfba54 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:44.370743 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3520ef9-9801-4d92-bb1d-e573e7cfba54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:44.371034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3520ef9-9801-4d92-bb1d-e573e7cfba54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:44.371773 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3520ef9-9801-4d92-bb1d-e573e7cfba54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:44.377003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3520ef9-9801-4d92-bb1d-e573e7cfba54 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:44.400026 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1026/2038] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:44.403950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6233d13-7b78-49c5-98c8-fc1386dae0ec admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:44.416370 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6233d13-7b78-49c5-98c8-fc1386dae0ec admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:44.422738 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd3fe8-b6c8-46bf-b824-14314b063838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:44.423418 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd3fe8-b6c8-46bf-b824-14314b063838 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:44.423703 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd3fe8-b6c8-46bf-b824-14314b063838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:44.423981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd3fe8-b6c8-46bf-b824-14314b063838 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:44.424708 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd3fe8-b6c8-46bf-b824-14314b063838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:44.426308 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd3fe8-b6c8-46bf-b824-14314b063838 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:44.434112 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3520ef9-9801-4d92-bb1d-e573e7cfba54 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:44.436616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a3520ef9-9801-4d92-bb1d-e573e7cfba54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:44.438715 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1013/2039] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:44.442348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd3fe8-b6c8-46bf-b824-14314b063838 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:44.455725 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd3fe8-b6c8-46bf-b824-14314b063838 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:44.461495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646dfd6-a0e8-4e39-ad2a-be96cbe94a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:44.462387 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646dfd6-a0e8-4e39-ad2a-be96cbe94a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:44.462702 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646dfd6-a0e8-4e39-ad2a-be96cbe94a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:44.462978 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646dfd6-a0e8-4e39-ad2a-be96cbe94a1a admin admin] PATH_INFO: `/v3/projects/041abbbe2ce54c8fa7c3d100c8d0e180/users/c8a7201fb47c40eba1218a69314e6809/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:44.483306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646dfd6-a0e8-4e39-ad2a-be96cbe94a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=041abbbe2ce54c8fa7c3d100c8d0e180, user_id=c8a7201fb47c40eba1218a69314e6809, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:44.487892 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646dfd6-a0e8-4e39-ad2a-be96cbe94a1a admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:44.506248 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1014/2040] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:44 2022] PUT /identity/v3/projects/041abbbe2ce54c8fa7c3d100c8d0e180/users/c8a7201fb47c40eba1218a69314e6809/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:09:44.517088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb93e72-da15-4924-80ac-6b9beee3f2c7 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:44.517338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb93e72-da15-4924-80ac-6b9beee3f2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:44.517620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb93e72-da15-4924-80ac-6b9beee3f2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:44.525546 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3520ef9-9801-4d92-bb1d-e573e7cfba54 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:44.530550 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:44.549511 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-ceb93e72-da15-4924-80ac-6b9beee3f2c7 None None] MFA Rules not processed for user `c8a7201fb47c40eba1218a69314e6809`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:44.550778 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ceb93e72-da15-4924-80ac-6b9beee3f2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:44.602903 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac75ed1-2a61-4114-ae13-c73e046c113d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:44.603568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac75ed1-2a61-4114-ae13-c73e046c113d service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:44.603852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac75ed1-2a61-4114-ae13-c73e046c113d service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:44.604131 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac75ed1-2a61-4114-ae13-c73e046c113d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:44.611203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5ac75ed1-2a61-4114-ae13-c73e046c113d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:44.650549 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1015/2041] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:09:44.655359 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb93e72-da15-4924-80ac-6b9beee3f2c7 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:44.702225 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac75ed1-2a61-4114-ae13-c73e046c113d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:44.703718 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac75ed1-2a61-4114-ae13-c73e046c113d service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:44.713143 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1027/2042] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:44.713903 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac75ed1-2a61-4114-ae13-c73e046c113d service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:44.715340 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5ac75ed1-2a61-4114-ae13-c73e046c113d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:44.726231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac75ed1-2a61-4114-ae13-c73e046c113d service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:44.730089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ad82c-3c69-4a6f-a538-3b81160e0a9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:44.730775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ad82c-3c69-4a6f-a538-3b81160e0a9e service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:44.731060 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ad82c-3c69-4a6f-a538-3b81160e0a9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:44.731337 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ad82c-3c69-4a6f-a538-3b81160e0a9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:44.734028 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6e0ad82c-3c69-4a6f-a538-3b81160e0a9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:44.737040 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb93e72-da15-4924-80ac-6b9beee3f2c7 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:44.751322 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d46547-1fc6-4d6d-b56e-fd96c3b6d6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:44.751986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d46547-1fc6-4d6d-b56e-fd96c3b6d6ce admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:44.752346 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d46547-1fc6-4d6d-b56e-fd96c3b6d6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:44.752704 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d46547-1fc6-4d6d-b56e-fd96c3b6d6ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:44.753670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d46547-1fc6-4d6d-b56e-fd96c3b6d6ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:44.755927 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d46547-1fc6-4d6d-b56e-fd96c3b6d6ce admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:44.790590 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1016/2043] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:44 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:44.795237 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d46547-1fc6-4d6d-b56e-fd96c3b6d6ce admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:44.806196 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:44.826763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ad82c-3c69-4a6f-a538-3b81160e0a9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:44.830246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ad82c-3c69-4a6f-a538-3b81160e0a9e service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:44.845356 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1028/2044] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:44.885929 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d46547-1fc6-4d6d-b56e-fd96c3b6d6ce admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:44.892194 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cef8e-8c0c-469d-b6d0-9f5eaab7ebef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:44.893323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cef8e-8c0c-469d-b6d0-9f5eaab7ebef admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:44.893745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cef8e-8c0c-469d-b6d0-9f5eaab7ebef admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:44.894212 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cef8e-8c0c-469d-b6d0-9f5eaab7ebef admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:44.895145 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cef8e-8c0c-469d-b6d0-9f5eaab7ebef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:44.897357 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cef8e-8c0c-469d-b6d0-9f5eaab7ebef admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:44.931004 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1017/2045] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:44 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:44.935971 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ad82c-3c69-4a6f-a538-3b81160e0a9e service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:44.948311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ad82c-3c69-4a6f-a538-3b81160e0a9e service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:44.953478 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030607bf-9199-458d-a996-3867794adabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:44.954151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030607bf-9199-458d-a996-3867794adabb admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:44.954439 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030607bf-9199-458d-a996-3867794adabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:44.954743 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030607bf-9199-458d-a996-3867794adabb admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:44.955474 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030607bf-9199-458d-a996-3867794adabb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:44.957095 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030607bf-9199-458d-a996-3867794adabb admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:44.972877 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1029/2046] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:44.975721 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cef8e-8c0c-469d-b6d0-9f5eaab7ebef admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:44.989716 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cef8e-8c0c-469d-b6d0-9f5eaab7ebef admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:44.994789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a8339-54d8-4e6f-939e-004bb459b197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:44.995821 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a8339-54d8-4e6f-939e-004bb459b197 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:44.996112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a8339-54d8-4e6f-939e-004bb459b197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:44.996391 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a8339-54d8-4e6f-939e-004bb459b197 admin admin] PATH_INFO: `/v3/projects/c3bc3a15294b4a4ca338f12ab9aaeee0/users/2dbec06a920548df9c10a3a3c873b0b2/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:45.011124 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:45.022440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a8339-54d8-4e6f-939e-004bb459b197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3bc3a15294b4a4ca338f12ab9aaeee0, user_id=2dbec06a920548df9c10a3a3c873b0b2, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:45.026575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a8339-54d8-4e6f-939e-004bb459b197 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:45.049276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1018/2047] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:44 2022] PUT /identity/v3/projects/c3bc3a15294b4a4ca338f12ab9aaeee0/users/2dbec06a920548df9c10a3a3c873b0b2/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:45.053675 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030607bf-9199-458d-a996-3867794adabb admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:45.070220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030607bf-9199-458d-a996-3867794adabb admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:45.158753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866dd6b-0053-427f-88af-3ea197608e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:45.160195 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866dd6b-0053-427f-88af-3ea197608e84 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:45.160492 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866dd6b-0053-427f-88af-3ea197608e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:45.160813 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866dd6b-0053-427f-88af-3ea197608e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:45.161554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866dd6b-0053-427f-88af-3ea197608e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:45.163228 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866dd6b-0053-427f-88af-3ea197608e84 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:45.176037 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1030/2048] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:09:45.181037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a8339-54d8-4e6f-939e-004bb459b197 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:45.193002 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a8339-54d8-4e6f-939e-004bb459b197 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:45.198729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1f0c7-6290-42b4-a3a7-5703b5b7ccbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:45.199681 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1f0c7-6290-42b4-a3a7-5703b5b7ccbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:45.199795 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1f0c7-6290-42b4-a3a7-5703b5b7ccbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:45.200064 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1f0c7-6290-42b4-a3a7-5703b5b7ccbd admin admin] PATH_INFO: `/v3/projects/c3bc3a15294b4a4ca338f12ab9aaeee0/users/2dbec06a920548df9c10a3a3c873b0b2/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:45.202357 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1f0c7-6290-42b4-a3a7-5703b5b7ccbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3bc3a15294b4a4ca338f12ab9aaeee0, user_id=2dbec06a920548df9c10a3a3c873b0b2, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:45.205318 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1f0c7-6290-42b4-a3a7-5703b5b7ccbd admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:45.218272 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1019/2049] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:45 2022] PUT /identity/v3/projects/c3bc3a15294b4a4ca338f12ab9aaeee0/users/2dbec06a920548df9c10a3a3c873b0b2/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:45.230313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd216b-9c1e-41f0-9934-8ab3926481f3 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:45.230593 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd216b-9c1e-41f0-9934-8ab3926481f3 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:45.230906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd216b-9c1e-41f0-9934-8ab3926481f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:45.261447 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-dbcd216b-9c1e-41f0-9934-8ab3926481f3 None None] MFA Rules not processed for user `2dbec06a920548df9c10a3a3c873b0b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:45.262779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-dbcd216b-9c1e-41f0-9934-8ab3926481f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:45.370529 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1031/2050] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:09:45.423924 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1f0c7-6290-42b4-a3a7-5703b5b7ccbd admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:45.502746 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1f0c7-6290-42b4-a3a7-5703b5b7ccbd admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:45.507002 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632d608-a69d-401e-902a-a709e8c3d97f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:45.507842 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632d608-a69d-401e-902a-a709e8c3d97f service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:45.508257 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632d608-a69d-401e-902a-a709e8c3d97f service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:45.508648 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632d608-a69d-401e-902a-a709e8c3d97f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:45.581354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632d608-a69d-401e-902a-a709e8c3d97f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:45.582880 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632d608-a69d-401e-902a-a709e8c3d97f service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:45.608342 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1020/2051] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:45.769452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd216b-9c1e-41f0-9934-8ab3926481f3 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:45.783957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd216b-9c1e-41f0-9934-8ab3926481f3 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:45.791278 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9ec1b-83c5-4f5d-b190-78249d596f3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:45.792997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9ec1b-83c5-4f5d-b190-78249d596f3a service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:45.793375 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9ec1b-83c5-4f5d-b190-78249d596f3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:45.793659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9ec1b-83c5-4f5d-b190-78249d596f3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:45.796646 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-81a9ec1b-83c5-4f5d-b190-78249d596f3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:45.868953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:45.871844 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9ec1b-83c5-4f5d-b190-78249d596f3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:45.873615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9ec1b-83c5-4f5d-b190-78249d596f3a service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:45.887445 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1032/2052] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:48.312771 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632d608-a69d-401e-902a-a709e8c3d97f service cinder] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:48.314328 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-4632d608-a69d-401e-902a-a709e8c3d97f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:48.385623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632d608-a69d-401e-902a-a709e8c3d97f service cinder] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:48.390129 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba723d0-0cfb-4a31-9df3-68ade0756c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:48.391179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba723d0-0cfb-4a31-9df3-68ade0756c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:48.391463 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba723d0-0cfb-4a31-9df3-68ade0756c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:48.391739 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba723d0-0cfb-4a31-9df3-68ade0756c66 admin admin] PATH_INFO: `/v3/users/8445dcc0f7e942cf8a6a36c750653312` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:48.392919 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba723d0-0cfb-4a31-9df3-68ade0756c66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8445dcc0f7e942cf8a6a36c750653312)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:48.394895 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba723d0-0cfb-4a31-9df3-68ade0756c66 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:48.429803 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:48.445516 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9ba723d0-0cfb-4a31-9df3-68ade0756c66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8445dcc0f7e942cf8a6a36c750653312'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:48.453787 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9ba723d0-0cfb-4a31-9df3-68ade0756c66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8445dcc0f7e942cf8a6a36c750653312'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:48.454661 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9ba723d0-0cfb-4a31-9df3-68ade0756c66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8445dcc0f7e942cf8a6a36c750653312'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:48.468938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9ba723d0-0cfb-4a31-9df3-68ade0756c66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8445dcc0f7e942cf8a6a36c750653312'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:48.469666 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9ba723d0-0cfb-4a31-9df3-68ade0756c66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8445dcc0f7e942cf8a6a36c750653312'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:48.484112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1021/2053] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:48 2022] DELETE /identity/v3/users/8445dcc0f7e942cf8a6a36c750653312 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:48.728450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9ec1b-83c5-4f5d-b190-78249d596f3a service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:48.755212 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9ec1b-83c5-4f5d-b190-78249d596f3a service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:48.872058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ad86c-ebc3-4251-98f6-6e9757b0ba12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:48.874267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ad86c-ebc3-4251-98f6-6e9757b0ba12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:48.875134 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ad86c-ebc3-4251-98f6-6e9757b0ba12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:48.875421 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ad86c-ebc3-4251-98f6-6e9757b0ba12 admin admin] PATH_INFO: `/v3/projects/b47b25a5f0184af3adbd6ee26f43e7ce` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:48.878962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ad86c-ebc3-4251-98f6-6e9757b0ba12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b47b25a5f0184af3adbd6ee26f43e7ce)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:48.882086 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ad86c-ebc3-4251-98f6-6e9757b0ba12 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:48.977131 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-926ad86c-ebc3-4251-98f6-6e9757b0ba12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b47b25a5f0184af3adbd6ee26f43e7ce', 'request_id': 'req-926ad86c-ebc3-4251-98f6-6e9757b0ba12'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:48.988605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-926ad86c-ebc3-4251-98f6-6e9757b0ba12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b47b25a5f0184af3adbd6ee26f43e7ce', 'request_id': 'req-926ad86c-ebc3-4251-98f6-6e9757b0ba12'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:48.998945 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-926ad86c-ebc3-4251-98f6-6e9757b0ba12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b47b25a5f0184af3adbd6ee26f43e7ce', 'request_id': 'req-926ad86c-ebc3-4251-98f6-6e9757b0ba12'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:49.019857 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-926ad86c-ebc3-4251-98f6-6e9757b0ba12 admin admin] The token cache is being invalidate because project b47b25a5f0184af3adbd6ee26f43e7ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:49.020776 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-926ad86c-ebc3-4251-98f6-6e9757b0ba12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:49.021389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-926ad86c-ebc3-4251-98f6-6e9757b0ba12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:49.027956 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1033/2054] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:48 2022] DELETE /identity/v3/projects/b47b25a5f0184af3adbd6ee26f43e7ce => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:49.038025 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d339f-22ac-46a0-84f8-768794f84181 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:49.038468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d339f-22ac-46a0-84f8-768794f84181 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:49.038811 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d339f-22ac-46a0-84f8-768794f84181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:49.065236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-389d339f-22ac-46a0-84f8-768794f84181 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:49.067189 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-389d339f-22ac-46a0-84f8-768794f84181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:49.164832 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1022/2055] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:49.174142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08f9cb-d5de-4a5f-bb99-864532ff7261 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:49.177819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08f9cb-d5de-4a5f-bb99-864532ff7261 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:49.178832 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08f9cb-d5de-4a5f-bb99-864532ff7261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:49.226460 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-2e08f9cb-d5de-4a5f-bb99-864532ff7261 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:49.228181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2e08f9cb-d5de-4a5f-bb99-864532ff7261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:49.239621 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1034/2056] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:49.243995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d339f-22ac-46a0-84f8-768794f84181 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:49.256287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d339f-22ac-46a0-84f8-768794f84181 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:49.261802 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f107065-cb44-466a-8619-44910dffc20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:49.262576 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f107065-cb44-466a-8619-44910dffc20c admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:49.263340 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f107065-cb44-466a-8619-44910dffc20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:49.263340 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f107065-cb44-466a-8619-44910dffc20c admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:49.263958 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f107065-cb44-466a-8619-44910dffc20c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:09:49.264217 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f107065-cb44-466a-8619-44910dffc20c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:49.266189 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f107065-cb44-466a-8619-44910dffc20c admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:49.280017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1023/2057] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:09:49.284484 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08f9cb-d5de-4a5f-bb99-864532ff7261 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:49.297047 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08f9cb-d5de-4a5f-bb99-864532ff7261 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:49.301960 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed58383-aba3-4b3a-a984-b75425c6aa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:49.302663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed58383-aba3-4b3a-a984-b75425c6aa63 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:49.302950 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed58383-aba3-4b3a-a984-b75425c6aa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:49.303227 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed58383-aba3-4b3a-a984-b75425c6aa63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:49.303915 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed58383-aba3-4b3a-a984-b75425c6aa63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:49.305811 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed58383-aba3-4b3a-a984-b75425c6aa63 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:49.335559 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1035/2058] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:49 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:49.337132 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f107065-cb44-466a-8619-44910dffc20c admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:49.347963 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f107065-cb44-466a-8619-44910dffc20c admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:49.406719 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192acd7-a9dd-4f44-8e96-7e5c996334f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:49.407417 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192acd7-a9dd-4f44-8e96-7e5c996334f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:49.407710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192acd7-a9dd-4f44-8e96-7e5c996334f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:49.407988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192acd7-a9dd-4f44-8e96-7e5c996334f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:49.408685 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192acd7-a9dd-4f44-8e96-7e5c996334f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:49.410719 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192acd7-a9dd-4f44-8e96-7e5c996334f1 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:49.434642 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1024/2059] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:49 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:49.436807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed58383-aba3-4b3a-a984-b75425c6aa63 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:49.449435 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed58383-aba3-4b3a-a984-b75425c6aa63 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:49.455085 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456dd5a-a3e1-4568-8a6d-ceb1fa12ea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:49.455867 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456dd5a-a3e1-4568-8a6d-ceb1fa12ea39 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:49.456176 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456dd5a-a3e1-4568-8a6d-ceb1fa12ea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:49.456573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456dd5a-a3e1-4568-8a6d-ceb1fa12ea39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:49.457537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456dd5a-a3e1-4568-8a6d-ceb1fa12ea39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:49.459188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456dd5a-a3e1-4568-8a6d-ceb1fa12ea39 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:49.470129 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1036/2060] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:49.474321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192acd7-a9dd-4f44-8e96-7e5c996334f1 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:49.484962 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192acd7-a9dd-4f44-8e96-7e5c996334f1 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:49.491025 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd0121-8359-4da1-9ca3-4b893f9d6d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:49.491791 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd0121-8359-4da1-9ca3-4b893f9d6d2b admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:49.492108 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd0121-8359-4da1-9ca3-4b893f9d6d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:49.492387 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd0121-8359-4da1-9ca3-4b893f9d6d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:49.493128 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd0121-8359-4da1-9ca3-4b893f9d6d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:49.495002 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd0121-8359-4da1-9ca3-4b893f9d6d2b admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:49.507715 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1025/2061] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:49.512313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456dd5a-a3e1-4568-8a6d-ceb1fa12ea39 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:49.522549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456dd5a-a3e1-4568-8a6d-ceb1fa12ea39 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:49.527021 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1d541-0489-4f80-a70f-4108318812fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:49.527892 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1d541-0489-4f80-a70f-4108318812fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:49.528175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1d541-0489-4f80-a70f-4108318812fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:49.528449 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1d541-0489-4f80-a70f-4108318812fe admin admin] PATH_INFO: `/v3/projects/3513dd87bbf243c8ae4d6090dbf7bd84/users/2c19c490070a405ab2f48336c5b842df/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:49.543885 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1d541-0489-4f80-a70f-4108318812fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3513dd87bbf243c8ae4d6090dbf7bd84, user_id=2c19c490070a405ab2f48336c5b842df, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:49.547099 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1d541-0489-4f80-a70f-4108318812fe admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:49.559756 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1037/2062] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:49 2022] PUT /identity/v3/projects/3513dd87bbf243c8ae4d6090dbf7bd84/users/2c19c490070a405ab2f48336c5b842df/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:09:49.565453 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158d5c1-63ea-49d5-a208-5d8037ef0ed9 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:49.565782 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158d5c1-63ea-49d5-a208-5d8037ef0ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:49.566064 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158d5c1-63ea-49d5-a208-5d8037ef0ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:49.584783 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-6158d5c1-63ea-49d5-a208-5d8037ef0ed9 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:49.586080 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-6158d5c1-63ea-49d5-a208-5d8037ef0ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:49.596520 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:49.647117 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1026/2063] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:49.657133 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1d541-0489-4f80-a70f-4108318812fe admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:49.658849 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a2f1d541-0489-4f80-a70f-4108318812fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:49.685647 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:49.720166 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1d541-0489-4f80-a70f-4108318812fe admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:49.724118 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cb3ce-c2c0-4be4-bc89-ce9e7c39a357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:49.724810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cb3ce-c2c0-4be4-bc89-ce9e7c39a357 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:49.725082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cb3ce-c2c0-4be4-bc89-ce9e7c39a357 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:49.725393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cb3ce-c2c0-4be4-bc89-ce9e7c39a357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:49.736002 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748cb3ce-c2c0-4be4-bc89-ce9e7c39a357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:49.738069 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748cb3ce-c2c0-4be4-bc89-ce9e7c39a357 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:49.748115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158d5c1-63ea-49d5-a208-5d8037ef0ed9 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:49.749511 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-6158d5c1-63ea-49d5-a208-5d8037ef0ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:49.751980 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1038/2064] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:49.761715 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158d5c1-63ea-49d5-a208-5d8037ef0ed9 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:49.766379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938c5a6-ce1c-41db-8384-bc0a0cd51980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:49.767557 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938c5a6-ce1c-41db-8384-bc0a0cd51980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:49.767557 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938c5a6-ce1c-41db-8384-bc0a0cd51980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:49.767832 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938c5a6-ce1c-41db-8384-bc0a0cd51980 admin admin] PATH_INFO: `/v3/users/c8a7201fb47c40eba1218a69314e6809` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:49.769075 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938c5a6-ce1c-41db-8384-bc0a0cd51980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8a7201fb47c40eba1218a69314e6809)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:49.771068 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938c5a6-ce1c-41db-8384-bc0a0cd51980 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:49.825876 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e938c5a6-ce1c-41db-8384-bc0a0cd51980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8a7201fb47c40eba1218a69314e6809'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:49.836911 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e938c5a6-ce1c-41db-8384-bc0a0cd51980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8a7201fb47c40eba1218a69314e6809'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:49.837846 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e938c5a6-ce1c-41db-8384-bc0a0cd51980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8a7201fb47c40eba1218a69314e6809'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:49.854294 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e938c5a6-ce1c-41db-8384-bc0a0cd51980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8a7201fb47c40eba1218a69314e6809'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:49.855187 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e938c5a6-ce1c-41db-8384-bc0a0cd51980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8a7201fb47c40eba1218a69314e6809'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:49.872681 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1027/2065] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:49 2022] DELETE /identity/v3/users/c8a7201fb47c40eba1218a69314e6809 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:09:49.877389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222f3cd-1335-4802-bfe2-482fcfa4ff14 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:49.877921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222f3cd-1335-4802-bfe2-482fcfa4ff14 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:49.878242 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222f3cd-1335-4802-bfe2-482fcfa4ff14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:49.897188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f222f3cd-1335-4802-bfe2-482fcfa4ff14 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:49.898455 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f222f3cd-1335-4802-bfe2-482fcfa4ff14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:49.975298 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1039/2066] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:49.985726 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938c5a6-ce1c-41db-8384-bc0a0cd51980 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:49.987345 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e938c5a6-ce1c-41db-8384-bc0a0cd51980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:50.066712 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938c5a6-ce1c-41db-8384-bc0a0cd51980 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:50.070617 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a6dcc-dcb5-45f4-8961-a1dbc156ab88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:50.071341 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a6dcc-dcb5-45f4-8961-a1dbc156ab88 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:50.071716 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a6dcc-dcb5-45f4-8961-a1dbc156ab88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:50.072058 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a6dcc-dcb5-45f4-8961-a1dbc156ab88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:50.085895 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a6dcc-dcb5-45f4-8961-a1dbc156ab88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:50.087468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a6dcc-dcb5-45f4-8961-a1dbc156ab88 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:50.103081 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1028/2067] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:50.378861 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222f3cd-1335-4802-bfe2-482fcfa4ff14 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:50.380517 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f222f3cd-1335-4802-bfe2-482fcfa4ff14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:50.395321 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222f3cd-1335-4802-bfe2-482fcfa4ff14 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:50.400828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7ec9b-0a7b-42da-9185-b60d38fc83e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:50.402105 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7ec9b-0a7b-42da-9185-b60d38fc83e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:50.402596 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7ec9b-0a7b-42da-9185-b60d38fc83e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:50.402930 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7ec9b-0a7b-42da-9185-b60d38fc83e4 admin admin] PATH_INFO: `/v3/users/31f2b56b68464450bff5b6e68ab1bfb4` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:50.404260 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7ec9b-0a7b-42da-9185-b60d38fc83e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31f2b56b68464450bff5b6e68ab1bfb4)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:50.406204 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7ec9b-0a7b-42da-9185-b60d38fc83e4 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:50.506564 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b1e7ec9b-0a7b-42da-9185-b60d38fc83e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31f2b56b68464450bff5b6e68ab1bfb4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:50.525187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b1e7ec9b-0a7b-42da-9185-b60d38fc83e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31f2b56b68464450bff5b6e68ab1bfb4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:50.536918 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b1e7ec9b-0a7b-42da-9185-b60d38fc83e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31f2b56b68464450bff5b6e68ab1bfb4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:50.572478 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b1e7ec9b-0a7b-42da-9185-b60d38fc83e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31f2b56b68464450bff5b6e68ab1bfb4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:50.573723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b1e7ec9b-0a7b-42da-9185-b60d38fc83e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31f2b56b68464450bff5b6e68ab1bfb4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:50.591022 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1040/2068] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:50 2022] DELETE /identity/v3/users/31f2b56b68464450bff5b6e68ab1bfb4 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:50.595964 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a206e6a-6099-4f65-8fe2-137f6d584594 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:50.596482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a206e6a-6099-4f65-8fe2-137f6d584594 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:50.596482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a206e6a-6099-4f65-8fe2-137f6d584594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:50.623494 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-5a206e6a-6099-4f65-8fe2-137f6d584594 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:50.624741 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5a206e6a-6099-4f65-8fe2-137f6d584594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:50.672003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:50.678795 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7ec9b-0a7b-42da-9185-b60d38fc83e4 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:50.681226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b1e7ec9b-0a7b-42da-9185-b60d38fc83e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:50.749884 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1029/2069] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:09:50.757460 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a206e6a-6099-4f65-8fe2-137f6d584594 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:50.759534 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5a206e6a-6099-4f65-8fe2-137f6d584594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:50.782081 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:50.810900 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7ec9b-0a7b-42da-9185-b60d38fc83e4 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:50.816468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e19b9-6512-456a-a2b7-21a0c896217b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:50.817348 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e19b9-6512-456a-a2b7-21a0c896217b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:50.817636 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e19b9-6512-456a-a2b7-21a0c896217b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:50.817920 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e19b9-6512-456a-a2b7-21a0c896217b admin admin] PATH_INFO: `/v3/projects/041abbbe2ce54c8fa7c3d100c8d0e180` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:50.819162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e19b9-6512-456a-a2b7-21a0c896217b admin admin] RBAC: Authorizing `identity:delete_project(project_id=041abbbe2ce54c8fa7c3d100c8d0e180)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:50.821114 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e19b9-6512-456a-a2b7-21a0c896217b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:50.855174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a206e6a-6099-4f65-8fe2-137f6d584594 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:50.860583 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500509c1-3ef0-4bd5-bcd5-12495275b994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:50.861493 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500509c1-3ef0-4bd5-bcd5-12495275b994 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:50.861855 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500509c1-3ef0-4bd5-bcd5-12495275b994 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:50.862414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500509c1-3ef0-4bd5-bcd5-12495275b994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:50.874558 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500509c1-3ef0-4bd5-bcd5-12495275b994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:50.876029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500509c1-3ef0-4bd5-bcd5-12495275b994 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:50.882338 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-961e19b9-6512-456a-a2b7-21a0c896217b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '041abbbe2ce54c8fa7c3d100c8d0e180', 'request_id': 'req-961e19b9-6512-456a-a2b7-21a0c896217b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:50.887097 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1030/2070] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:50.889497 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-961e19b9-6512-456a-a2b7-21a0c896217b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '041abbbe2ce54c8fa7c3d100c8d0e180', 'request_id': 'req-961e19b9-6512-456a-a2b7-21a0c896217b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:50.895618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-961e19b9-6512-456a-a2b7-21a0c896217b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '041abbbe2ce54c8fa7c3d100c8d0e180', 'request_id': 'req-961e19b9-6512-456a-a2b7-21a0c896217b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:50.915769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-961e19b9-6512-456a-a2b7-21a0c896217b admin admin] The token cache is being invalidate because project 041abbbe2ce54c8fa7c3d100c8d0e180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:50.916164 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-961e19b9-6512-456a-a2b7-21a0c896217b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:50.917511 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-961e19b9-6512-456a-a2b7-21a0c896217b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:50.921808 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1041/2071] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:50 2022] DELETE /identity/v3/projects/041abbbe2ce54c8fa7c3d100c8d0e180 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:50.925682 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500509c1-3ef0-4bd5-bcd5-12495275b994 service neutron] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:50.944647 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500509c1-3ef0-4bd5-bcd5-12495275b994 service neutron] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:51.030884 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a26f09-85f0-4d43-9409-e80214d7f35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:51.032001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a26f09-85f0-4d43-9409-e80214d7f35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:51.032421 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a26f09-85f0-4d43-9409-e80214d7f35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:51.032713 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a26f09-85f0-4d43-9409-e80214d7f35d admin admin] PATH_INFO: `/v3/users/2dbec06a920548df9c10a3a3c873b0b2` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:51.034005 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a26f09-85f0-4d43-9409-e80214d7f35d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dbec06a920548df9c10a3a3c873b0b2)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:51.036080 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a26f09-85f0-4d43-9409-e80214d7f35d admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:51.117748 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-52a26f09-85f0-4d43-9409-e80214d7f35d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dbec06a920548df9c10a3a3c873b0b2'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:51.127888 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-52a26f09-85f0-4d43-9409-e80214d7f35d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dbec06a920548df9c10a3a3c873b0b2'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:51.128894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-52a26f09-85f0-4d43-9409-e80214d7f35d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dbec06a920548df9c10a3a3c873b0b2'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:51.147401 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-52a26f09-85f0-4d43-9409-e80214d7f35d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dbec06a920548df9c10a3a3c873b0b2'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:51.148270 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-52a26f09-85f0-4d43-9409-e80214d7f35d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dbec06a920548df9c10a3a3c873b0b2'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:51.153272 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:51.171276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1031/2072] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:50 2022] DELETE /identity/v3/users/2dbec06a920548df9c10a3a3c873b0b2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:51.420014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e19b9-6512-456a-a2b7-21a0c896217b admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:51.422957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-961e19b9-6512-456a-a2b7-21a0c896217b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:51.452143 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e19b9-6512-456a-a2b7-21a0c896217b admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:51.525957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a26f09-85f0-4d43-9409-e80214d7f35d admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:51.529791 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-52a26f09-85f0-4d43-9409-e80214d7f35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:51.613814 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebf5da-eac5-48b8-aa0a-7e534dcf5cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:51.614933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebf5da-eac5-48b8-aa0a-7e534dcf5cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:51.615291 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebf5da-eac5-48b8-aa0a-7e534dcf5cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:51.615642 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebf5da-eac5-48b8-aa0a-7e534dcf5cc2 admin admin] PATH_INFO: `/v3/projects/2fa89bb4530647a3a87c3f92c421df62` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:51.617008 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ebf5da-eac5-48b8-aa0a-7e534dcf5cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fa89bb4530647a3a87c3f92c421df62)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:51.619124 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ebf5da-eac5-48b8-aa0a-7e534dcf5cc2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:51.666521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a26f09-85f0-4d43-9409-e80214d7f35d admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:51.676145 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe207f4a-639f-46ee-a45b-78ff6467c35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:51.677029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe207f4a-639f-46ee-a45b-78ff6467c35b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:51.677317 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe207f4a-639f-46ee-a45b-78ff6467c35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:51.677602 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe207f4a-639f-46ee-a45b-78ff6467c35b admin admin] PATH_INFO: `/v3/projects/c3bc3a15294b4a4ca338f12ab9aaeee0` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:51.678980 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe207f4a-639f-46ee-a45b-78ff6467c35b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3bc3a15294b4a4ca338f12ab9aaeee0)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:51.681897 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe207f4a-639f-46ee-a45b-78ff6467c35b admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:51.694686 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-87ebf5da-eac5-48b8-aa0a-7e534dcf5cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fa89bb4530647a3a87c3f92c421df62', 'request_id': 'req-87ebf5da-eac5-48b8-aa0a-7e534dcf5cc2'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:51.706521 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-87ebf5da-eac5-48b8-aa0a-7e534dcf5cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fa89bb4530647a3a87c3f92c421df62', 'request_id': 'req-87ebf5da-eac5-48b8-aa0a-7e534dcf5cc2'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:51.718335 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-87ebf5da-eac5-48b8-aa0a-7e534dcf5cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fa89bb4530647a3a87c3f92c421df62', 'request_id': 'req-87ebf5da-eac5-48b8-aa0a-7e534dcf5cc2'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:51.734461 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:51.737063 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-87ebf5da-eac5-48b8-aa0a-7e534dcf5cc2 admin admin] The token cache is being invalidate because project 2fa89bb4530647a3a87c3f92c421df62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:51.737351 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-87ebf5da-eac5-48b8-aa0a-7e534dcf5cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:51.738018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-87ebf5da-eac5-48b8-aa0a-7e534dcf5cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:51.740350 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1042/2073] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:51 2022] DELETE /identity/v3/projects/2fa89bb4530647a3a87c3f92c421df62 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:51.744770 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebf5da-eac5-48b8-aa0a-7e534dcf5cc2 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:51.747302 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-87ebf5da-eac5-48b8-aa0a-7e534dcf5cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:51.771826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-fe207f4a-639f-46ee-a45b-78ff6467c35b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3bc3a15294b4a4ca338f12ab9aaeee0', 'request_id': 'req-fe207f4a-639f-46ee-a45b-78ff6467c35b'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:51.813744 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-fe207f4a-639f-46ee-a45b-78ff6467c35b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3bc3a15294b4a4ca338f12ab9aaeee0', 'request_id': 'req-fe207f4a-639f-46ee-a45b-78ff6467c35b'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:51.831108 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-fe207f4a-639f-46ee-a45b-78ff6467c35b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3bc3a15294b4a4ca338f12ab9aaeee0', 'request_id': 'req-fe207f4a-639f-46ee-a45b-78ff6467c35b'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:51.877073 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-fe207f4a-639f-46ee-a45b-78ff6467c35b admin admin] The token cache is being invalidate because project c3bc3a15294b4a4ca338f12ab9aaeee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:51.877073 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-fe207f4a-639f-46ee-a45b-78ff6467c35b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:51.878004 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-fe207f4a-639f-46ee-a45b-78ff6467c35b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:51.880960 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1032/2074] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:51 2022] DELETE /identity/v3/projects/c3bc3a15294b4a4ca338f12ab9aaeee0 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:09:51.888625 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855acaf8-dbc6-4a23-a9b5-4a2372d086ca None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:51.890328 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855acaf8-dbc6-4a23-a9b5-4a2372d086ca None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:51.892655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855acaf8-dbc6-4a23-a9b5-4a2372d086ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:51.928499 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-855acaf8-dbc6-4a23-a9b5-4a2372d086ca None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:51.929766 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebf5da-eac5-48b8-aa0a-7e534dcf5cc2 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:51.930329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-855acaf8-dbc6-4a23-a9b5-4a2372d086ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:52.056269 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a08fb1-b31c-4583-b582-826450f8fbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:52.057171 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a08fb1-b31c-4583-b582-826450f8fbe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:52.057728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a08fb1-b31c-4583-b582-826450f8fbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:52.057728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a08fb1-b31c-4583-b582-826450f8fbe1 admin admin] PATH_INFO: `/v3/users/77e6cdbb4b294a449454bb9f09852000` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:52.059015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a08fb1-b31c-4583-b582-826450f8fbe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77e6cdbb4b294a449454bb9f09852000)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:52.061497 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a08fb1-b31c-4583-b582-826450f8fbe1 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:52.067133 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1033/2075] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:52.082591 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173b92c-0c13-4236-817f-91c04752b409 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:52.085253 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173b92c-0c13-4236-817f-91c04752b409 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:52.085253 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173b92c-0c13-4236-817f-91c04752b409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:52.104515 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-a173b92c-0c13-4236-817f-91c04752b409 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:52.106202 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a173b92c-0c13-4236-817f-91c04752b409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:52.131233 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1034/2076] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:52.131233 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173b92c-0c13-4236-817f-91c04752b409 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:52.131877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173b92c-0c13-4236-817f-91c04752b409 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:52.138759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeabaa6-c907-4c1b-b3f3-7a05a086df22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:52.139616 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeabaa6-c907-4c1b-b3f3-7a05a086df22 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:52.139764 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeabaa6-c907-4c1b-b3f3-7a05a086df22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:52.140019 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeabaa6-c907-4c1b-b3f3-7a05a086df22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:52.140841 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeabaa6-c907-4c1b-b3f3-7a05a086df22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:09:52.141430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeabaa6-c907-4c1b-b3f3-7a05a086df22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:52.143229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeabaa6-c907-4c1b-b3f3-7a05a086df22 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:52.162326 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1035/2077] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:09:52.166727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeabaa6-c907-4c1b-b3f3-7a05a086df22 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:52.173099 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:52.185831 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeabaa6-c907-4c1b-b3f3-7a05a086df22 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:52.191359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-97a08fb1-b31c-4583-b582-826450f8fbe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77e6cdbb4b294a449454bb9f09852000'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:52.194263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1836eb3-460d-423e-be7c-1c80966cee49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:52.195270 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1836eb3-460d-423e-be7c-1c80966cee49 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:52.195975 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1836eb3-460d-423e-be7c-1c80966cee49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:52.196426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1836eb3-460d-423e-be7c-1c80966cee49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:52.197428 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1836eb3-460d-423e-be7c-1c80966cee49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:52.200441 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1836eb3-460d-423e-be7c-1c80966cee49 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:52.204538 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-97a08fb1-b31c-4583-b582-826450f8fbe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77e6cdbb4b294a449454bb9f09852000'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:52.220089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-97a08fb1-b31c-4583-b582-826450f8fbe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77e6cdbb4b294a449454bb9f09852000'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:52.238016 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-97a08fb1-b31c-4583-b582-826450f8fbe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77e6cdbb4b294a449454bb9f09852000'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:52.239500 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-97a08fb1-b31c-4583-b582-826450f8fbe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77e6cdbb4b294a449454bb9f09852000'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:52.250629 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1036/2078] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:52 2022] POST /identity/v3/projects => generated 367 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:09:52.250844 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1043/2079] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:51 2022] DELETE /identity/v3/users/77e6cdbb4b294a449454bb9f09852000 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:09:52.252089 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1836eb3-460d-423e-be7c-1c80966cee49 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:52.255440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b1836eb3-460d-423e-be7c-1c80966cee49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:52.374084 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1836eb3-460d-423e-be7c-1c80966cee49 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:52.472561 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd350b-6fd3-4208-bfdc-e4ba9b80fd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:52.474930 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd350b-6fd3-4208-bfdc-e4ba9b80fd30 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:52.475236 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd350b-6fd3-4208-bfdc-e4ba9b80fd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:52.475518 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd350b-6fd3-4208-bfdc-e4ba9b80fd30 admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:52.476259 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd350b-6fd3-4208-bfdc-e4ba9b80fd30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:52.480643 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd350b-6fd3-4208-bfdc-e4ba9b80fd30 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:52.530854 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1037/2080] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:52 2022] POST /identity/v3/users => generated 284 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:09:52.536580 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a08fb1-b31c-4583-b582-826450f8fbe1 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:52.555658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a08fb1-b31c-4583-b582-826450f8fbe1 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:52.564103 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593990c0-89cd-4b24-b183-c6ef507639b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:52.565112 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593990c0-89cd-4b24-b183-c6ef507639b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:52.565404 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593990c0-89cd-4b24-b183-c6ef507639b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:52.565728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593990c0-89cd-4b24-b183-c6ef507639b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:52.566564 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593990c0-89cd-4b24-b183-c6ef507639b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:52.583167 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593990c0-89cd-4b24-b183-c6ef507639b8 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:52.596191 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1044/2081] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:09:52.600475 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd350b-6fd3-4208-bfdc-e4ba9b80fd30 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:52.626983 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd350b-6fd3-4208-bfdc-e4ba9b80fd30 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:52.638453 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df88ab-e534-438b-9f74-8c34ab88cebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:52.639670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df88ab-e534-438b-9f74-8c34ab88cebb admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:52.640749 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df88ab-e534-438b-9f74-8c34ab88cebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:52.641264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df88ab-e534-438b-9f74-8c34ab88cebb admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:52.642394 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df88ab-e534-438b-9f74-8c34ab88cebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:52.644433 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df88ab-e534-438b-9f74-8c34ab88cebb admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:52.659108 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1038/2082] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:52.663665 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593990c0-89cd-4b24-b183-c6ef507639b8 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:52.680998 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593990c0-89cd-4b24-b183-c6ef507639b8 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:52.687856 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d91ff-9847-4c9a-8088-ecb1817d5d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:52.689238 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d91ff-9847-4c9a-8088-ecb1817d5d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:52.689597 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d91ff-9847-4c9a-8088-ecb1817d5d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:52.689985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d91ff-9847-4c9a-8088-ecb1817d5d35 admin admin] PATH_INFO: `/v3/projects/339c23fb856b49878b6ffbe467a87220/users/bf3e8ee5f8ff41118d4bd885f73d85c4/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:52.707047 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:52.715431 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d91ff-9847-4c9a-8088-ecb1817d5d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=339c23fb856b49878b6ffbe467a87220, user_id=bf3e8ee5f8ff41118d4bd885f73d85c4, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:52.717196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df88ab-e534-438b-9f74-8c34ab88cebb admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:52.720219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-13df88ab-e534-438b-9f74-8c34ab88cebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:52.726764 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d91ff-9847-4c9a-8088-ecb1817d5d35 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:52.754133 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1045/2083] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:52 2022] PUT /identity/v3/projects/339c23fb856b49878b6ffbe467a87220/users/bf3e8ee5f8ff41118d4bd885f73d85c4/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:52.765542 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7004073-3864-483a-b117-cbbdc7ba1b3f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:52.765875 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7004073-3864-483a-b117-cbbdc7ba1b3f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:52.766113 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7004073-3864-483a-b117-cbbdc7ba1b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:52.768381 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df88ab-e534-438b-9f74-8c34ab88cebb admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:52.815335 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-d7004073-3864-483a-b117-cbbdc7ba1b3f None None] MFA Rules not processed for user `bf3e8ee5f8ff41118d4bd885f73d85c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:52.817115 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d7004073-3864-483a-b117-cbbdc7ba1b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:52.869530 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfef33c-2101-4d0d-819a-0a4b85a41fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:52.871134 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfef33c-2101-4d0d-819a-0a4b85a41fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:52.871524 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfef33c-2101-4d0d-819a-0a4b85a41fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:52.871904 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfef33c-2101-4d0d-819a-0a4b85a41fda admin admin] PATH_INFO: `/v3/projects/4cb9353f809a46ec9a7990c960cc284a` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:52.875146 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfef33c-2101-4d0d-819a-0a4b85a41fda admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cb9353f809a46ec9a7990c960cc284a)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:52.877873 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfef33c-2101-4d0d-819a-0a4b85a41fda admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:52.890591 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:52.916317 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1046/2084] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:52.937436 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7004073-3864-483a-b117-cbbdc7ba1b3f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:52.941390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d7004073-3864-483a-b117-cbbdc7ba1b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:52.953154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-dbfef33c-2101-4d0d-819a-0a4b85a41fda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cb9353f809a46ec9a7990c960cc284a', 'request_id': 'req-dbfef33c-2101-4d0d-819a-0a4b85a41fda'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:52.962447 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-dbfef33c-2101-4d0d-819a-0a4b85a41fda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cb9353f809a46ec9a7990c960cc284a', 'request_id': 'req-dbfef33c-2101-4d0d-819a-0a4b85a41fda'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:52.972354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-dbfef33c-2101-4d0d-819a-0a4b85a41fda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cb9353f809a46ec9a7990c960cc284a', 'request_id': 'req-dbfef33c-2101-4d0d-819a-0a4b85a41fda'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:52.992861 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-dbfef33c-2101-4d0d-819a-0a4b85a41fda admin admin] The token cache is being invalidate because project 4cb9353f809a46ec9a7990c960cc284a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:52.993252 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-dbfef33c-2101-4d0d-819a-0a4b85a41fda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:52.994074 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-dbfef33c-2101-4d0d-819a-0a4b85a41fda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:53.001520 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1039/2085] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:52 2022] DELETE /identity/v3/projects/4cb9353f809a46ec9a7990c960cc284a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:53.002645 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfef33c-2101-4d0d-819a-0a4b85a41fda admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:53.004261 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-dbfef33c-2101-4d0d-819a-0a4b85a41fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:53.109423 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfef33c-2101-4d0d-819a-0a4b85a41fda admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:53.115595 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ebccf-cf52-4067-b910-60dd495925de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:53.117030 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ebccf-cf52-4067-b910-60dd495925de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:53.117474 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ebccf-cf52-4067-b910-60dd495925de admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:53.117909 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ebccf-cf52-4067-b910-60dd495925de admin admin] PATH_INFO: `/v3/users/a9c934bd3ed14e8e92bbd4dfe8c4f76c` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:53.119792 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ebccf-cf52-4067-b910-60dd495925de admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9c934bd3ed14e8e92bbd4dfe8c4f76c)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:53.120169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7004073-3864-483a-b117-cbbdc7ba1b3f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:53.122856 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ebccf-cf52-4067-b910-60dd495925de admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:53.198660 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd241a5b-206c-42b7-bf11-a30234eb4480 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6921990ec98492f8f4420f911208b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:53.199366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd241a5b-206c-42b7-bf11-a30234eb4480 service glance] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:53.199756 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd241a5b-206c-42b7-bf11-a30234eb4480 service glance] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:53.200038 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd241a5b-206c-42b7-bf11-a30234eb4480 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:53.204895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-dd241a5b-206c-42b7-bf11-a30234eb4480 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:53.230132 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2e4ebccf-cf52-4067-b910-60dd495925de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9c934bd3ed14e8e92bbd4dfe8c4f76c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:53.246248 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2e4ebccf-cf52-4067-b910-60dd495925de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9c934bd3ed14e8e92bbd4dfe8c4f76c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:53.248588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2e4ebccf-cf52-4067-b910-60dd495925de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9c934bd3ed14e8e92bbd4dfe8c4f76c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:53.250334 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:53.273063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2e4ebccf-cf52-4067-b910-60dd495925de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9c934bd3ed14e8e92bbd4dfe8c4f76c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:53.274699 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2e4ebccf-cf52-4067-b910-60dd495925de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9c934bd3ed14e8e92bbd4dfe8c4f76c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:53.297487 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1040/2086] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:53 2022] DELETE /identity/v3/users/a9c934bd3ed14e8e92bbd4dfe8c4f76c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:53.310835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd241a5b-206c-42b7-bf11-a30234eb4480 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:53.312420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd241a5b-206c-42b7-bf11-a30234eb4480 service glance] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:53.325474 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1047/2087] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:54.006233 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ebccf-cf52-4067-b910-60dd495925de admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:54.008306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-2e4ebccf-cf52-4067-b910-60dd495925de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:54.051202 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:54.119726 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ebccf-cf52-4067-b910-60dd495925de admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:54.131213 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de0d75-a7c0-41e8-8b7e-5aad9c5f148d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:54.132418 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de0d75-a7c0-41e8-8b7e-5aad9c5f148d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:54.133708 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de0d75-a7c0-41e8-8b7e-5aad9c5f148d admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:54.134980 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de0d75-a7c0-41e8-8b7e-5aad9c5f148d admin admin] PATH_INFO: `/v3/projects/e8b5929936e4420ab8a047527bf2b46e` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:54.139170 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de0d75-a7c0-41e8-8b7e-5aad9c5f148d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8b5929936e4420ab8a047527bf2b46e)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:54.147175 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de0d75-a7c0-41e8-8b7e-5aad9c5f148d admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:54.212134 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd241a5b-206c-42b7-bf11-a30234eb4480 service glance] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:54.215413 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-dd241a5b-206c-42b7-bf11-a30234eb4480 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:54.233185 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd241a5b-206c-42b7-bf11-a30234eb4480 service glance] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:54.258768 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-98de0d75-a7c0-41e8-8b7e-5aad9c5f148d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8b5929936e4420ab8a047527bf2b46e', 'request_id': 'req-98de0d75-a7c0-41e8-8b7e-5aad9c5f148d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:54.271398 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-98de0d75-a7c0-41e8-8b7e-5aad9c5f148d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8b5929936e4420ab8a047527bf2b46e', 'request_id': 'req-98de0d75-a7c0-41e8-8b7e-5aad9c5f148d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:54.282168 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-98de0d75-a7c0-41e8-8b7e-5aad9c5f148d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8b5929936e4420ab8a047527bf2b46e', 'request_id': 'req-98de0d75-a7c0-41e8-8b7e-5aad9c5f148d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:54.301671 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-98de0d75-a7c0-41e8-8b7e-5aad9c5f148d admin admin] The token cache is being invalidate because project e8b5929936e4420ab8a047527bf2b46e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:54.302251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-98de0d75-a7c0-41e8-8b7e-5aad9c5f148d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:54.303159 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-98de0d75-a7c0-41e8-8b7e-5aad9c5f148d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:54.308492 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1041/2088] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:54 2022] DELETE /identity/v3/projects/e8b5929936e4420ab8a047527bf2b46e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:54.311219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd7b2c-c0ec-44b3-becb-e88dae3e1145 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:54.311541 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd7b2c-c0ec-44b3-becb-e88dae3e1145 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:54.311886 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd7b2c-c0ec-44b3-becb-e88dae3e1145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:54.333967 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-eafd7b2c-c0ec-44b3-becb-e88dae3e1145 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:54.335323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-eafd7b2c-c0ec-44b3-becb-e88dae3e1145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:54.339605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1efda3-ac28-4a7b-9020-3964d8b1be82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:54.340982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1efda3-ac28-4a7b-9020-3964d8b1be82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:54.341549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1efda3-ac28-4a7b-9020-3964d8b1be82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:54.341984 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1efda3-ac28-4a7b-9020-3964d8b1be82 admin admin] PATH_INFO: `/v3/users/81e656362ec047df992b32f1533f1741` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:54.343578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1efda3-ac28-4a7b-9020-3964d8b1be82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81e656362ec047df992b32f1533f1741)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:54.345861 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1efda3-ac28-4a7b-9020-3964d8b1be82 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:54.346264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1042/2089] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:09:54.354459 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d506fcd-5b24-41cd-b88a-2533b529533d None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:54.354773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d506fcd-5b24-41cd-b88a-2533b529533d None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:54.355094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d506fcd-5b24-41cd-b88a-2533b529533d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:54.374734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-4d506fcd-5b24-41cd-b88a-2533b529533d None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:54.376013 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-4d506fcd-5b24-41cd-b88a-2533b529533d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:54.387727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1043/2090] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:09:54.393081 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d506fcd-5b24-41cd-b88a-2533b529533d None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:54.404725 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d506fcd-5b24-41cd-b88a-2533b529533d None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:54.410832 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b34ae-15db-48f3-b5d6-9a2ef9be42f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:54.411302 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b34ae-15db-48f3-b5d6-9a2ef9be42f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:54.411587 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b34ae-15db-48f3-b5d6-9a2ef9be42f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:54.411863 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b34ae-15db-48f3-b5d6-9a2ef9be42f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:54.412591 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b34ae-15db-48f3-b5d6-9a2ef9be42f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:09:54.412901 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b34ae-15db-48f3-b5d6-9a2ef9be42f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:54.414549 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b34ae-15db-48f3-b5d6-9a2ef9be42f9 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:54.417172 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-dc1efda3-ac28-4a7b-9020-3964d8b1be82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81e656362ec047df992b32f1533f1741'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:54.429181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1044/2091] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:09:54.429499 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-dc1efda3-ac28-4a7b-9020-3964d8b1be82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81e656362ec047df992b32f1533f1741'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:54.433757 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b34ae-15db-48f3-b5d6-9a2ef9be42f9 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:54.441273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-dc1efda3-ac28-4a7b-9020-3964d8b1be82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81e656362ec047df992b32f1533f1741'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:54.444829 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b34ae-15db-48f3-b5d6-9a2ef9be42f9 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:54.471486 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84b055-6c5b-493f-9c11-eefd6620456c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:54.472424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84b055-6c5b-493f-9c11-eefd6620456c admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:54.472865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84b055-6c5b-493f-9c11-eefd6620456c admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:54.472997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84b055-6c5b-493f-9c11-eefd6620456c admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:54.473748 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84b055-6c5b-493f-9c11-eefd6620456c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:54.474203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-dc1efda3-ac28-4a7b-9020-3964d8b1be82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81e656362ec047df992b32f1533f1741'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:54.475297 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-dc1efda3-ac28-4a7b-9020-3964d8b1be82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81e656362ec047df992b32f1533f1741'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:54.477870 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84b055-6c5b-493f-9c11-eefd6620456c admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:54.484309 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1048/2092] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:54 2022] DELETE /identity/v3/users/81e656362ec047df992b32f1533f1741 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:09:54.491707 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c8519-9085-4a33-8d71-5c0d60c3ce5a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:54.492104 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c8519-9085-4a33-8d71-5c0d60c3ce5a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:54.492487 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c8519-9085-4a33-8d71-5c0d60c3ce5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:54.521936 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-d47c8519-9085-4a33-8d71-5c0d60c3ce5a None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:54.523736 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d47c8519-9085-4a33-8d71-5c0d60c3ce5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:54.555110 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1045/2093] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:54 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:09:54.556114 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84b055-6c5b-493f-9c11-eefd6620456c admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:54.558775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-0b84b055-6c5b-493f-9c11-eefd6620456c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:54.630379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:54.648466 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:54.653389 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84b055-6c5b-493f-9c11-eefd6620456c admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:54.682189 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663aef07-242e-4c6e-b739-694b0b2a074a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:54.683488 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663aef07-242e-4c6e-b739-694b0b2a074a admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:54.685851 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663aef07-242e-4c6e-b739-694b0b2a074a admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:54.686375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663aef07-242e-4c6e-b739-694b0b2a074a admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:54.687243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1049/2094] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:54.687584 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663aef07-242e-4c6e-b739-694b0b2a074a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:54.689758 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663aef07-242e-4c6e-b739-694b0b2a074a admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:54.699484 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c8519-9085-4a33-8d71-5c0d60c3ce5a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:54.703767 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d47c8519-9085-4a33-8d71-5c0d60c3ce5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:54.749216 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1046/2095] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:54 2022] POST /identity/v3/users => generated 291 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:54.751003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663aef07-242e-4c6e-b739-694b0b2a074a admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:54.783411 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663aef07-242e-4c6e-b739-694b0b2a074a admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:54.802051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695995f-0555-4482-9e82-4d89926e0f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:54.802778 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695995f-0555-4482-9e82-4d89926e0f3b admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:54.803073 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695995f-0555-4482-9e82-4d89926e0f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:54.803354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695995f-0555-4482-9e82-4d89926e0f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:54.804833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695995f-0555-4482-9e82-4d89926e0f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:54.812823 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695995f-0555-4482-9e82-4d89926e0f3b admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:54.842166 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1047/2096] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:54.843398 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695995f-0555-4482-9e82-4d89926e0f3b admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:54.872842 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695995f-0555-4482-9e82-4d89926e0f3b admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:54.886591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c8519-9085-4a33-8d71-5c0d60c3ce5a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:54.890048 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b59595-e8ea-4cb3-a49d-12b18fd5cf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:54.890911 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b59595-e8ea-4cb3-a49d-12b18fd5cf53 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:54.891591 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b59595-e8ea-4cb3-a49d-12b18fd5cf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:54.891591 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b59595-e8ea-4cb3-a49d-12b18fd5cf53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:54.892195 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b59595-e8ea-4cb3-a49d-12b18fd5cf53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:54.893849 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b59595-e8ea-4cb3-a49d-12b18fd5cf53 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:54.928710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1048/2097] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:54.930776 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b59595-e8ea-4cb3-a49d-12b18fd5cf53 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:54.954197 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b59595-e8ea-4cb3-a49d-12b18fd5cf53 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:54.966867 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114e380-4891-481a-8de6-ebc67ef9142c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:54.967797 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114e380-4891-481a-8de6-ebc67ef9142c admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:54.968083 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114e380-4891-481a-8de6-ebc67ef9142c admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:54.968373 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114e380-4891-481a-8de6-ebc67ef9142c admin admin] PATH_INFO: `/v3/projects/eb1ec6cdf3e444fabde6ef47e45b6a99/users/31cf6712c5ec4fc993640d5afcf3e6a4/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:55.018896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114e380-4891-481a-8de6-ebc67ef9142c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1ec6cdf3e444fabde6ef47e45b6a99, user_id=31cf6712c5ec4fc993640d5afcf3e6a4, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:55.021769 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114e380-4891-481a-8de6-ebc67ef9142c admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:55.034310 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e0eea-bddc-4dea-b25f-9d97b5d6bbbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:55.035058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e0eea-bddc-4dea-b25f-9d97b5d6bbbc service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:55.035351 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e0eea-bddc-4dea-b25f-9d97b5d6bbbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:55.035565 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e0eea-bddc-4dea-b25f-9d97b5d6bbbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:55.057720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1049/2098] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:54 2022] PUT /identity/v3/projects/eb1ec6cdf3e444fabde6ef47e45b6a99/users/31cf6712c5ec4fc993640d5afcf3e6a4/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:55.061157 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e0eea-bddc-4dea-b25f-9d97b5d6bbbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:55.063857 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c05abb-547d-467a-83c3-300df56e3d2a None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:55.064259 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c05abb-547d-467a-83c3-300df56e3d2a None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:55.064743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c05abb-547d-467a-83c3-300df56e3d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:55.068083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e0eea-bddc-4dea-b25f-9d97b5d6bbbc service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:55.081432 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1050/2099] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:09:55.102206 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-98c05abb-547d-467a-83c3-300df56e3d2a None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:55.115164 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-98c05abb-547d-467a-83c3-300df56e3d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:55.253395 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1050/2100] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:55.267323 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e0eea-bddc-4dea-b25f-9d97b5d6bbbc service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:55.279022 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e0eea-bddc-4dea-b25f-9d97b5d6bbbc service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:55.361565 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a55f1e-198c-4dd0-9c93-ce1d36df7c7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:55.362394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a55f1e-198c-4dd0-9c93-ce1d36df7c7c service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:55.362937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a55f1e-198c-4dd0-9c93-ce1d36df7c7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:55.363383 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a55f1e-198c-4dd0-9c93-ce1d36df7c7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:55.378589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a55f1e-198c-4dd0-9c93-ce1d36df7c7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:55.380052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a55f1e-198c-4dd0-9c93-ce1d36df7c7c service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:55.391293 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1051/2101] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:55.564372 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c05abb-547d-467a-83c3-300df56e3d2a None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:55.567320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-98c05abb-547d-467a-83c3-300df56e3d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:55.632226 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c05abb-547d-467a-83c3-300df56e3d2a None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:55.642782 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73725231-f306-4b87-bbc3-a13a475a333d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:55.643845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73725231-f306-4b87-bbc3-a13a475a333d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:55.644238 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73725231-f306-4b87-bbc3-a13a475a333d admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:55.644615 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73725231-f306-4b87-bbc3-a13a475a333d admin admin] PATH_INFO: `/v3/projects/4da49006c836483995ed1e860a95c398` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:55.646509 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73725231-f306-4b87-bbc3-a13a475a333d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4da49006c836483995ed1e860a95c398)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:55.652281 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73725231-f306-4b87-bbc3-a13a475a333d admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:55.720030 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-73725231-f306-4b87-bbc3-a13a475a333d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4da49006c836483995ed1e860a95c398', 'request_id': 'req-73725231-f306-4b87-bbc3-a13a475a333d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:55.735310 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-73725231-f306-4b87-bbc3-a13a475a333d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4da49006c836483995ed1e860a95c398', 'request_id': 'req-73725231-f306-4b87-bbc3-a13a475a333d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:55.753060 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-73725231-f306-4b87-bbc3-a13a475a333d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4da49006c836483995ed1e860a95c398', 'request_id': 'req-73725231-f306-4b87-bbc3-a13a475a333d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:55.781397 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-73725231-f306-4b87-bbc3-a13a475a333d admin admin] The token cache is being invalidate because project 4da49006c836483995ed1e860a95c398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:55.781397 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-73725231-f306-4b87-bbc3-a13a475a333d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:55.782810 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-73725231-f306-4b87-bbc3-a13a475a333d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:55.787802 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1051/2102] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:55 2022] DELETE /identity/v3/projects/4da49006c836483995ed1e860a95c398 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:55.788884 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a55f1e-198c-4dd0-9c93-ce1d36df7c7c service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:55.805213 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a55f1e-198c-4dd0-9c93-ce1d36df7c7c service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:55.911417 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32db93-a3de-4ae6-84a1-3a0112d37e51 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:55.911751 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32db93-a3de-4ae6-84a1-3a0112d37e51 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:55.911995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32db93-a3de-4ae6-84a1-3a0112d37e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:55.924686 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:55.934164 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a4d39-430c-4d39-92f2-ce3063ff7832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:55.935408 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a4d39-430c-4d39-92f2-ce3063ff7832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:55.936433 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a4d39-430c-4d39-92f2-ce3063ff7832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:55.936433 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a4d39-430c-4d39-92f2-ce3063ff7832 admin admin] PATH_INFO: `/v3/users/188607ed43a44590adf2ccebf3053fe9` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:55.938116 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a4d39-430c-4d39-92f2-ce3063ff7832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=188607ed43a44590adf2ccebf3053fe9)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:55.940791 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a4d39-430c-4d39-92f2-ce3063ff7832 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:55.965649 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-dd32db93-a3de-4ae6-84a1-3a0112d37e51 None None] MFA Rules not processed for user `2c19c490070a405ab2f48336c5b842df`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:55.967583 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-dd32db93-a3de-4ae6-84a1-3a0112d37e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:56.024804 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:56.067035 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-766a4d39-430c-4d39-92f2-ce3063ff7832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '188607ed43a44590adf2ccebf3053fe9'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:56.079408 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-766a4d39-430c-4d39-92f2-ce3063ff7832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '188607ed43a44590adf2ccebf3053fe9'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:56.091911 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-766a4d39-430c-4d39-92f2-ce3063ff7832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '188607ed43a44590adf2ccebf3053fe9'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:56.115129 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-766a4d39-430c-4d39-92f2-ce3063ff7832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '188607ed43a44590adf2ccebf3053fe9'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:56.116296 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-766a4d39-430c-4d39-92f2-ce3063ff7832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '188607ed43a44590adf2ccebf3053fe9'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:56.129973 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1052/2103] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:09:55 2022] DELETE /identity/v3/users/188607ed43a44590adf2ccebf3053fe9 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:56.140875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1052/2104] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:56.150827 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c60c1-d70e-4137-9661-ef5c28e6e55b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:56.151116 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c60c1-d70e-4137-9661-ef5c28e6e55b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:56.151393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c60c1-d70e-4137-9661-ef5c28e6e55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:56.181419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3a0c60c1-d70e-4137-9661-ef5c28e6e55b None None] MFA Rules not processed for user `2c19c490070a405ab2f48336c5b842df`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:56.182865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3a0c60c1-d70e-4137-9661-ef5c28e6e55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:56.321233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1053/2105] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:09:56.334399 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32db93-a3de-4ae6-84a1-3a0112d37e51 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:56.335938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-dd32db93-a3de-4ae6-84a1-3a0112d37e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:56.523018 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32db93-a3de-4ae6-84a1-3a0112d37e51 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:56.552477 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb212d75-08dc-4982-964f-e0df685b0e65 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:56.553056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb212d75-08dc-4982-964f-e0df685b0e65 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:56.553495 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb212d75-08dc-4982-964f-e0df685b0e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:56.618361 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-fb212d75-08dc-4982-964f-e0df685b0e65 None None] MFA Rules not processed for user `31cf6712c5ec4fc993640d5afcf3e6a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:56.626534 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-fb212d75-08dc-4982-964f-e0df685b0e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:56.751486 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d0f72-0e5d-448b-a300-c43e3be32c56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:56.752651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d0f72-0e5d-448b-a300-c43e3be32c56 service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:56.753173 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d0f72-0e5d-448b-a300-c43e3be32c56 service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:56.753689 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d0f72-0e5d-448b-a300-c43e3be32c56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:56.775807 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d0f72-0e5d-448b-a300-c43e3be32c56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:56.778085 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d0f72-0e5d-448b-a300-c43e3be32c56 service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:56.790043 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1053/2106] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:56.796315 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1054/2107] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:09:56.809451 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb212d75-08dc-4982-964f-e0df685b0e65 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:56.811535 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-fb212d75-08dc-4982-964f-e0df685b0e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:56.817255 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d0f72-0e5d-448b-a300-c43e3be32c56 service nova] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:56.819671 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:56.823331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-cb5d0f72-0e5d-448b-a300-c43e3be32c56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:56.937523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:56.938437 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb212d75-08dc-4982-964f-e0df685b0e65 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:56.956664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d23f77-09f5-4e03-9810-69c548790a48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:56.957256 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d23f77-09f5-4e03-9810-69c548790a48 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:56.957547 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d23f77-09f5-4e03-9810-69c548790a48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:56.957856 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d23f77-09f5-4e03-9810-69c548790a48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:56.978443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d0f72-0e5d-448b-a300-c43e3be32c56 service nova] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:56.983373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d23f77-09f5-4e03-9810-69c548790a48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:56.984654 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac79a65-2fd6-4e5f-bfac-8a767fcc736f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:56.985531 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac79a65-2fd6-4e5f-bfac-8a767fcc736f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:56.985822 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac79a65-2fd6-4e5f-bfac-8a767fcc736f admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:56.985929 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d23f77-09f5-4e03-9810-69c548790a48 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:56.986279 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac79a65-2fd6-4e5f-bfac-8a767fcc736f admin admin] PATH_INFO: `/v3/projects/c03e2e96d7074222b28844a0191b61ff` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:56.990702 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac79a65-2fd6-4e5f-bfac-8a767fcc736f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c03e2e96d7074222b28844a0191b61ff)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:56.993338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac79a65-2fd6-4e5f-bfac-8a767fcc736f admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:57.011745 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1055/2108] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:57.070158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2ac79a65-2fd6-4e5f-bfac-8a767fcc736f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c03e2e96d7074222b28844a0191b61ff', 'request_id': 'req-2ac79a65-2fd6-4e5f-bfac-8a767fcc736f'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:57.086989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2ac79a65-2fd6-4e5f-bfac-8a767fcc736f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c03e2e96d7074222b28844a0191b61ff', 'request_id': 'req-2ac79a65-2fd6-4e5f-bfac-8a767fcc736f'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:57.103468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2ac79a65-2fd6-4e5f-bfac-8a767fcc736f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c03e2e96d7074222b28844a0191b61ff', 'request_id': 'req-2ac79a65-2fd6-4e5f-bfac-8a767fcc736f'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:57.129294 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2ac79a65-2fd6-4e5f-bfac-8a767fcc736f admin admin] The token cache is being invalidate because project c03e2e96d7074222b28844a0191b61ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:09:57.129601 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2ac79a65-2fd6-4e5f-bfac-8a767fcc736f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:57.130909 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2ac79a65-2fd6-4e5f-bfac-8a767fcc736f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:09:57.136177 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1054/2109] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:09:56 2022] DELETE /identity/v3/projects/c03e2e96d7074222b28844a0191b61ff => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:57.140531 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf2c7e-8588-40a2-836f-1b9e5a8d6c1a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:57.140822 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf2c7e-8588-40a2-836f-1b9e5a8d6c1a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:57.141515 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf2c7e-8588-40a2-836f-1b9e5a8d6c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:57.167646 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a1bf2c7e-8588-40a2-836f-1b9e5a8d6c1a None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:57.169970 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a1bf2c7e-8588-40a2-836f-1b9e5a8d6c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:57.287907 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1056/2110] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:57.296822 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f35d5-f073-4a9b-98e3-dcab707c39a8 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:57.297108 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f35d5-f073-4a9b-98e3-dcab707c39a8 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:57.297377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f35d5-f073-4a9b-98e3-dcab707c39a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:57.317073 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-da9f35d5-f073-4a9b-98e3-dcab707c39a8 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:57.318326 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-da9f35d5-f073-4a9b-98e3-dcab707c39a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:57.330297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1055/2111] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:57.331685 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf2c7e-8588-40a2-836f-1b9e5a8d6c1a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:57.351279 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf2c7e-8588-40a2-836f-1b9e5a8d6c1a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:57.374345 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf842de-f3ae-42d9-9564-470602ebaabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:57.378413 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf842de-f3ae-42d9-9564-470602ebaabb admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:57.379121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf842de-f3ae-42d9-9564-470602ebaabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:57.381188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf842de-f3ae-42d9-9564-470602ebaabb admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:57.382515 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf842de-f3ae-42d9-9564-470602ebaabb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:09:57.384010 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf842de-f3ae-42d9-9564-470602ebaabb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:57.388215 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf842de-f3ae-42d9-9564-470602ebaabb admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:57.406703 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1057/2112] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:09:57.411051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f35d5-f073-4a9b-98e3-dcab707c39a8 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:57.426165 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f35d5-f073-4a9b-98e3-dcab707c39a8 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:57.431468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656d91d-8501-4402-811b-74abeb8037ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:57.432212 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656d91d-8501-4402-811b-74abeb8037ab admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:57.432571 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656d91d-8501-4402-811b-74abeb8037ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:57.432915 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656d91d-8501-4402-811b-74abeb8037ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:57.433730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656d91d-8501-4402-811b-74abeb8037ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:57.436376 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656d91d-8501-4402-811b-74abeb8037ab admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:57.478117 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1056/2113] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:57 2022] POST /identity/v3/projects => generated 363 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:57.482135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf842de-f3ae-42d9-9564-470602ebaabb admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:57.495766 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf842de-f3ae-42d9-9564-470602ebaabb admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:57.558309 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ba45e-3da1-402a-a690-2c1b3a1263f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:57.559227 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ba45e-3da1-402a-a690-2c1b3a1263f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:57.559938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ba45e-3da1-402a-a690-2c1b3a1263f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:57.560384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ba45e-3da1-402a-a690-2c1b3a1263f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:57.562077 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ba45e-3da1-402a-a690-2c1b3a1263f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:57.564353 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ba45e-3da1-402a-a690-2c1b3a1263f3 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:57.595359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1058/2114] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:57 2022] POST /identity/v3/users => generated 282 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:57.595836 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656d91d-8501-4402-811b-74abeb8037ab admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:57.607135 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656d91d-8501-4402-811b-74abeb8037ab admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:57.614285 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5349461-3dab-49f8-8e2e-10d8af2fd7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:57.615197 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5349461-3dab-49f8-8e2e-10d8af2fd7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:57.615769 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5349461-3dab-49f8-8e2e-10d8af2fd7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:57.620511 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5349461-3dab-49f8-8e2e-10d8af2fd7d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:57.621444 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5349461-3dab-49f8-8e2e-10d8af2fd7d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:57.623414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5349461-3dab-49f8-8e2e-10d8af2fd7d6 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:57.627408 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad6bbf-c186-411c-abd6-33c087662e90 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:57.627705 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad6bbf-c186-411c-abd6-33c087662e90 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:57.628144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad6bbf-c186-411c-abd6-33c087662e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:57.638761 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1057/2115] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:57.645191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5349461-3dab-49f8-8e2e-10d8af2fd7d6 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:57.651454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-1aad6bbf-c186-411c-abd6-33c087662e90 None None] MFA Rules not processed for user `2c19c490070a405ab2f48336c5b842df`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:57.652798 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1aad6bbf-c186-411c-abd6-33c087662e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:57.664762 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5349461-3dab-49f8-8e2e-10d8af2fd7d6 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:57.671450 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9df1c2-bc59-4643-8af2-e9ca40432f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:57.672327 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9df1c2-bc59-4643-8af2-e9ca40432f18 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:57.672963 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9df1c2-bc59-4643-8af2-e9ca40432f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:57.673394 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9df1c2-bc59-4643-8af2-e9ca40432f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:57.674143 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9df1c2-bc59-4643-8af2-e9ca40432f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:57.677110 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9df1c2-bc59-4643-8af2-e9ca40432f18 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:57.694770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1058/2116] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:57.699116 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:57.703849 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9df1c2-bc59-4643-8af2-e9ca40432f18 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:57.718644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9df1c2-bc59-4643-8af2-e9ca40432f18 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:57.728500 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad02a7-d87e-4c6c-b34e-89137a667ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:57.729588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad02a7-d87e-4c6c-b34e-89137a667ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:57.730006 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad02a7-d87e-4c6c-b34e-89137a667ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:57.730434 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad02a7-d87e-4c6c-b34e-89137a667ea5 admin admin] PATH_INFO: `/v3/projects/6979a341c250408ab3810cfcb57a6954/users/82129e45465b4f5b80524309f08cd5ac/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:57.758245 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad02a7-d87e-4c6c-b34e-89137a667ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6979a341c250408ab3810cfcb57a6954, user_id=82129e45465b4f5b80524309f08cd5ac, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:57.764510 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad02a7-d87e-4c6c-b34e-89137a667ea5 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:57.773155 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1059/2117] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:09:57.787077 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1059/2118] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:57 2022] PUT /identity/v3/projects/6979a341c250408ab3810cfcb57a6954/users/82129e45465b4f5b80524309f08cd5ac/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:09:57.797408 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2a206-d14a-4865-b4d7-7f710ec031aa None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:57.798033 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2a206-d14a-4865-b4d7-7f710ec031aa None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:57.798516 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2a206-d14a-4865-b4d7-7f710ec031aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:57.857689 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-c1c2a206-d14a-4865-b4d7-7f710ec031aa None None] MFA Rules not processed for user `82129e45465b4f5b80524309f08cd5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:57.859197 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c1c2a206-d14a-4865-b4d7-7f710ec031aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:57.965214 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1060/2119] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:57 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:57.967972 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad02a7-d87e-4c6c-b34e-89137a667ea5 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:58.061816 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:58.079250 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad02a7-d87e-4c6c-b34e-89137a667ea5 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:58.087938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ed4da-55f7-4794-b42f-1a55f095480e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:58.089131 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ed4da-55f7-4794-b42f-1a55f095480e admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:58.089613 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ed4da-55f7-4794-b42f-1a55f095480e admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:58.089991 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ed4da-55f7-4794-b42f-1a55f095480e admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:58.090824 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ed4da-55f7-4794-b42f-1a55f095480e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:58.093017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ed4da-55f7-4794-b42f-1a55f095480e admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:58.131908 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1060/2120] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:09:57 2022] POST /identity/v3/projects => generated 365 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:09:58.135840 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2a206-d14a-4865-b4d7-7f710ec031aa None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:58.149828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2a206-d14a-4865-b4d7-7f710ec031aa None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:58.228619 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e5d99-632f-4daf-aedf-f9341c413cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:58.229664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e5d99-632f-4daf-aedf-f9341c413cbc admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:58.230194 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e5d99-632f-4daf-aedf-f9341c413cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:58.230669 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e5d99-632f-4daf-aedf-f9341c413cbc admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:58.232939 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e5d99-632f-4daf-aedf-f9341c413cbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:58.235710 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e5d99-632f-4daf-aedf-f9341c413cbc admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:58.268421 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1061/2121] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:09:58 2022] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:09:58.272260 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ed4da-55f7-4794-b42f-1a55f095480e admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:58.284324 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ed4da-55f7-4794-b42f-1a55f095480e admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:58.290129 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262941d-f597-4cc6-b04f-c740d027757d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:58.291118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262941d-f597-4cc6-b04f-c740d027757d admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:58.291516 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262941d-f597-4cc6-b04f-c740d027757d admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:58.292592 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262941d-f597-4cc6-b04f-c740d027757d admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:58.293305 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262941d-f597-4cc6-b04f-c740d027757d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:58.295452 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262941d-f597-4cc6-b04f-c740d027757d admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:58.308033 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1061/2122] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:58.313434 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e5d99-632f-4daf-aedf-f9341c413cbc admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:58.327355 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e5d99-632f-4daf-aedf-f9341c413cbc admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:58.332317 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857d927-f246-47c0-a3a2-fce35ad0051c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:58.333207 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857d927-f246-47c0-a3a2-fce35ad0051c admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:58.333487 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857d927-f246-47c0-a3a2-fce35ad0051c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:58.333759 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857d927-f246-47c0-a3a2-fce35ad0051c admin admin] PATH_INFO: `/v3/projects/26c57682ff4a4f649bfaf02b68dfa7ed/users/41d963049303473e87554b39d8d5e2b7/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:58.364898 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857d927-f246-47c0-a3a2-fce35ad0051c admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c57682ff4a4f649bfaf02b68dfa7ed, user_id=41d963049303473e87554b39d8d5e2b7, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:58.369624 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857d927-f246-47c0-a3a2-fce35ad0051c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:58.388774 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1062/2123] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:58 2022] PUT /identity/v3/projects/26c57682ff4a4f649bfaf02b68dfa7ed/users/41d963049303473e87554b39d8d5e2b7/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:58.392738 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262941d-f597-4cc6-b04f-c740d027757d admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:58.423719 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262941d-f597-4cc6-b04f-c740d027757d admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:58.532046 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26e0b4-9b69-4968-bb1d-ed739f5baa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:58.535590 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26e0b4-9b69-4968-bb1d-ed739f5baa87 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:58.535975 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26e0b4-9b69-4968-bb1d-ed739f5baa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:58.536326 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26e0b4-9b69-4968-bb1d-ed739f5baa87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:58.537687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26e0b4-9b69-4968-bb1d-ed739f5baa87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:58.539715 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26e0b4-9b69-4968-bb1d-ed739f5baa87 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:58.562223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857d927-f246-47c0-a3a2-fce35ad0051c admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:58.563849 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1062/2124] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:09:58.601099 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d37dc4-9e47-4996-8222-55e1341c4924 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:58.601099 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d37dc4-9e47-4996-8222-55e1341c4924 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:58.604901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857d927-f246-47c0-a3a2-fce35ad0051c admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:58.605714 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d37dc4-9e47-4996-8222-55e1341c4924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:58.626383 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccc03f-88a7-41dd-b56a-299cde30fed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:58.627699 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccc03f-88a7-41dd-b56a-299cde30fed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:58.627985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccc03f-88a7-41dd-b56a-299cde30fed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:58.628267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccc03f-88a7-41dd-b56a-299cde30fed6 admin admin] PATH_INFO: `/v3/projects/26c57682ff4a4f649bfaf02b68dfa7ed/users/41d963049303473e87554b39d8d5e2b7/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:58.639446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccc03f-88a7-41dd-b56a-299cde30fed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c57682ff4a4f649bfaf02b68dfa7ed, user_id=41d963049303473e87554b39d8d5e2b7, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:58.642783 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccc03f-88a7-41dd-b56a-299cde30fed6 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:58.666433 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-86d37dc4-9e47-4996-8222-55e1341c4924 None None] MFA Rules not processed for user `31cf6712c5ec4fc993640d5afcf3e6a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:58.677684 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-86d37dc4-9e47-4996-8222-55e1341c4924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:58.682730 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1063/2125] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:09:58 2022] PUT /identity/v3/projects/26c57682ff4a4f649bfaf02b68dfa7ed/users/41d963049303473e87554b39d8d5e2b7/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:09:58.693558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b6a75-2c19-4454-9733-e31b6dbd4b08 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:58.694233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b6a75-2c19-4454-9733-e31b6dbd4b08 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:58.694233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b6a75-2c19-4454-9733-e31b6dbd4b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:58.717109 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:09:58.729772 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-df9b6a75-2c19-4454-9733-e31b6dbd4b08 None None] MFA Rules not processed for user `41d963049303473e87554b39d8d5e2b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:09:58.732579 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-df9b6a75-2c19-4454-9733-e31b6dbd4b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:58.781374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1063/2126] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:58.842762 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1064/2127] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:09:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:09:58.855648 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d37dc4-9e47-4996-8222-55e1341c4924 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:58.857986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-86d37dc4-9e47-4996-8222-55e1341c4924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:58.972210 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d37dc4-9e47-4996-8222-55e1341c4924 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:58.980804 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5350125-83f1-412a-bb86-64f5aa212aab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:58.981120 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5350125-83f1-412a-bb86-64f5aa212aab service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:58.981442 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5350125-83f1-412a-bb86-64f5aa212aab service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:58.981781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5350125-83f1-412a-bb86-64f5aa212aab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:59.005033 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5350125-83f1-412a-bb86-64f5aa212aab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:59.007473 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5350125-83f1-412a-bb86-64f5aa212aab service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:59.036503 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1064/2128] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:58 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:09:59.174238 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b6a75-2c19-4454-9733-e31b6dbd4b08 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:09:59.175882 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-df9b6a75-2c19-4454-9733-e31b6dbd4b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:09:59.199135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b6a75-2c19-4454-9733-e31b6dbd4b08 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:09:59.212453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1bf9a-5f0d-4b83-aa4f-51280927b601 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:09:59.213140 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1bf9a-5f0d-4b83-aa4f-51280927b601 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:09:59.213430 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1bf9a-5f0d-4b83-aa4f-51280927b601 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:09:59.213723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1bf9a-5f0d-4b83-aa4f-51280927b601 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:09:59.369917 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1bf9a-5f0d-4b83-aa4f-51280927b601 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:09:59.388566 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1bf9a-5f0d-4b83-aa4f-51280927b601 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:09:59.406329 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1065/2129] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:09:59 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:10:02.815921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5350125-83f1-412a-bb86-64f5aa212aab service cinder] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:02.837982 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:02.976649 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5350125-83f1-412a-bb86-64f5aa212aab service cinder] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:02.991545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e9da2-fc56-408a-95b4-002382fd3262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:02.992574 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e9da2-fc56-408a-95b4-002382fd3262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:02.992930 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e9da2-fc56-408a-95b4-002382fd3262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:02.993281 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e9da2-fc56-408a-95b4-002382fd3262 admin admin] PATH_INFO: `/v3/users/82129e45465b4f5b80524309f08cd5ac` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:02.994890 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e9da2-fc56-408a-95b4-002382fd3262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82129e45465b4f5b80524309f08cd5ac)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:03.002030 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e9da2-fc56-408a-95b4-002382fd3262 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:03.129762 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-168e9da2-fc56-408a-95b4-002382fd3262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82129e45465b4f5b80524309f08cd5ac'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:03.144758 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-168e9da2-fc56-408a-95b4-002382fd3262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82129e45465b4f5b80524309f08cd5ac'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:03.145510 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-168e9da2-fc56-408a-95b4-002382fd3262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82129e45465b4f5b80524309f08cd5ac'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:03.166602 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-168e9da2-fc56-408a-95b4-002382fd3262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82129e45465b4f5b80524309f08cd5ac'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:03.167646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-168e9da2-fc56-408a-95b4-002382fd3262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82129e45465b4f5b80524309f08cd5ac'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:03.194057 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1065/2130] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:10:02 2022] DELETE /identity/v3/users/82129e45465b4f5b80524309f08cd5ac => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:03.199899 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebff2b-678e-463e-a56b-ef4abd6d8b41 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:03.201492 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebff2b-678e-463e-a56b-ef4abd6d8b41 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:03.201967 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebff2b-678e-463e-a56b-ef4abd6d8b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:03.240315 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-9cebff2b-678e-463e-a56b-ef4abd6d8b41 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:03.245361 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9cebff2b-678e-463e-a56b-ef4abd6d8b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:03.347041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1066/2131] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:03.363882 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e9da2-fc56-408a-95b4-002382fd3262 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:03.365920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-168e9da2-fc56-408a-95b4-002382fd3262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:03.457547 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e9da2-fc56-408a-95b4-002382fd3262 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:03.464328 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daaa7b6-e7f8-4e44-9cae-c52f85c9e82a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:03.465626 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daaa7b6-e7f8-4e44-9cae-c52f85c9e82a service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:03.466149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daaa7b6-e7f8-4e44-9cae-c52f85c9e82a service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:03.466722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daaa7b6-e7f8-4e44-9cae-c52f85c9e82a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:03.479772 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daaa7b6-e7f8-4e44-9cae-c52f85c9e82a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:03.482307 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daaa7b6-e7f8-4e44-9cae-c52f85c9e82a service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:03.498573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1066/2132] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:10:04.165337 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebff2b-678e-463e-a56b-ef4abd6d8b41 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:04.166904 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9cebff2b-678e-463e-a56b-ef4abd6d8b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:04.187832 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebff2b-678e-463e-a56b-ef4abd6d8b41 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:04.193181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3602123-961c-4ffe-afb0-a1d0eabbdb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:04.194276 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3602123-961c-4ffe-afb0-a1d0eabbdb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:04.194769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3602123-961c-4ffe-afb0-a1d0eabbdb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:04.195196 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3602123-961c-4ffe-afb0-a1d0eabbdb76 admin admin] PATH_INFO: `/v3/projects/6979a341c250408ab3810cfcb57a6954` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:04.197021 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3602123-961c-4ffe-afb0-a1d0eabbdb76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6979a341c250408ab3810cfcb57a6954)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:04.199163 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3602123-961c-4ffe-afb0-a1d0eabbdb76 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:04.266356 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:04.292745 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b3602123-961c-4ffe-afb0-a1d0eabbdb76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6979a341c250408ab3810cfcb57a6954', 'request_id': 'req-b3602123-961c-4ffe-afb0-a1d0eabbdb76'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:04.323355 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b3602123-961c-4ffe-afb0-a1d0eabbdb76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6979a341c250408ab3810cfcb57a6954', 'request_id': 'req-b3602123-961c-4ffe-afb0-a1d0eabbdb76'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:04.351407 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b3602123-961c-4ffe-afb0-a1d0eabbdb76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6979a341c250408ab3810cfcb57a6954', 'request_id': 'req-b3602123-961c-4ffe-afb0-a1d0eabbdb76'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:04.368808 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b3602123-961c-4ffe-afb0-a1d0eabbdb76 admin admin] The token cache is being invalidate because project 6979a341c250408ab3810cfcb57a6954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:10:04.369128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b3602123-961c-4ffe-afb0-a1d0eabbdb76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:04.370132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b3602123-961c-4ffe-afb0-a1d0eabbdb76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:04.375474 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1067/2133] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:10:04 2022] DELETE /identity/v3/projects/6979a341c250408ab3810cfcb57a6954 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:04.377831 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daaa7b6-e7f8-4e44-9cae-c52f85c9e82a service neutron] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:04.416056 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daaa7b6-e7f8-4e44-9cae-c52f85c9e82a service neutron] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:04.471858 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:04.509297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93d20d-1682-4b5e-b16c-9606dc8e3837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:04.509297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93d20d-1682-4b5e-b16c-9606dc8e3837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:04.509297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93d20d-1682-4b5e-b16c-9606dc8e3837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:04.509801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93d20d-1682-4b5e-b16c-9606dc8e3837 admin admin] PATH_INFO: `/v3/users/41d963049303473e87554b39d8d5e2b7` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:04.511008 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93d20d-1682-4b5e-b16c-9606dc8e3837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41d963049303473e87554b39d8d5e2b7)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:04.513217 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93d20d-1682-4b5e-b16c-9606dc8e3837 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:04.574371 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-fc93d20d-1682-4b5e-b16c-9606dc8e3837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41d963049303473e87554b39d8d5e2b7'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:04.589616 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-fc93d20d-1682-4b5e-b16c-9606dc8e3837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41d963049303473e87554b39d8d5e2b7'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:04.591368 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-fc93d20d-1682-4b5e-b16c-9606dc8e3837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41d963049303473e87554b39d8d5e2b7'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:04.608525 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-fc93d20d-1682-4b5e-b16c-9606dc8e3837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41d963049303473e87554b39d8d5e2b7'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:04.609523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-fc93d20d-1682-4b5e-b16c-9606dc8e3837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41d963049303473e87554b39d8d5e2b7'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:04.625224 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1067/2134] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:10:04 2022] DELETE /identity/v3/users/41d963049303473e87554b39d8d5e2b7 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:05.081565 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3602123-961c-4ffe-afb0-a1d0eabbdb76 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:05.083358 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b3602123-961c-4ffe-afb0-a1d0eabbdb76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:05.098843 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3602123-961c-4ffe-afb0-a1d0eabbdb76 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:05.193405 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84164add-d036-4f1d-bc82-5a46c547fa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:05.195048 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84164add-d036-4f1d-bc82-5a46c547fa9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:05.195437 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84164add-d036-4f1d-bc82-5a46c547fa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:05.195828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84164add-d036-4f1d-bc82-5a46c547fa9e admin admin] PATH_INFO: `/v3/projects/26c57682ff4a4f649bfaf02b68dfa7ed` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:05.197700 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84164add-d036-4f1d-bc82-5a46c547fa9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=26c57682ff4a4f649bfaf02b68dfa7ed)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:05.200469 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84164add-d036-4f1d-bc82-5a46c547fa9e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:05.299354 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-84164add-d036-4f1d-bc82-5a46c547fa9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26c57682ff4a4f649bfaf02b68dfa7ed', 'request_id': 'req-84164add-d036-4f1d-bc82-5a46c547fa9e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:05.308333 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-84164add-d036-4f1d-bc82-5a46c547fa9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26c57682ff4a4f649bfaf02b68dfa7ed', 'request_id': 'req-84164add-d036-4f1d-bc82-5a46c547fa9e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:05.319697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-84164add-d036-4f1d-bc82-5a46c547fa9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26c57682ff4a4f649bfaf02b68dfa7ed', 'request_id': 'req-84164add-d036-4f1d-bc82-5a46c547fa9e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:05.342032 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-84164add-d036-4f1d-bc82-5a46c547fa9e admin admin] The token cache is being invalidate because project 26c57682ff4a4f649bfaf02b68dfa7ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:10:05.342630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-84164add-d036-4f1d-bc82-5a46c547fa9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:05.343649 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-84164add-d036-4f1d-bc82-5a46c547fa9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:05.345441 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1068/2135] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:10:05 2022] DELETE /identity/v3/projects/26c57682ff4a4f649bfaf02b68dfa7ed => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:10:05.352340 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a87c0f-175d-4d8d-b007-1967533f8a77 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:05.352340 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a87c0f-175d-4d8d-b007-1967533f8a77 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:05.352340 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a87c0f-175d-4d8d-b007-1967533f8a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:05.375066 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-04a87c0f-175d-4d8d-b007-1967533f8a77 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:05.376063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-04a87c0f-175d-4d8d-b007-1967533f8a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:05.494550 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1068/2136] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:10:05.502442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ea6f8-e7b0-413f-bc84-7fee1fb3c711 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:05.502770 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ea6f8-e7b0-413f-bc84-7fee1fb3c711 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:05.502871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ea6f8-e7b0-413f-bc84-7fee1fb3c711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:05.524679 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6e0ea6f8-e7b0-413f-bc84-7fee1fb3c711 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:05.526623 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6e0ea6f8-e7b0-413f-bc84-7fee1fb3c711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:05.537471 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1069/2137] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:05.539749 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a87c0f-175d-4d8d-b007-1967533f8a77 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:05.550717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a87c0f-175d-4d8d-b007-1967533f8a77 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:05.556092 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508a0f1-b2ce-4902-ac53-8ea5d77b88cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:05.556781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508a0f1-b2ce-4902-ac53-8ea5d77b88cc admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:05.557062 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508a0f1-b2ce-4902-ac53-8ea5d77b88cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:05.557336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508a0f1-b2ce-4902-ac53-8ea5d77b88cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:05.558692 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508a0f1-b2ce-4902-ac53-8ea5d77b88cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:10:05.558692 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508a0f1-b2ce-4902-ac53-8ea5d77b88cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:05.560601 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508a0f1-b2ce-4902-ac53-8ea5d77b88cc admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:05.573228 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1069/2138] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:10:05.578355 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ea6f8-e7b0-413f-bc84-7fee1fb3c711 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:05.590792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ea6f8-e7b0-413f-bc84-7fee1fb3c711 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:05.600562 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec667542-04ba-439b-8761-b18c48f1c776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:05.601832 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec667542-04ba-439b-8761-b18c48f1c776 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:05.602197 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec667542-04ba-439b-8761-b18c48f1c776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:05.602561 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec667542-04ba-439b-8761-b18c48f1c776 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:05.603369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec667542-04ba-439b-8761-b18c48f1c776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:05.606087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec667542-04ba-439b-8761-b18c48f1c776 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:05.645759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508a0f1-b2ce-4902-ac53-8ea5d77b88cc admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:05.646855 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1070/2139] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:10:05 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:10:05.656913 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508a0f1-b2ce-4902-ac53-8ea5d77b88cc admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:05.701553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:05.737940 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e39e5-9221-491f-9252-b15980dfbd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:05.739141 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e39e5-9221-491f-9252-b15980dfbd7f admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:05.739364 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e39e5-9221-491f-9252-b15980dfbd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:05.739804 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e39e5-9221-491f-9252-b15980dfbd7f admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:05.740893 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e39e5-9221-491f-9252-b15980dfbd7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:05.744217 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e39e5-9221-491f-9252-b15980dfbd7f admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:05.774269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1070/2140] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:10:05 2022] POST /identity/v3/users => generated 290 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:10:05.778447 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec667542-04ba-439b-8761-b18c48f1c776 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:05.794750 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec667542-04ba-439b-8761-b18c48f1c776 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:05.799604 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089aac4-7d80-46e7-a038-3696220ab85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:05.800288 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089aac4-7d80-46e7-a038-3696220ab85f admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:05.800572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089aac4-7d80-46e7-a038-3696220ab85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:05.800845 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089aac4-7d80-46e7-a038-3696220ab85f admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:05.801610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089aac4-7d80-46e7-a038-3696220ab85f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:05.803258 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089aac4-7d80-46e7-a038-3696220ab85f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:05.815423 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1071/2141] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:10:05.819392 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e39e5-9221-491f-9252-b15980dfbd7f admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:05.837859 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e39e5-9221-491f-9252-b15980dfbd7f admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:05.850701 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797080af-2644-4aa5-9536-9a29a5929ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:05.851397 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797080af-2644-4aa5-9536-9a29a5929ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:05.851684 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797080af-2644-4aa5-9536-9a29a5929ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:05.851961 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797080af-2644-4aa5-9536-9a29a5929ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:05.852734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797080af-2644-4aa5-9536-9a29a5929ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:05.854402 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797080af-2644-4aa5-9536-9a29a5929ffe admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:05.865976 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1071/2142] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:10:05.870402 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089aac4-7d80-46e7-a038-3696220ab85f admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:05.882006 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089aac4-7d80-46e7-a038-3696220ab85f admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:05.886877 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0adbb5-b9fd-43a0-b92a-ab50e35ffa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:05.887822 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0adbb5-b9fd-43a0-b92a-ab50e35ffa37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:05.888109 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0adbb5-b9fd-43a0-b92a-ab50e35ffa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:05.888391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0adbb5-b9fd-43a0-b92a-ab50e35ffa37 admin admin] PATH_INFO: `/v3/projects/e2c2265a4a014551abf5b3a37be849e5/users/481b05687b4649f2b51974246431d62b/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:05.892096 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:05.907884 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0adbb5-b9fd-43a0-b92a-ab50e35ffa37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2c2265a4a014551abf5b3a37be849e5, user_id=481b05687b4649f2b51974246431d62b, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:05.911135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0adbb5-b9fd-43a0-b92a-ab50e35ffa37 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:05.926127 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1072/2143] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:10:05 2022] PUT /identity/v3/projects/e2c2265a4a014551abf5b3a37be849e5/users/481b05687b4649f2b51974246431d62b/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:05.937032 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15aeea-bf3b-4b0b-9058-80f0b9f6e56f None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:05.937324 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15aeea-bf3b-4b0b-9058-80f0b9f6e56f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:05.937609 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15aeea-bf3b-4b0b-9058-80f0b9f6e56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:05.964656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-fd15aeea-bf3b-4b0b-9058-80f0b9f6e56f None None] MFA Rules not processed for user `481b05687b4649f2b51974246431d62b`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:05.965891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-fd15aeea-bf3b-4b0b-9058-80f0b9f6e56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:06.056386 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1072/2144] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:06.061510 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0adbb5-b9fd-43a0-b92a-ab50e35ffa37 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:06.140947 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0adbb5-b9fd-43a0-b92a-ab50e35ffa37 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:06.147182 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f212e7-8271-4918-ba19-986027149dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:06.147957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f212e7-8271-4918-ba19-986027149dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:06.148306 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f212e7-8271-4918-ba19-986027149dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:06.148653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f212e7-8271-4918-ba19-986027149dc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:06.149455 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f212e7-8271-4918-ba19-986027149dc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:06.151556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f212e7-8271-4918-ba19-986027149dc0 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:06.193152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1073/2145] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:10:06 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:10:06.198822 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15aeea-bf3b-4b0b-9058-80f0b9f6e56f None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:06.215094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15aeea-bf3b-4b0b-9058-80f0b9f6e56f None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:06.297275 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb5037-8b95-4a32-9b1d-2296bff6c6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:06.297989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb5037-8b95-4a32-9b1d-2296bff6c6a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:06.298279 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb5037-8b95-4a32-9b1d-2296bff6c6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:06.298595 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb5037-8b95-4a32-9b1d-2296bff6c6a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:06.299302 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb5037-8b95-4a32-9b1d-2296bff6c6a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:06.301241 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb5037-8b95-4a32-9b1d-2296bff6c6a0 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:06.323482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1073/2146] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:10:06 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:10:06.327611 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f212e7-8271-4918-ba19-986027149dc0 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:06.338235 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f212e7-8271-4918-ba19-986027149dc0 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:06.343505 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de6147-f286-4ad6-89e0-d446a34e21f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:06.344168 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de6147-f286-4ad6-89e0-d446a34e21f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:06.344455 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de6147-f286-4ad6-89e0-d446a34e21f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:06.344731 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de6147-f286-4ad6-89e0-d446a34e21f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:06.345459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de6147-f286-4ad6-89e0-d446a34e21f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:06.347082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de6147-f286-4ad6-89e0-d446a34e21f5 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:06.362320 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1074/2147] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:10:06.363801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb5037-8b95-4a32-9b1d-2296bff6c6a0 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:06.374307 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb5037-8b95-4a32-9b1d-2296bff6c6a0 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:06.379273 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3597e-28a7-4696-9cfa-495ae1bcfa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:06.380246 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3597e-28a7-4696-9cfa-495ae1bcfa80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:06.380530 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3597e-28a7-4696-9cfa-495ae1bcfa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:06.380809 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3597e-28a7-4696-9cfa-495ae1bcfa80 admin admin] PATH_INFO: `/v3/projects/a02d4a165a304d4b8d4336c282f10b9a/users/df28ec642ab947edb805c01118cdac2a/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:06.409353 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3597e-28a7-4696-9cfa-495ae1bcfa80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02d4a165a304d4b8d4336c282f10b9a, user_id=df28ec642ab947edb805c01118cdac2a, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:06.412724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3597e-28a7-4696-9cfa-495ae1bcfa80 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:06.428670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1074/2148] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:10:06 2022] PUT /identity/v3/projects/a02d4a165a304d4b8d4336c282f10b9a/users/df28ec642ab947edb805c01118cdac2a/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:06.432486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de6147-f286-4ad6-89e0-d446a34e21f5 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:06.444315 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de6147-f286-4ad6-89e0-d446a34e21f5 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:06.525447 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e295e0-f338-497f-8c4b-c0bea6a4ffb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:06.526149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e295e0-f338-497f-8c4b-c0bea6a4ffb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:06.526434 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e295e0-f338-497f-8c4b-c0bea6a4ffb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:06.526745 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e295e0-f338-497f-8c4b-c0bea6a4ffb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:06.527541 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e295e0-f338-497f-8c4b-c0bea6a4ffb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:06.529717 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e295e0-f338-497f-8c4b-c0bea6a4ffb6 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:06.541938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1075/2149] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:10:06.546185 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3597e-28a7-4696-9cfa-495ae1bcfa80 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:06.556943 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3597e-28a7-4696-9cfa-495ae1bcfa80 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:06.565100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134d00d-ff05-49bd-afea-60d26c269207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:06.566240 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134d00d-ff05-49bd-afea-60d26c269207 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:06.566668 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134d00d-ff05-49bd-afea-60d26c269207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:06.567046 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134d00d-ff05-49bd-afea-60d26c269207 admin admin] PATH_INFO: `/v3/projects/a02d4a165a304d4b8d4336c282f10b9a/users/df28ec642ab947edb805c01118cdac2a/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:06.569737 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134d00d-ff05-49bd-afea-60d26c269207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02d4a165a304d4b8d4336c282f10b9a, user_id=df28ec642ab947edb805c01118cdac2a, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:06.572789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134d00d-ff05-49bd-afea-60d26c269207 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:06.581979 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:06.588535 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1075/2150] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:10:06 2022] PUT /identity/v3/projects/a02d4a165a304d4b8d4336c282f10b9a/users/df28ec642ab947edb805c01118cdac2a/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:10:06.601719 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04090ec6-7641-47e2-934f-e4cca6c72f43 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:06.602092 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04090ec6-7641-47e2-934f-e4cca6c72f43 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:06.602445 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04090ec6-7641-47e2-934f-e4cca6c72f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:06.633308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-04090ec6-7641-47e2-934f-e4cca6c72f43 None None] MFA Rules not processed for user `df28ec642ab947edb805c01118cdac2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:06.634556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-04090ec6-7641-47e2-934f-e4cca6c72f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:06.693678 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:06.722657 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1076/2151] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:10:06.734384 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134d00d-ff05-49bd-afea-60d26c269207 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:06.736259 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-3134d00d-ff05-49bd-afea-60d26c269207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:06.797149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134d00d-ff05-49bd-afea-60d26c269207 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:06.800964 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac20dc-774c-421c-831b-a1f135fcde6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:06.801629 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac20dc-774c-421c-831b-a1f135fcde6d service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:06.801953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac20dc-774c-421c-831b-a1f135fcde6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:06.802239 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac20dc-774c-421c-831b-a1f135fcde6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:06.865959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac20dc-774c-421c-831b-a1f135fcde6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:06.867933 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac20dc-774c-421c-831b-a1f135fcde6d service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:06.877855 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1076/2152] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:10:08.276134 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04090ec6-7641-47e2-934f-e4cca6c72f43 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:08.277656 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-04090ec6-7641-47e2-934f-e4cca6c72f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:08.290715 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04090ec6-7641-47e2-934f-e4cca6c72f43 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:08.295683 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8608a-8d66-4f05-9c93-c4bf2ac4821d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:08.296408 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8608a-8d66-4f05-9c93-c4bf2ac4821d service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:08.296688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8608a-8d66-4f05-9c93-c4bf2ac4821d service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:08.296975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8608a-8d66-4f05-9c93-c4bf2ac4821d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:08.308582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8608a-8d66-4f05-9c93-c4bf2ac4821d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:08.310734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8608a-8d66-4f05-9c93-c4bf2ac4821d service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:08.321731 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1077/2153] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:10:08.660105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac20dc-774c-421c-831b-a1f135fcde6d service cinder] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:08.661649 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-42ac20dc-774c-421c-831b-a1f135fcde6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:08.732565 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac20dc-774c-421c-831b-a1f135fcde6d service cinder] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:08.737200 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a716982-c9d8-4e2a-8649-110e423c47ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:08.738092 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a716982-c9d8-4e2a-8649-110e423c47ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:08.738375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a716982-c9d8-4e2a-8649-110e423c47ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:08.738679 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a716982-c9d8-4e2a-8649-110e423c47ff admin admin] PATH_INFO: `/v3/users/e53b8fd4b4ef4feba927f770fd6a09da` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:08.739906 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a716982-c9d8-4e2a-8649-110e423c47ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=e53b8fd4b4ef4feba927f770fd6a09da)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:08.742002 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a716982-c9d8-4e2a-8649-110e423c47ff admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:08.801104 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-7a716982-c9d8-4e2a-8649-110e423c47ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e53b8fd4b4ef4feba927f770fd6a09da'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:08.813829 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-7a716982-c9d8-4e2a-8649-110e423c47ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e53b8fd4b4ef4feba927f770fd6a09da'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:08.814869 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-7a716982-c9d8-4e2a-8649-110e423c47ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e53b8fd4b4ef4feba927f770fd6a09da'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:08.818173 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:08.835859 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-7a716982-c9d8-4e2a-8649-110e423c47ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e53b8fd4b4ef4feba927f770fd6a09da'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:08.836603 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-7a716982-c9d8-4e2a-8649-110e423c47ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e53b8fd4b4ef4feba927f770fd6a09da'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:08.856020 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1077/2154] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:10:08 2022] DELETE /identity/v3/users/e53b8fd4b4ef4feba927f770fd6a09da => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:09.048700 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8608a-8d66-4f05-9c93-c4bf2ac4821d service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:09.060811 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8608a-8d66-4f05-9c93-c4bf2ac4821d service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:09.124423 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ff6e2-ba40-4f07-a5e3-9b713b8c8333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:09.125321 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ff6e2-ba40-4f07-a5e3-9b713b8c8333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:09.125615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ff6e2-ba40-4f07-a5e3-9b713b8c8333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:09.125908 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ff6e2-ba40-4f07-a5e3-9b713b8c8333 admin admin] PATH_INFO: `/v3/projects/00aba904a38b4d17a7ac322fcd7c265e` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:09.127272 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ff6e2-ba40-4f07-a5e3-9b713b8c8333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00aba904a38b4d17a7ac322fcd7c265e)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:09.129250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ff6e2-ba40-4f07-a5e3-9b713b8c8333 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:09.177767 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-590ff6e2-ba40-4f07-a5e3-9b713b8c8333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00aba904a38b4d17a7ac322fcd7c265e', 'request_id': 'req-590ff6e2-ba40-4f07-a5e3-9b713b8c8333'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:09.183912 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-590ff6e2-ba40-4f07-a5e3-9b713b8c8333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00aba904a38b4d17a7ac322fcd7c265e', 'request_id': 'req-590ff6e2-ba40-4f07-a5e3-9b713b8c8333'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:09.189489 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-590ff6e2-ba40-4f07-a5e3-9b713b8c8333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00aba904a38b4d17a7ac322fcd7c265e', 'request_id': 'req-590ff6e2-ba40-4f07-a5e3-9b713b8c8333'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:09.203587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-590ff6e2-ba40-4f07-a5e3-9b713b8c8333 admin admin] The token cache is being invalidate because project 00aba904a38b4d17a7ac322fcd7c265e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:10:09.203879 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-590ff6e2-ba40-4f07-a5e3-9b713b8c8333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:09.204500 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-590ff6e2-ba40-4f07-a5e3-9b713b8c8333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:09.206037 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1078/2155] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:10:09 2022] DELETE /identity/v3/projects/00aba904a38b4d17a7ac322fcd7c265e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:09.210105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a716982-c9d8-4e2a-8649-110e423c47ff admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:09.211531 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-7a716982-c9d8-4e2a-8649-110e423c47ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:09.224923 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a716982-c9d8-4e2a-8649-110e423c47ff admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:09.281205 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c621e8-2a41-40f3-8604-a6aafc4f56f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:09.282119 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c621e8-2a41-40f3-8604-a6aafc4f56f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:09.282406 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c621e8-2a41-40f3-8604-a6aafc4f56f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:09.282728 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c621e8-2a41-40f3-8604-a6aafc4f56f7 admin admin] PATH_INFO: `/v3/users/40359476f0314ab9889900fab3cb331d` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:09.283934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c621e8-2a41-40f3-8604-a6aafc4f56f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40359476f0314ab9889900fab3cb331d)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:09.285880 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c621e8-2a41-40f3-8604-a6aafc4f56f7 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:09.340521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-c8c621e8-2a41-40f3-8604-a6aafc4f56f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40359476f0314ab9889900fab3cb331d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:09.349247 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-c8c621e8-2a41-40f3-8604-a6aafc4f56f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40359476f0314ab9889900fab3cb331d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:09.349916 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-c8c621e8-2a41-40f3-8604-a6aafc4f56f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40359476f0314ab9889900fab3cb331d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:09.362781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-c8c621e8-2a41-40f3-8604-a6aafc4f56f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40359476f0314ab9889900fab3cb331d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:09.363441 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-c8c621e8-2a41-40f3-8604-a6aafc4f56f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40359476f0314ab9889900fab3cb331d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:09.375656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1078/2156] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:10:09 2022] DELETE /identity/v3/users/40359476f0314ab9889900fab3cb331d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:09.573931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ff6e2-ba40-4f07-a5e3-9b713b8c8333 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:09.576565 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-590ff6e2-ba40-4f07-a5e3-9b713b8c8333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:09.619377 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ff6e2-ba40-4f07-a5e3-9b713b8c8333 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:09.681404 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:09.689204 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cdf05-e1b7-4b6c-8f2b-052e4ebab6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:09.690419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cdf05-e1b7-4b6c-8f2b-052e4ebab6ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:09.690714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cdf05-e1b7-4b6c-8f2b-052e4ebab6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:09.691172 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cdf05-e1b7-4b6c-8f2b-052e4ebab6ec admin admin] PATH_INFO: `/v3/projects/de106c66fc4c4ed49d6c74060df62c81` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:09.692734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cdf05-e1b7-4b6c-8f2b-052e4ebab6ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=de106c66fc4c4ed49d6c74060df62c81)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:09.695013 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cdf05-e1b7-4b6c-8f2b-052e4ebab6ec admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:09.755658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d55cdf05-e1b7-4b6c-8f2b-052e4ebab6ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de106c66fc4c4ed49d6c74060df62c81', 'request_id': 'req-d55cdf05-e1b7-4b6c-8f2b-052e4ebab6ec'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:09.764764 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d55cdf05-e1b7-4b6c-8f2b-052e4ebab6ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de106c66fc4c4ed49d6c74060df62c81', 'request_id': 'req-d55cdf05-e1b7-4b6c-8f2b-052e4ebab6ec'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:09.771561 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d55cdf05-e1b7-4b6c-8f2b-052e4ebab6ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de106c66fc4c4ed49d6c74060df62c81', 'request_id': 'req-d55cdf05-e1b7-4b6c-8f2b-052e4ebab6ec'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:09.787228 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d55cdf05-e1b7-4b6c-8f2b-052e4ebab6ec admin admin] The token cache is being invalidate because project de106c66fc4c4ed49d6c74060df62c81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:10:09.787620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d55cdf05-e1b7-4b6c-8f2b-052e4ebab6ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:09.788458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d55cdf05-e1b7-4b6c-8f2b-052e4ebab6ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:09.790602 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1079/2157] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:10:09 2022] DELETE /identity/v3/projects/de106c66fc4c4ed49d6c74060df62c81 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:09.796857 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97788746-18e9-40c7-8236-4c0ae44c3019 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:09.797321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97788746-18e9-40c7-8236-4c0ae44c3019 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:09.797597 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97788746-18e9-40c7-8236-4c0ae44c3019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:09.828500 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-97788746-18e9-40c7-8236-4c0ae44c3019 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:09.830033 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-97788746-18e9-40c7-8236-4c0ae44c3019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:09.886687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:09.901875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1079/2158] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:09.910096 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6c761-1245-4db0-a35c-39e0a8347417 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:09.910392 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6c761-1245-4db0-a35c-39e0a8347417 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:09.910708 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6c761-1245-4db0-a35c-39e0a8347417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:09.932488 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-5bf6c761-1245-4db0-a35c-39e0a8347417 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:09.933738 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5bf6c761-1245-4db0-a35c-39e0a8347417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:09.941924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1080/2159] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:09.946135 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97788746-18e9-40c7-8236-4c0ae44c3019 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:09.956420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97788746-18e9-40c7-8236-4c0ae44c3019 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:09.961196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac625d3c-1e95-441e-b6d7-c83ff9e958a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:09.961959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac625d3c-1e95-441e-b6d7-c83ff9e958a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:09.962268 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac625d3c-1e95-441e-b6d7-c83ff9e958a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:09.962589 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac625d3c-1e95-441e-b6d7-c83ff9e958a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:09.963870 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac625d3c-1e95-441e-b6d7-c83ff9e958a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:10:09.963870 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac625d3c-1e95-441e-b6d7-c83ff9e958a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:09.965576 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac625d3c-1e95-441e-b6d7-c83ff9e958a7 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:09.982907 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1080/2160] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:10:09.985949 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6c761-1245-4db0-a35c-39e0a8347417 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:09.998696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6c761-1245-4db0-a35c-39e0a8347417 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:10.004310 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8454f0-1a35-4915-bb7c-2246640a9bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:10.005357 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8454f0-1a35-4915-bb7c-2246640a9bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:10.005798 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8454f0-1a35-4915-bb7c-2246640a9bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:10.006335 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8454f0-1a35-4915-bb7c-2246640a9bf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:10.007335 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8454f0-1a35-4915-bb7c-2246640a9bf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:10.009403 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8454f0-1a35-4915-bb7c-2246640a9bf2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:10.043808 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1081/2161] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:10:09 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:10:10.048533 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac625d3c-1e95-441e-b6d7-c83ff9e958a7 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:10.059337 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac625d3c-1e95-441e-b6d7-c83ff9e958a7 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:10.159710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a981fa7-062b-4acd-89ac-7a719c9461c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:10.160412 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a981fa7-062b-4acd-89ac-7a719c9461c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:10.160729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a981fa7-062b-4acd-89ac-7a719c9461c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:10.160978 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a981fa7-062b-4acd-89ac-7a719c9461c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:10.162192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a981fa7-062b-4acd-89ac-7a719c9461c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:10.164243 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a981fa7-062b-4acd-89ac-7a719c9461c8 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:10.195837 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1081/2162] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:10:10 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:10:10.200333 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8454f0-1a35-4915-bb7c-2246640a9bf2 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:10.213896 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8454f0-1a35-4915-bb7c-2246640a9bf2 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:10.223252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf1458-35c6-4095-9960-e4dfc9861221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:10.225123 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf1458-35c6-4095-9960-e4dfc9861221 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:10.225745 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf1458-35c6-4095-9960-e4dfc9861221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:10.227295 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf1458-35c6-4095-9960-e4dfc9861221 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:10.228747 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf1458-35c6-4095-9960-e4dfc9861221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:10.233182 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf1458-35c6-4095-9960-e4dfc9861221 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:10.249583 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1082/2163] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:10:10.253838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a981fa7-062b-4acd-89ac-7a719c9461c8 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:10.269855 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a981fa7-062b-4acd-89ac-7a719c9461c8 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:10.279856 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fa2d0-9df7-4330-a5f0-c1e0f31ab787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:10.281010 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fa2d0-9df7-4330-a5f0-c1e0f31ab787 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:10.281421 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fa2d0-9df7-4330-a5f0-c1e0f31ab787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:10.281805 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fa2d0-9df7-4330-a5f0-c1e0f31ab787 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:10.282742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fa2d0-9df7-4330-a5f0-c1e0f31ab787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:10.285334 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fa2d0-9df7-4330-a5f0-c1e0f31ab787 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:10.302377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1082/2164] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:10:10.311900 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf1458-35c6-4095-9960-e4dfc9861221 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:10.323106 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf1458-35c6-4095-9960-e4dfc9861221 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:10.329397 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c94270-17c7-456c-86af-5711468a85bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:10.330444 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c94270-17c7-456c-86af-5711468a85bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:10.330846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c94270-17c7-456c-86af-5711468a85bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:10.331198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c94270-17c7-456c-86af-5711468a85bc admin admin] PATH_INFO: `/v3/projects/7cee2fd01e2c47f493ed863342258761/users/7907cef503ef42ddb7fc86e0c249c91a/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:10.347207 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c94270-17c7-456c-86af-5711468a85bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cee2fd01e2c47f493ed863342258761, user_id=7907cef503ef42ddb7fc86e0c249c91a, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:10.349972 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c94270-17c7-456c-86af-5711468a85bc admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:10.373754 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1083/2165] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:10:10 2022] PUT /identity/v3/projects/7cee2fd01e2c47f493ed863342258761/users/7907cef503ef42ddb7fc86e0c249c91a/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:10:10.384843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f27dc2-0110-48d9-a9cc-c5951bb8eb91 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:10.385404 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f27dc2-0110-48d9-a9cc-c5951bb8eb91 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:10.385718 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f27dc2-0110-48d9-a9cc-c5951bb8eb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:10.415496 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-89f27dc2-0110-48d9-a9cc-c5951bb8eb91 None None] MFA Rules not processed for user `7907cef503ef42ddb7fc86e0c249c91a`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:10.416931 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-89f27dc2-0110-48d9-a9cc-c5951bb8eb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:10.492958 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1083/2166] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:10.497724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c94270-17c7-456c-86af-5711468a85bc admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:10.578911 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c94270-17c7-456c-86af-5711468a85bc admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:10.583803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a44fad-e501-43c4-99d9-e931a410e0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:10.584469 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a44fad-e501-43c4-99d9-e931a410e0ba admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:10.584759 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a44fad-e501-43c4-99d9-e931a410e0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:10.585052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a44fad-e501-43c4-99d9-e931a410e0ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:10.585751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a44fad-e501-43c4-99d9-e931a410e0ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:10.587707 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a44fad-e501-43c4-99d9-e931a410e0ba admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:10.616007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1084/2167] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:10:10 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:10:10.620029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f27dc2-0110-48d9-a9cc-c5951bb8eb91 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:10.630660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f27dc2-0110-48d9-a9cc-c5951bb8eb91 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:10.674202 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:10.686312 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd96a0-4fa1-45dd-8baa-01ebc49a3a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:10.687404 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd96a0-4fa1-45dd-8baa-01ebc49a3a25 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:10.687845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd96a0-4fa1-45dd-8baa-01ebc49a3a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:10.688204 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd96a0-4fa1-45dd-8baa-01ebc49a3a25 admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:10.688711 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd96a0-4fa1-45dd-8baa-01ebc49a3a25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:10.691153 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd96a0-4fa1-45dd-8baa-01ebc49a3a25 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:10.714622 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1084/2168] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:10:10 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:10:10.719052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a44fad-e501-43c4-99d9-e931a410e0ba admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:10.729556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a44fad-e501-43c4-99d9-e931a410e0ba admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:10.734962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a094e-6f42-40a2-b7fa-506c289cc8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:10.735651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a094e-6f42-40a2-b7fa-506c289cc8db admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:10.735946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a094e-6f42-40a2-b7fa-506c289cc8db admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:10.736239 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a094e-6f42-40a2-b7fa-506c289cc8db admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:10.737009 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a094e-6f42-40a2-b7fa-506c289cc8db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:10.738718 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a094e-6f42-40a2-b7fa-506c289cc8db admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:10.741232 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:10.752408 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1085/2169] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:10:10.755779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd96a0-4fa1-45dd-8baa-01ebc49a3a25 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:10.767369 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd96a0-4fa1-45dd-8baa-01ebc49a3a25 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:10.772348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cba5e7-c7f7-49ad-a892-13877889d952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:10.773023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cba5e7-c7f7-49ad-a892-13877889d952 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:10.773339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cba5e7-c7f7-49ad-a892-13877889d952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:10.773755 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cba5e7-c7f7-49ad-a892-13877889d952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:10.774526 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cba5e7-c7f7-49ad-a892-13877889d952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:10.776137 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cba5e7-c7f7-49ad-a892-13877889d952 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:10.789086 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1085/2170] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:10:10.791301 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a094e-6f42-40a2-b7fa-506c289cc8db admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:10.802050 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a094e-6f42-40a2-b7fa-506c289cc8db admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:10.806683 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88156641-9871-4faa-838b-4ff5596794c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:10.807571 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88156641-9871-4faa-838b-4ff5596794c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:10.807853 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88156641-9871-4faa-838b-4ff5596794c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:10.808131 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88156641-9871-4faa-838b-4ff5596794c1 admin admin] PATH_INFO: `/v3/projects/6c3c95e5a22c4b0db5333c6cd6625729/users/813c5f0aa20241f7a79d68a002542c88/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:10.823093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88156641-9871-4faa-838b-4ff5596794c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c3c95e5a22c4b0db5333c6cd6625729, user_id=813c5f0aa20241f7a79d68a002542c88, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:10.825855 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88156641-9871-4faa-838b-4ff5596794c1 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:10.839619 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1086/2171] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:10:10 2022] PUT /identity/v3/projects/6c3c95e5a22c4b0db5333c6cd6625729/users/813c5f0aa20241f7a79d68a002542c88/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:10.850108 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23be57-b021-4af8-943b-a0f1d12ea3b6 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:10.850684 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23be57-b021-4af8-943b-a0f1d12ea3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:10.850684 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23be57-b021-4af8-943b-a0f1d12ea3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:10.877571 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-df23be57-b021-4af8-943b-a0f1d12ea3b6 None None] MFA Rules not processed for user `813c5f0aa20241f7a79d68a002542c88`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:10.878836 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-df23be57-b021-4af8-943b-a0f1d12ea3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:10.962985 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1086/2172] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:10.965689 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88156641-9871-4faa-838b-4ff5596794c1 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:11.035941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88156641-9871-4faa-838b-4ff5596794c1 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:11.041240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf87a64-af5a-4f61-9612-cff5bc7f5f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:11.041928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf87a64-af5a-4f61-9612-cff5bc7f5f24 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:11.042479 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf87a64-af5a-4f61-9612-cff5bc7f5f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:11.042817 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf87a64-af5a-4f61-9612-cff5bc7f5f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:11.043518 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf87a64-af5a-4f61-9612-cff5bc7f5f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:11.045464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf87a64-af5a-4f61-9612-cff5bc7f5f24 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:11.077022 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1087/2173] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:10:10 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:10:11.078106 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23be57-b021-4af8-943b-a0f1d12ea3b6 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:11.090739 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23be57-b021-4af8-943b-a0f1d12ea3b6 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:11.152655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac7002-0d9a-437c-9508-b55a4d776f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:11.153329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac7002-0d9a-437c-9508-b55a4d776f93 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:11.153609 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac7002-0d9a-437c-9508-b55a4d776f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:11.153957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac7002-0d9a-437c-9508-b55a4d776f93 admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:11.155222 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac7002-0d9a-437c-9508-b55a4d776f93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:11.157169 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac7002-0d9a-437c-9508-b55a4d776f93 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:11.176890 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1087/2174] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:10:11 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:10:11.181039 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf87a64-af5a-4f61-9612-cff5bc7f5f24 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:11.191725 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf87a64-af5a-4f61-9612-cff5bc7f5f24 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:11.196758 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc3a88-c38a-412d-ac2d-e052b0455e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:11.197542 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc3a88-c38a-412d-ac2d-e052b0455e5b admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:11.197838 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc3a88-c38a-412d-ac2d-e052b0455e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:11.198119 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc3a88-c38a-412d-ac2d-e052b0455e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:11.198911 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc3a88-c38a-412d-ac2d-e052b0455e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:11.200527 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc3a88-c38a-412d-ac2d-e052b0455e5b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:11.212635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1088/2175] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:10:11.218021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac7002-0d9a-437c-9508-b55a4d776f93 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:11.228619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac7002-0d9a-437c-9508-b55a4d776f93 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:11.233521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa91025-fff7-434e-9bba-1659e851e289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:11.234539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa91025-fff7-434e-9bba-1659e851e289 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:11.234904 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa91025-fff7-434e-9bba-1659e851e289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:11.235256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa91025-fff7-434e-9bba-1659e851e289 admin admin] PATH_INFO: `/v3/projects/bf1cdabbb51e4c3cbb3a7c2c7a5a3062/users/4cc7e92736fb44c8a72ce5eaa5ec6316/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:11.250894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa91025-fff7-434e-9bba-1659e851e289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf1cdabbb51e4c3cbb3a7c2c7a5a3062, user_id=4cc7e92736fb44c8a72ce5eaa5ec6316, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:11.253593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa91025-fff7-434e-9bba-1659e851e289 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:11.270218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1088/2176] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:10:11 2022] PUT /identity/v3/projects/bf1cdabbb51e4c3cbb3a7c2c7a5a3062/users/4cc7e92736fb44c8a72ce5eaa5ec6316/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:11.274146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc3a88-c38a-412d-ac2d-e052b0455e5b admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:11.287351 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc3a88-c38a-412d-ac2d-e052b0455e5b admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:11.355676 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8c333-c67d-4d94-8d4d-f43e19d7bf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:11.356271 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8c333-c67d-4d94-8d4d-f43e19d7bf3c admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:11.356558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8c333-c67d-4d94-8d4d-f43e19d7bf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:11.356836 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8c333-c67d-4d94-8d4d-f43e19d7bf3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:11.357613 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8c333-c67d-4d94-8d4d-f43e19d7bf3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:11.359234 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8c333-c67d-4d94-8d4d-f43e19d7bf3c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:11.374375 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1089/2177] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:10:11.382790 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa91025-fff7-434e-9bba-1659e851e289 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:11.394169 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa91025-fff7-434e-9bba-1659e851e289 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:11.398924 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30994d2a-f834-4d74-b203-2c9863a2e9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:11.399857 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30994d2a-f834-4d74-b203-2c9863a2e9c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:11.400161 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30994d2a-f834-4d74-b203-2c9863a2e9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:11.400424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30994d2a-f834-4d74-b203-2c9863a2e9c8 admin admin] PATH_INFO: `/v3/projects/bf1cdabbb51e4c3cbb3a7c2c7a5a3062/users/4cc7e92736fb44c8a72ce5eaa5ec6316/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:11.402475 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30994d2a-f834-4d74-b203-2c9863a2e9c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf1cdabbb51e4c3cbb3a7c2c7a5a3062, user_id=4cc7e92736fb44c8a72ce5eaa5ec6316, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:11.405224 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30994d2a-f834-4d74-b203-2c9863a2e9c8 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:11.416050 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1089/2178] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:10:11 2022] PUT /identity/v3/projects/bf1cdabbb51e4c3cbb3a7c2c7a5a3062/users/4cc7e92736fb44c8a72ce5eaa5ec6316/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:11.426653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e584c-1bb3-4c7f-9697-7ada49752f49 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:11.426950 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e584c-1bb3-4c7f-9697-7ada49752f49 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:11.427238 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e584c-1bb3-4c7f-9697-7ada49752f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:11.455725 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-2f9e584c-1bb3-4c7f-9697-7ada49752f49 None None] MFA Rules not processed for user `4cc7e92736fb44c8a72ce5eaa5ec6316`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:11.456309 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2f9e584c-1bb3-4c7f-9697-7ada49752f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:11.493452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:11.533409 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1090/2179] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:11.546899 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30994d2a-f834-4d74-b203-2c9863a2e9c8 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:11.548659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-30994d2a-f834-4d74-b203-2c9863a2e9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:11.560089 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:11.608819 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30994d2a-f834-4d74-b203-2c9863a2e9c8 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:11.612534 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053e525-5519-43c6-8824-bad4ec840eec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:11.613195 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053e525-5519-43c6-8824-bad4ec840eec service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:11.613485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053e525-5519-43c6-8824-bad4ec840eec service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:11.613766 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053e525-5519-43c6-8824-bad4ec840eec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:11.673266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053e525-5519-43c6-8824-bad4ec840eec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:11.675164 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053e525-5519-43c6-8824-bad4ec840eec service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:11.687454 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1090/2180] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:10:12.156373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e584c-1bb3-4c7f-9697-7ada49752f49 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:12.158219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2f9e584c-1bb3-4c7f-9697-7ada49752f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:12.228614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e584c-1bb3-4c7f-9697-7ada49752f49 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:12.234297 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c077a7-7782-4e14-8b11-c6842a06c6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:12.235218 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c077a7-7782-4e14-8b11-c6842a06c6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:12.235501 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c077a7-7782-4e14-8b11-c6842a06c6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:12.235804 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c077a7-7782-4e14-8b11-c6842a06c6c6 admin admin] PATH_INFO: `/v3/users/481b05687b4649f2b51974246431d62b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:12.237248 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c077a7-7782-4e14-8b11-c6842a06c6c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=481b05687b4649f2b51974246431d62b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:12.239601 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c077a7-7782-4e14-8b11-c6842a06c6c6 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:12.293034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-09c077a7-7782-4e14-8b11-c6842a06c6c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '481b05687b4649f2b51974246431d62b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:12.303075 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-09c077a7-7782-4e14-8b11-c6842a06c6c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '481b05687b4649f2b51974246431d62b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:12.310250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-09c077a7-7782-4e14-8b11-c6842a06c6c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '481b05687b4649f2b51974246431d62b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:12.323658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-09c077a7-7782-4e14-8b11-c6842a06c6c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '481b05687b4649f2b51974246431d62b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:12.324346 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-09c077a7-7782-4e14-8b11-c6842a06c6c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '481b05687b4649f2b51974246431d62b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:12.332546 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1091/2181] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:10:12 2022] DELETE /identity/v3/users/481b05687b4649f2b51974246431d62b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:12.337136 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f365869-3f33-4a48-9f57-39efa5e114fc None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:12.337673 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f365869-3f33-4a48-9f57-39efa5e114fc None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:12.338262 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f365869-3f33-4a48-9f57-39efa5e114fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:12.362002 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-2f365869-3f33-4a48-9f57-39efa5e114fc None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:12.363256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-2f365869-3f33-4a48-9f57-39efa5e114fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:12.432070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1091/2182] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:12.442246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c077a7-7782-4e14-8b11-c6842a06c6c6 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:12.443857 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-09c077a7-7782-4e14-8b11-c6842a06c6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:12.506064 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:12.511018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c077a7-7782-4e14-8b11-c6842a06c6c6 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:12.516409 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a16cee-839c-4cfe-b2c2-28870e4cc68e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:12.517113 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a16cee-839c-4cfe-b2c2-28870e4cc68e service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:12.517406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a16cee-839c-4cfe-b2c2-28870e4cc68e service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:12.517688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a16cee-839c-4cfe-b2c2-28870e4cc68e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:12.532057 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a16cee-839c-4cfe-b2c2-28870e4cc68e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:12.533509 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a16cee-839c-4cfe-b2c2-28870e4cc68e service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:12.546243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1092/2183] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:10:12.885824 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f365869-3f33-4a48-9f57-39efa5e114fc None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:12.887368 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-2f365869-3f33-4a48-9f57-39efa5e114fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:12.905601 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f365869-3f33-4a48-9f57-39efa5e114fc None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:12.911278 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d70a4d-bfed-4efa-bd52-2b5d5aaf595f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:12.912174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d70a4d-bfed-4efa-bd52-2b5d5aaf595f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:12.912464 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d70a4d-bfed-4efa-bd52-2b5d5aaf595f admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:12.912757 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d70a4d-bfed-4efa-bd52-2b5d5aaf595f admin admin] PATH_INFO: `/v3/projects/e2c2265a4a014551abf5b3a37be849e5` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:12.914021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d70a4d-bfed-4efa-bd52-2b5d5aaf595f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2c2265a4a014551abf5b3a37be849e5)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:12.915991 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d70a4d-bfed-4efa-bd52-2b5d5aaf595f admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:12.983797 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-92d70a4d-bfed-4efa-bd52-2b5d5aaf595f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2c2265a4a014551abf5b3a37be849e5', 'request_id': 'req-92d70a4d-bfed-4efa-bd52-2b5d5aaf595f'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:12.992635 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-92d70a4d-bfed-4efa-bd52-2b5d5aaf595f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2c2265a4a014551abf5b3a37be849e5', 'request_id': 'req-92d70a4d-bfed-4efa-bd52-2b5d5aaf595f'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:12.998423 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:13.001069 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-92d70a4d-bfed-4efa-bd52-2b5d5aaf595f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2c2265a4a014551abf5b3a37be849e5', 'request_id': 'req-92d70a4d-bfed-4efa-bd52-2b5d5aaf595f'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:13.019653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-92d70a4d-bfed-4efa-bd52-2b5d5aaf595f admin admin] The token cache is being invalidate because project e2c2265a4a014551abf5b3a37be849e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:10:13.019952 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-92d70a4d-bfed-4efa-bd52-2b5d5aaf595f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:13.020750 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-92d70a4d-bfed-4efa-bd52-2b5d5aaf595f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:13.022321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1092/2184] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:10:12 2022] DELETE /identity/v3/projects/e2c2265a4a014551abf5b3a37be849e5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:13.027080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a16cee-839c-4cfe-b2c2-28870e4cc68e service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:13.037670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a16cee-839c-4cfe-b2c2-28870e4cc68e service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:13.109975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c593f-a5cd-4667-bab2-ac108937491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:13.111387 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c593f-a5cd-4667-bab2-ac108937491c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:13.111387 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c593f-a5cd-4667-bab2-ac108937491c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:13.111558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c593f-a5cd-4667-bab2-ac108937491c admin admin] PATH_INFO: `/v3/users/df28ec642ab947edb805c01118cdac2a` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:13.112739 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c593f-a5cd-4667-bab2-ac108937491c admin admin] RBAC: Authorizing `identity:delete_user(user_id=df28ec642ab947edb805c01118cdac2a)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:13.114884 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c593f-a5cd-4667-bab2-ac108937491c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:13.169224 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1b6c593f-a5cd-4667-bab2-ac108937491c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df28ec642ab947edb805c01118cdac2a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:13.180351 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1b6c593f-a5cd-4667-bab2-ac108937491c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df28ec642ab947edb805c01118cdac2a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:13.189200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1b6c593f-a5cd-4667-bab2-ac108937491c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df28ec642ab947edb805c01118cdac2a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:13.203000 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1b6c593f-a5cd-4667-bab2-ac108937491c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df28ec642ab947edb805c01118cdac2a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:13.203736 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1b6c593f-a5cd-4667-bab2-ac108937491c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df28ec642ab947edb805c01118cdac2a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:13.204877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d70a4d-bfed-4efa-bd52-2b5d5aaf595f admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:13.206718 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-92d70a4d-bfed-4efa-bd52-2b5d5aaf595f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:13.210034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1093/2185] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:10:13 2022] DELETE /identity/v3/users/df28ec642ab947edb805c01118cdac2a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:13.273453 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d70a4d-bfed-4efa-bd52-2b5d5aaf595f admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:13.324918 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89ee0c-9337-4488-ad17-4ab5286dbe4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:13.325555 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89ee0c-9337-4488-ad17-4ab5286dbe4c service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:13.326384 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89ee0c-9337-4488-ad17-4ab5286dbe4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:13.326712 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89ee0c-9337-4488-ad17-4ab5286dbe4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:13.328665 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-2b89ee0c-9337-4488-ad17-4ab5286dbe4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:13.398093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89ee0c-9337-4488-ad17-4ab5286dbe4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:13.399612 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89ee0c-9337-4488-ad17-4ab5286dbe4c service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:13.410917 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1093/2186] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:10:13.514817 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c593f-a5cd-4667-bab2-ac108937491c admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:13.516637 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1b6c593f-a5cd-4667-bab2-ac108937491c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:13.603713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c593f-a5cd-4667-bab2-ac108937491c admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:13.608595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add267cd-04c2-4c82-bb2a-8a05a3661bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:13.609488 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add267cd-04c2-4c82-bb2a-8a05a3661bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:13.609778 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add267cd-04c2-4c82-bb2a-8a05a3661bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:13.610067 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add267cd-04c2-4c82-bb2a-8a05a3661bb0 admin admin] PATH_INFO: `/v3/projects/a02d4a165a304d4b8d4336c282f10b9a` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:13.611370 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add267cd-04c2-4c82-bb2a-8a05a3661bb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a02d4a165a304d4b8d4336c282f10b9a)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:13.613354 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add267cd-04c2-4c82-bb2a-8a05a3661bb0 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:13.631783 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:13.710288 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-add267cd-04c2-4c82-bb2a-8a05a3661bb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a02d4a165a304d4b8d4336c282f10b9a', 'request_id': 'req-add267cd-04c2-4c82-bb2a-8a05a3661bb0'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:13.718790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-add267cd-04c2-4c82-bb2a-8a05a3661bb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a02d4a165a304d4b8d4336c282f10b9a', 'request_id': 'req-add267cd-04c2-4c82-bb2a-8a05a3661bb0'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:13.731027 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-add267cd-04c2-4c82-bb2a-8a05a3661bb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a02d4a165a304d4b8d4336c282f10b9a', 'request_id': 'req-add267cd-04c2-4c82-bb2a-8a05a3661bb0'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:13.755573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-add267cd-04c2-4c82-bb2a-8a05a3661bb0 admin admin] The token cache is being invalidate because project a02d4a165a304d4b8d4336c282f10b9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:10:13.755874 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-add267cd-04c2-4c82-bb2a-8a05a3661bb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:13.756678 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-add267cd-04c2-4c82-bb2a-8a05a3661bb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:13.758527 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1094/2187] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:10:13 2022] DELETE /identity/v3/projects/a02d4a165a304d4b8d4336c282f10b9a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:13.765258 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d00db7-a5e9-445b-b65a-a663c1a35bd0 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:13.765886 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d00db7-a5e9-445b-b65a-a663c1a35bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:13.766213 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d00db7-a5e9-445b-b65a-a663c1a35bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:13.786434 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-c0d00db7-a5e9-445b-b65a-a663c1a35bd0 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:13.787700 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-c0d00db7-a5e9-445b-b65a-a663c1a35bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:13.849512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:13.864576 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1094/2188] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:13.872400 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda8d8a-b311-475a-9d50-2b0e98c078c7 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:13.873202 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda8d8a-b311-475a-9d50-2b0e98c078c7 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:13.873492 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda8d8a-b311-475a-9d50-2b0e98c078c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:13.892552 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-bfda8d8a-b311-475a-9d50-2b0e98c078c7 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:13.893759 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-bfda8d8a-b311-475a-9d50-2b0e98c078c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:13.901977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1095/2189] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:13.906246 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d00db7-a5e9-445b-b65a-a663c1a35bd0 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:13.916180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d00db7-a5e9-445b-b65a-a663c1a35bd0 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:13.921640 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe85a0-b11c-40a7-935a-e2fc680e2edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:13.922301 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe85a0-b11c-40a7-935a-e2fc680e2edf admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:13.922620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe85a0-b11c-40a7-935a-e2fc680e2edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:13.922899 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe85a0-b11c-40a7-935a-e2fc680e2edf admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:13.923624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe85a0-b11c-40a7-935a-e2fc680e2edf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:10:13.923931 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe85a0-b11c-40a7-935a-e2fc680e2edf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:13.925532 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe85a0-b11c-40a7-935a-e2fc680e2edf admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:13.941392 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1095/2190] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:10:13.945800 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda8d8a-b311-475a-9d50-2b0e98c078c7 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:13.955878 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda8d8a-b311-475a-9d50-2b0e98c078c7 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:13.961637 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98108136-764f-4789-9831-1912e2873fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:13.962686 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98108136-764f-4789-9831-1912e2873fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:13.962976 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98108136-764f-4789-9831-1912e2873fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:13.963254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98108136-764f-4789-9831-1912e2873fa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:13.963949 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98108136-764f-4789-9831-1912e2873fa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:13.966028 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98108136-764f-4789-9831-1912e2873fa0 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:14.003007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1096/2191] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:10:13 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:10:14.007509 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe85a0-b11c-40a7-935a-e2fc680e2edf admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:14.019692 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe85a0-b11c-40a7-935a-e2fc680e2edf admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:14.094755 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e8360-83e6-4bb3-9212-01d059e8bdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:14.095684 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e8360-83e6-4bb3-9212-01d059e8bdb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:14.095989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e8360-83e6-4bb3-9212-01d059e8bdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:14.096277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e8360-83e6-4bb3-9212-01d059e8bdb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:14.097001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e8360-83e6-4bb3-9212-01d059e8bdb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:14.099028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e8360-83e6-4bb3-9212-01d059e8bdb3 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:14.126860 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1096/2192] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:10:14 2022] POST /identity/v3/users => generated 296 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:10:14.131690 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98108136-764f-4789-9831-1912e2873fa0 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:14.142996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98108136-764f-4789-9831-1912e2873fa0 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:14.148093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702890f-64a5-4642-85df-7fb3dbc5556b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:14.148790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702890f-64a5-4642-85df-7fb3dbc5556b admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:14.149087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702890f-64a5-4642-85df-7fb3dbc5556b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:14.149350 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702890f-64a5-4642-85df-7fb3dbc5556b admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:14.150108 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702890f-64a5-4642-85df-7fb3dbc5556b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:14.151784 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702890f-64a5-4642-85df-7fb3dbc5556b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:14.166117 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1097/2193] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:10:14.170855 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e8360-83e6-4bb3-9212-01d059e8bdb3 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:14.185226 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e8360-83e6-4bb3-9212-01d059e8bdb3 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:14.192428 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a440d17-fa04-431d-a4ab-c6dc44bc41f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:14.193134 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a440d17-fa04-431d-a4ab-c6dc44bc41f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:14.193441 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a440d17-fa04-431d-a4ab-c6dc44bc41f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:14.193725 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a440d17-fa04-431d-a4ab-c6dc44bc41f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:14.194530 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a440d17-fa04-431d-a4ab-c6dc44bc41f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:14.196204 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a440d17-fa04-431d-a4ab-c6dc44bc41f7 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:14.215263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1097/2194] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:10:14.220011 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702890f-64a5-4642-85df-7fb3dbc5556b admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:14.235498 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a440d17-fa04-431d-a4ab-c6dc44bc41f7 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:14.236913 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702890f-64a5-4642-85df-7fb3dbc5556b admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:14.237520 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-9a440d17-fa04-431d-a4ab-c6dc44bc41f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:14.242919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b4e97-3178-4bb1-aa0a-ad0769d5d303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:14.244395 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b4e97-3178-4bb1-aa0a-ad0769d5d303 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:14.244870 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b4e97-3178-4bb1-aa0a-ad0769d5d303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:14.245282 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b4e97-3178-4bb1-aa0a-ad0769d5d303 admin admin] PATH_INFO: `/v3/projects/dd38a7800b644e52bec3dc60f9967334/users/aaa61e0dc9b348879a819ce2bdf991c0/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:14.269517 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b4e97-3178-4bb1-aa0a-ad0769d5d303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd38a7800b644e52bec3dc60f9967334, user_id=aaa61e0dc9b348879a819ce2bdf991c0, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:14.274604 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b4e97-3178-4bb1-aa0a-ad0769d5d303 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:14.294271 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1098/2195] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:10:14 2022] PUT /identity/v3/projects/dd38a7800b644e52bec3dc60f9967334/users/aaa61e0dc9b348879a819ce2bdf991c0/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:10:14.307342 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df6f2c-3f30-46a2-9cfd-7b692698c43d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:14.307704 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df6f2c-3f30-46a2-9cfd-7b692698c43d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:14.308051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df6f2c-3f30-46a2-9cfd-7b692698c43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:14.316515 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a440d17-fa04-431d-a4ab-c6dc44bc41f7 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:14.343037 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-d1df6f2c-3f30-46a2-9cfd-7b692698c43d None None] MFA Rules not processed for user `aaa61e0dc9b348879a819ce2bdf991c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:14.344298 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d1df6f2c-3f30-46a2-9cfd-7b692698c43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:14.377687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68311cdb-273a-45db-8c65-aed6b5ff8cb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:14.378858 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68311cdb-273a-45db-8c65-aed6b5ff8cb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:14.379317 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68311cdb-273a-45db-8c65-aed6b5ff8cb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:14.379952 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68311cdb-273a-45db-8c65-aed6b5ff8cb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:14.382986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-68311cdb-273a-45db-8c65-aed6b5ff8cb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:14.429550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1099/2196] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:14.433810 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:14.434328 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df6f2c-3f30-46a2-9cfd-7b692698c43d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:14.467826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:14.483450 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68311cdb-273a-45db-8c65-aed6b5ff8cb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:14.484923 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68311cdb-273a-45db-8c65-aed6b5ff8cb2 service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:14.497047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1098/2197] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:10:14.527738 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df6f2c-3f30-46a2-9cfd-7b692698c43d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:14.534423 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb3bec-64a2-42f4-b52d-7fa903b0e6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:14.535217 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb3bec-64a2-42f4-b52d-7fa903b0e6a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:14.535510 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb3bec-64a2-42f4-b52d-7fa903b0e6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:14.535827 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb3bec-64a2-42f4-b52d-7fa903b0e6a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:14.536654 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb3bec-64a2-42f4-b52d-7fa903b0e6a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:14.538788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb3bec-64a2-42f4-b52d-7fa903b0e6a6 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:14.572623 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1100/2198] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:10:14 2022] POST /identity/v3/projects => generated 391 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:10:14.573863 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68311cdb-273a-45db-8c65-aed6b5ff8cb2 service cinder] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:14.584948 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68311cdb-273a-45db-8c65-aed6b5ff8cb2 service cinder] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:14.652369 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fa98d-d32d-43d9-a134-e24333b7e858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:14.653039 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fa98d-d32d-43d9-a134-e24333b7e858 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:14.653325 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fa98d-d32d-43d9-a134-e24333b7e858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:14.653603 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fa98d-d32d-43d9-a134-e24333b7e858 admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:14.654883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263fa98d-d32d-43d9-a134-e24333b7e858 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:14.656829 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263fa98d-d32d-43d9-a134-e24333b7e858 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:14.680613 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1099/2199] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:10:14 2022] POST /identity/v3/users => generated 302 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:10:14.681796 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb3bec-64a2-42f4-b52d-7fa903b0e6a6 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:14.692578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb3bec-64a2-42f4-b52d-7fa903b0e6a6 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:14.701279 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bd44f-09c8-4936-9175-e6d47cafce2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:14.701279 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bd44f-09c8-4936-9175-e6d47cafce2e admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:14.701279 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bd44f-09c8-4936-9175-e6d47cafce2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:14.701279 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bd44f-09c8-4936-9175-e6d47cafce2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:14.702342 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031bd44f-09c8-4936-9175-e6d47cafce2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:14.704988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031bd44f-09c8-4936-9175-e6d47cafce2e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:14.733782 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1101/2200] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:10:14.735075 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fa98d-d32d-43d9-a134-e24333b7e858 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:14.749592 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fa98d-d32d-43d9-a134-e24333b7e858 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:14.755674 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f9e0e-ad36-412d-9c66-e06bbbdb35cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:14.756966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f9e0e-ad36-412d-9c66-e06bbbdb35cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:14.757337 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f9e0e-ad36-412d-9c66-e06bbbdb35cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:14.757627 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f9e0e-ad36-412d-9c66-e06bbbdb35cf admin admin] PATH_INFO: `/v3/projects/c035dc9820b141c3bf84f892790405bc/users/95508769fa724af097d7b0f693b99e3a/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:14.781347 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f9e0e-ad36-412d-9c66-e06bbbdb35cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c035dc9820b141c3bf84f892790405bc, user_id=95508769fa724af097d7b0f693b99e3a, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:14.785023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f9e0e-ad36-412d-9c66-e06bbbdb35cf admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:14.804160 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1100/2201] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:10:14 2022] PUT /identity/v3/projects/c035dc9820b141c3bf84f892790405bc/users/95508769fa724af097d7b0f693b99e3a/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:10:14.810359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bd44f-09c8-4936-9175-e6d47cafce2e admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:14.831100 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bd44f-09c8-4936-9175-e6d47cafce2e admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:14.930824 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0852b65-58f8-4ef2-a696-8bd276ccb50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:14.931512 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0852b65-58f8-4ef2-a696-8bd276ccb50a admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:14.931795 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0852b65-58f8-4ef2-a696-8bd276ccb50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:14.932281 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0852b65-58f8-4ef2-a696-8bd276ccb50a admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:14.933034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0852b65-58f8-4ef2-a696-8bd276ccb50a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:14.935731 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0852b65-58f8-4ef2-a696-8bd276ccb50a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:14.954982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1102/2202] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:10:14.957798 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f9e0e-ad36-412d-9c66-e06bbbdb35cf admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:14.972609 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f9e0e-ad36-412d-9c66-e06bbbdb35cf admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:14.977936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c6ee5-1ba2-420e-89c5-ff8106c2144f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:14.979283 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c6ee5-1ba2-420e-89c5-ff8106c2144f admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:14.979568 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c6ee5-1ba2-420e-89c5-ff8106c2144f admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:14.979848 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c6ee5-1ba2-420e-89c5-ff8106c2144f admin admin] PATH_INFO: `/v3/projects/c035dc9820b141c3bf84f892790405bc/users/95508769fa724af097d7b0f693b99e3a/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:14.981991 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c6ee5-1ba2-420e-89c5-ff8106c2144f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c035dc9820b141c3bf84f892790405bc, user_id=95508769fa724af097d7b0f693b99e3a, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:14.984964 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c6ee5-1ba2-420e-89c5-ff8106c2144f admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:14.998634 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1101/2203] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:10:14 2022] PUT /identity/v3/projects/c035dc9820b141c3bf84f892790405bc/users/95508769fa724af097d7b0f693b99e3a/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:15.010253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f097917-027f-4170-ba41-98c807a705ff None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:15.010692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f097917-027f-4170-ba41-98c807a705ff None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:15.011042 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f097917-027f-4170-ba41-98c807a705ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:15.043140 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-9f097917-027f-4170-ba41-98c807a705ff None None] MFA Rules not processed for user `95508769fa724af097d7b0f693b99e3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:15.045938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9f097917-027f-4170-ba41-98c807a705ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:15.137250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1103/2204] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:15.149402 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c6ee5-1ba2-420e-89c5-ff8106c2144f admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:15.151257 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-c02c6ee5-1ba2-420e-89c5-ff8106c2144f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:15.214545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c6ee5-1ba2-420e-89c5-ff8106c2144f admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:15.218375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594f39e-1a17-434c-b2b0-db38fb844951 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:15.219108 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594f39e-1a17-434c-b2b0-db38fb844951 service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:15.219411 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594f39e-1a17-434c-b2b0-db38fb844951 service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:15.219692 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594f39e-1a17-434c-b2b0-db38fb844951 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:15.230406 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594f39e-1a17-434c-b2b0-db38fb844951 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:15.232034 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594f39e-1a17-434c-b2b0-db38fb844951 service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:15.243565 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1102/2205] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:10:15.291169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f097917-027f-4170-ba41-98c807a705ff None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:15.302005 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f097917-027f-4170-ba41-98c807a705ff None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:15.306372 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b70666-22e4-473b-a3e9-f3356a572ecd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:15.307642 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b70666-22e4-473b-a3e9-f3356a572ecd service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:15.308045 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b70666-22e4-473b-a3e9-f3356a572ecd service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:15.308330 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b70666-22e4-473b-a3e9-f3356a572ecd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:15.330692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:15.383397 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b70666-22e4-473b-a3e9-f3356a572ecd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:15.384800 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b70666-22e4-473b-a3e9-f3356a572ecd service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:15.395611 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1104/2206] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:10:19.712194 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594f39e-1a17-434c-b2b0-db38fb844951 service cinder] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:19.713576 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-3594f39e-1a17-434c-b2b0-db38fb844951 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:19.743090 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:19.783536 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594f39e-1a17-434c-b2b0-db38fb844951 service cinder] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:19.788565 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648accba-a33f-4c66-a2cd-3d868b54a861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:19.789504 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648accba-a33f-4c66-a2cd-3d868b54a861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:19.789709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648accba-a33f-4c66-a2cd-3d868b54a861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:19.789984 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648accba-a33f-4c66-a2cd-3d868b54a861 admin admin] PATH_INFO: `/v3/users/7907cef503ef42ddb7fc86e0c249c91a` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:19.791491 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648accba-a33f-4c66-a2cd-3d868b54a861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7907cef503ef42ddb7fc86e0c249c91a)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:19.793776 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648accba-a33f-4c66-a2cd-3d868b54a861 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:19.855614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-648accba-a33f-4c66-a2cd-3d868b54a861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7907cef503ef42ddb7fc86e0c249c91a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:19.863649 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-648accba-a33f-4c66-a2cd-3d868b54a861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7907cef503ef42ddb7fc86e0c249c91a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:19.864423 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-648accba-a33f-4c66-a2cd-3d868b54a861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7907cef503ef42ddb7fc86e0c249c91a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:19.878377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-648accba-a33f-4c66-a2cd-3d868b54a861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7907cef503ef42ddb7fc86e0c249c91a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:19.879175 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-648accba-a33f-4c66-a2cd-3d868b54a861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7907cef503ef42ddb7fc86e0c249c91a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:19.893103 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1103/2207] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:10:19 2022] DELETE /identity/v3/users/7907cef503ef42ddb7fc86e0c249c91a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:19.897977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a8024-ff5f-4564-8562-bc3be224f02b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:19.898477 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a8024-ff5f-4564-8562-bc3be224f02b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:19.898679 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a8024-ff5f-4564-8562-bc3be224f02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:19.925494 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-d30a8024-ff5f-4564-8562-bc3be224f02b None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:19.925494 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d30a8024-ff5f-4564-8562-bc3be224f02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:19.927909 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648accba-a33f-4c66-a2cd-3d868b54a861 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:19.931532 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-648accba-a33f-4c66-a2cd-3d868b54a861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:20.008248 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1105/2208] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:20.024442 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648accba-a33f-4c66-a2cd-3d868b54a861 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:20.026156 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a8024-ff5f-4564-8562-bc3be224f02b None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:20.029367 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d30a8024-ff5f-4564-8562-bc3be224f02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:20.030538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493c61f-2609-4aaa-9e8c-573119718d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:20.031478 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493c61f-2609-4aaa-9e8c-573119718d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:20.031799 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493c61f-2609-4aaa-9e8c-573119718d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:20.033447 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493c61f-2609-4aaa-9e8c-573119718d33 admin admin] PATH_INFO: `/v3/users/aaa61e0dc9b348879a819ce2bdf991c0` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:20.034994 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493c61f-2609-4aaa-9e8c-573119718d33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaa61e0dc9b348879a819ce2bdf991c0)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:20.036986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493c61f-2609-4aaa-9e8c-573119718d33 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:20.101275 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:20.104479 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-d493c61f-2609-4aaa-9e8c-573119718d33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaa61e0dc9b348879a819ce2bdf991c0'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:20.116779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-d493c61f-2609-4aaa-9e8c-573119718d33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaa61e0dc9b348879a819ce2bdf991c0'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:20.118019 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-d493c61f-2609-4aaa-9e8c-573119718d33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaa61e0dc9b348879a819ce2bdf991c0'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:20.140770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-d493c61f-2609-4aaa-9e8c-573119718d33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaa61e0dc9b348879a819ce2bdf991c0'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:20.140942 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a8024-ff5f-4564-8562-bc3be224f02b None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:20.142653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-d493c61f-2609-4aaa-9e8c-573119718d33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaa61e0dc9b348879a819ce2bdf991c0'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:20.150854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d1b8d-0845-477b-b3d0-0af15e5ff93f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:20.151554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d1b8d-0845-477b-b3d0-0af15e5ff93f service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:20.151843 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d1b8d-0845-477b-b3d0-0af15e5ff93f service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:20.152170 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d1b8d-0845-477b-b3d0-0af15e5ff93f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:20.155569 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3b5d1b8d-0845-477b-b3d0-0af15e5ff93f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:20.166165 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1104/2209] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:10:19 2022] DELETE /identity/v3/users/aaa61e0dc9b348879a819ce2bdf991c0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:20.172031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe1d6b-a0a7-47d9-865a-39d1de9813ae None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:20.172333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe1d6b-a0a7-47d9-865a-39d1de9813ae None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:20.172619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe1d6b-a0a7-47d9-865a-39d1de9813ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:20.182171 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d1b8d-0845-477b-b3d0-0af15e5ff93f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:20.183726 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d1b8d-0845-477b-b3d0-0af15e5ff93f service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:20.195784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-d2fe1d6b-a0a7-47d9-865a-39d1de9813ae None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:20.197468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-d2fe1d6b-a0a7-47d9-865a-39d1de9813ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:20.200750 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1106/2210] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:10:20.281231 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1105/2211] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:10:20.294140 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d1b8d-0845-477b-b3d0-0af15e5ff93f service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:20.296389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3b5d1b8d-0845-477b-b3d0-0af15e5ff93f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:20.308631 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d1b8d-0845-477b-b3d0-0af15e5ff93f service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:20.368677 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5732a15-5b35-4490-b647-62079840cdbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:20.369248 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5732a15-5b35-4490-b647-62079840cdbd service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:20.369540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5732a15-5b35-4490-b647-62079840cdbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:20.369819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5732a15-5b35-4490-b647-62079840cdbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:20.383745 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5732a15-5b35-4490-b647-62079840cdbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:20.385758 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5732a15-5b35-4490-b647-62079840cdbd service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:20.399190 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1107/2212] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:10:20.603169 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe1d6b-a0a7-47d9-865a-39d1de9813ae None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:20.604588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-d2fe1d6b-a0a7-47d9-865a-39d1de9813ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:20.618227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe1d6b-a0a7-47d9-865a-39d1de9813ae None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:20.623105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17051f37-3a94-46c9-a63a-c059fa195ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:20.623899 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17051f37-3a94-46c9-a63a-c059fa195ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:20.624187 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17051f37-3a94-46c9-a63a-c059fa195ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:20.624463 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17051f37-3a94-46c9-a63a-c059fa195ac5 admin admin] PATH_INFO: `/v3/projects/7cee2fd01e2c47f493ed863342258761` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:20.625989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17051f37-3a94-46c9-a63a-c059fa195ac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cee2fd01e2c47f493ed863342258761)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:20.627956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17051f37-3a94-46c9-a63a-c059fa195ac5 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:20.726196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-17051f37-3a94-46c9-a63a-c059fa195ac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cee2fd01e2c47f493ed863342258761', 'request_id': 'req-17051f37-3a94-46c9-a63a-c059fa195ac5'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:20.740859 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-17051f37-3a94-46c9-a63a-c059fa195ac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cee2fd01e2c47f493ed863342258761', 'request_id': 'req-17051f37-3a94-46c9-a63a-c059fa195ac5'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:20.755989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-17051f37-3a94-46c9-a63a-c059fa195ac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cee2fd01e2c47f493ed863342258761', 'request_id': 'req-17051f37-3a94-46c9-a63a-c059fa195ac5'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:20.778038 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-17051f37-3a94-46c9-a63a-c059fa195ac5 admin admin] The token cache is being invalidate because project 7cee2fd01e2c47f493ed863342258761 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:10:20.778841 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-17051f37-3a94-46c9-a63a-c059fa195ac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:20.780716 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-17051f37-3a94-46c9-a63a-c059fa195ac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:20.786591 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1106/2213] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:10:20 2022] DELETE /identity/v3/projects/7cee2fd01e2c47f493ed863342258761 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:20.789353 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5732a15-5b35-4490-b647-62079840cdbd service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:20.801380 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5732a15-5b35-4490-b647-62079840cdbd service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:20.805891 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:20.824096 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17051f37-3a94-46c9-a63a-c059fa195ac5 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:20.826424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-17051f37-3a94-46c9-a63a-c059fa195ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:20.902788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa5a02-f428-44df-9348-c281d14d30ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:20.904879 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa5a02-f428-44df-9348-c281d14d30ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:20.906817 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa5a02-f428-44df-9348-c281d14d30ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:20.907309 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa5a02-f428-44df-9348-c281d14d30ae admin admin] PATH_INFO: `/v3/users/813c5f0aa20241f7a79d68a002542c88` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:20.909001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa5a02-f428-44df-9348-c281d14d30ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=813c5f0aa20241f7a79d68a002542c88)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:20.911017 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa5a02-f428-44df-9348-c281d14d30ae admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:20.937938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:20.967730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17051f37-3a94-46c9-a63a-c059fa195ac5 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:20.976753 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868258a-4edc-457a-91e5-35cfc4b79266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:20.977727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868258a-4edc-457a-91e5-35cfc4b79266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:20.978052 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868258a-4edc-457a-91e5-35cfc4b79266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:20.978339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868258a-4edc-457a-91e5-35cfc4b79266 admin admin] PATH_INFO: `/v3/projects/dd38a7800b644e52bec3dc60f9967334` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:20.979855 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-e3fa5a02-f428-44df-9348-c281d14d30ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '813c5f0aa20241f7a79d68a002542c88'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:20.984585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868258a-4edc-457a-91e5-35cfc4b79266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd38a7800b644e52bec3dc60f9967334)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:20.987147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868258a-4edc-457a-91e5-35cfc4b79266 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:20.989591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-e3fa5a02-f428-44df-9348-c281d14d30ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '813c5f0aa20241f7a79d68a002542c88'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:20.999189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-e3fa5a02-f428-44df-9348-c281d14d30ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '813c5f0aa20241f7a79d68a002542c88'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.013657 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-e3fa5a02-f428-44df-9348-c281d14d30ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '813c5f0aa20241f7a79d68a002542c88'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.014447 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-e3fa5a02-f428-44df-9348-c281d14d30ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '813c5f0aa20241f7a79d68a002542c88'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.021125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1108/2214] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:10:20 2022] DELETE /identity/v3/users/813c5f0aa20241f7a79d68a002542c88 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:10:21.044341 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-f868258a-4edc-457a-91e5-35cfc4b79266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd38a7800b644e52bec3dc60f9967334', 'request_id': 'req-f868258a-4edc-457a-91e5-35cfc4b79266'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.053128 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-f868258a-4edc-457a-91e5-35cfc4b79266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd38a7800b644e52bec3dc60f9967334', 'request_id': 'req-f868258a-4edc-457a-91e5-35cfc4b79266'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.059729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-f868258a-4edc-457a-91e5-35cfc4b79266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd38a7800b644e52bec3dc60f9967334', 'request_id': 'req-f868258a-4edc-457a-91e5-35cfc4b79266'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.073993 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-f868258a-4edc-457a-91e5-35cfc4b79266 admin admin] The token cache is being invalidate because project dd38a7800b644e52bec3dc60f9967334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:10:21.074474 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-f868258a-4edc-457a-91e5-35cfc4b79266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.075401 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-f868258a-4edc-457a-91e5-35cfc4b79266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.077795 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1107/2215] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:10:20 2022] DELETE /identity/v3/projects/dd38a7800b644e52bec3dc60f9967334 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:21.081895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa5a02-f428-44df-9348-c281d14d30ae admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:21.083799 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e3fa5a02-f428-44df-9348-c281d14d30ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:21.165363 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa5a02-f428-44df-9348-c281d14d30ae admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:21.204756 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:21.245378 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d96833-edee-41ed-9d3c-104a94b372e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:21.246419 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d96833-edee-41ed-9d3c-104a94b372e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:21.246831 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d96833-edee-41ed-9d3c-104a94b372e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:21.248097 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d96833-edee-41ed-9d3c-104a94b372e7 admin admin] PATH_INFO: `/v3/users/95508769fa724af097d7b0f693b99e3a` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:21.250718 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d96833-edee-41ed-9d3c-104a94b372e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95508769fa724af097d7b0f693b99e3a)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:21.255744 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d96833-edee-41ed-9d3c-104a94b372e7 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:21.336374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-40d96833-edee-41ed-9d3c-104a94b372e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95508769fa724af097d7b0f693b99e3a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.346299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868258a-4edc-457a-91e5-35cfc4b79266 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:21.348100 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-40d96833-edee-41ed-9d3c-104a94b372e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95508769fa724af097d7b0f693b99e3a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.348714 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-f868258a-4edc-457a-91e5-35cfc4b79266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:21.358300 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-40d96833-edee-41ed-9d3c-104a94b372e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95508769fa724af097d7b0f693b99e3a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.367113 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868258a-4edc-457a-91e5-35cfc4b79266 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:21.372990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b674f-1a6c-48af-8918-4c7ee8e73ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:21.374246 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b674f-1a6c-48af-8918-4c7ee8e73ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:21.374559 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b674f-1a6c-48af-8918-4c7ee8e73ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:21.374847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b674f-1a6c-48af-8918-4c7ee8e73ce8 admin admin] PATH_INFO: `/v3/projects/6c3c95e5a22c4b0db5333c6cd6625729` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:21.376247 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b674f-1a6c-48af-8918-4c7ee8e73ce8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c3c95e5a22c4b0db5333c6cd6625729)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:21.378319 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b674f-1a6c-48af-8918-4c7ee8e73ce8 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:21.381360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-40d96833-edee-41ed-9d3c-104a94b372e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95508769fa724af097d7b0f693b99e3a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.382945 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-40d96833-edee-41ed-9d3c-104a94b372e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95508769fa724af097d7b0f693b99e3a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.392441 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1109/2216] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:10:21 2022] DELETE /identity/v3/users/95508769fa724af097d7b0f693b99e3a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:21.446462 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-720b674f-1a6c-48af-8918-4c7ee8e73ce8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c3c95e5a22c4b0db5333c6cd6625729', 'request_id': 'req-720b674f-1a6c-48af-8918-4c7ee8e73ce8'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.454719 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-720b674f-1a6c-48af-8918-4c7ee8e73ce8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c3c95e5a22c4b0db5333c6cd6625729', 'request_id': 'req-720b674f-1a6c-48af-8918-4c7ee8e73ce8'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.462617 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-720b674f-1a6c-48af-8918-4c7ee8e73ce8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c3c95e5a22c4b0db5333c6cd6625729', 'request_id': 'req-720b674f-1a6c-48af-8918-4c7ee8e73ce8'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.480540 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-720b674f-1a6c-48af-8918-4c7ee8e73ce8 admin admin] The token cache is being invalidate because project 6c3c95e5a22c4b0db5333c6cd6625729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:10:21.480866 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-720b674f-1a6c-48af-8918-4c7ee8e73ce8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.481770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-720b674f-1a6c-48af-8918-4c7ee8e73ce8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.484570 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1108/2217] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:10:21 2022] DELETE /identity/v3/projects/6c3c95e5a22c4b0db5333c6cd6625729 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:10:21.488564 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d96833-edee-41ed-9d3c-104a94b372e7 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:21.490472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-40d96833-edee-41ed-9d3c-104a94b372e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:21.572833 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d96833-edee-41ed-9d3c-104a94b372e7 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:21.642273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07b0cf-0241-43cd-8dcc-6bd7df25a4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:21.643199 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07b0cf-0241-43cd-8dcc-6bd7df25a4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:21.643493 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07b0cf-0241-43cd-8dcc-6bd7df25a4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:21.643778 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07b0cf-0241-43cd-8dcc-6bd7df25a4fe admin admin] PATH_INFO: `/v3/users/4cc7e92736fb44c8a72ce5eaa5ec6316` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:21.645134 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07b0cf-0241-43cd-8dcc-6bd7df25a4fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cc7e92736fb44c8a72ce5eaa5ec6316)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:21.647140 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07b0cf-0241-43cd-8dcc-6bd7df25a4fe admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:21.649138 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:21.713644 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5a07b0cf-0241-43cd-8dcc-6bd7df25a4fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cc7e92736fb44c8a72ce5eaa5ec6316'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.719342 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b674f-1a6c-48af-8918-4c7ee8e73ce8 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:21.721981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-720b674f-1a6c-48af-8918-4c7ee8e73ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:21.741974 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b674f-1a6c-48af-8918-4c7ee8e73ce8 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:21.748544 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c1043-ca3e-42b8-9e87-7de57e886584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:21.748741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5a07b0cf-0241-43cd-8dcc-6bd7df25a4fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cc7e92736fb44c8a72ce5eaa5ec6316'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.749642 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c1043-ca3e-42b8-9e87-7de57e886584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:21.749818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c1043-ca3e-42b8-9e87-7de57e886584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:21.750288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c1043-ca3e-42b8-9e87-7de57e886584 admin admin] PATH_INFO: `/v3/projects/c035dc9820b141c3bf84f892790405bc` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:21.753447 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c1043-ca3e-42b8-9e87-7de57e886584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c035dc9820b141c3bf84f892790405bc)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:21.755575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c1043-ca3e-42b8-9e87-7de57e886584 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:21.756914 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5a07b0cf-0241-43cd-8dcc-6bd7df25a4fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cc7e92736fb44c8a72ce5eaa5ec6316'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.773874 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5a07b0cf-0241-43cd-8dcc-6bd7df25a4fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cc7e92736fb44c8a72ce5eaa5ec6316'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.775433 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-5a07b0cf-0241-43cd-8dcc-6bd7df25a4fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cc7e92736fb44c8a72ce5eaa5ec6316'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.782940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1110/2218] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:10:21 2022] DELETE /identity/v3/users/4cc7e92736fb44c8a72ce5eaa5ec6316 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:21.821926 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e44c1043-ca3e-42b8-9e87-7de57e886584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c035dc9820b141c3bf84f892790405bc', 'request_id': 'req-e44c1043-ca3e-42b8-9e87-7de57e886584'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.833405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e44c1043-ca3e-42b8-9e87-7de57e886584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c035dc9820b141c3bf84f892790405bc', 'request_id': 'req-e44c1043-ca3e-42b8-9e87-7de57e886584'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.836563 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:21.851467 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e44c1043-ca3e-42b8-9e87-7de57e886584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c035dc9820b141c3bf84f892790405bc', 'request_id': 'req-e44c1043-ca3e-42b8-9e87-7de57e886584'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.889029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e44c1043-ca3e-42b8-9e87-7de57e886584 admin admin] The token cache is being invalidate because project c035dc9820b141c3bf84f892790405bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:10:21.889463 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e44c1043-ca3e-42b8-9e87-7de57e886584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.890689 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e44c1043-ca3e-42b8-9e87-7de57e886584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:21.893456 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1109/2219] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:10:21 2022] DELETE /identity/v3/projects/c035dc9820b141c3bf84f892790405bc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:10:21.898699 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7a7a2-4454-43a5-b200-a19367fc0ee3 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:21.898983 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7a7a2-4454-43a5-b200-a19367fc0ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:21.899818 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7a7a2-4454-43a5-b200-a19367fc0ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:21.920833 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-0fd7a7a2-4454-43a5-b200-a19367fc0ee3 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:21.922227 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0fd7a7a2-4454-43a5-b200-a19367fc0ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:22.007236 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1111/2220] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:22.015280 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789eddf2-ed68-42ba-a02b-0aee4c3d9baa None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:22.015779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789eddf2-ed68-42ba-a02b-0aee4c3d9baa None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:22.016232 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789eddf2-ed68-42ba-a02b-0aee4c3d9baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:22.042341 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-789eddf2-ed68-42ba-a02b-0aee4c3d9baa None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:22.044189 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-789eddf2-ed68-42ba-a02b-0aee4c3d9baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:22.055970 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1110/2221] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:10:22.067776 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7a7a2-4454-43a5-b200-a19367fc0ee3 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:22.080491 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7a7a2-4454-43a5-b200-a19367fc0ee3 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:22.086120 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1881d66-8bae-4558-9178-f0862d6807bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:22.086956 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1881d66-8bae-4558-9178-f0862d6807bd admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:22.087219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1881d66-8bae-4558-9178-f0862d6807bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:22.087717 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1881d66-8bae-4558-9178-f0862d6807bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:22.088547 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1881d66-8bae-4558-9178-f0862d6807bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:10:22.089009 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1881d66-8bae-4558-9178-f0862d6807bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:22.090887 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1881d66-8bae-4558-9178-f0862d6807bd admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:22.105201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1112/2222] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:10:22.112545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789eddf2-ed68-42ba-a02b-0aee4c3d9baa None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:22.125902 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789eddf2-ed68-42ba-a02b-0aee4c3d9baa None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:22.139439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a44dfe-0c44-4770-ba9f-9a17288ecc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:22.140758 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a44dfe-0c44-4770-ba9f-9a17288ecc95 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:22.141530 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a44dfe-0c44-4770-ba9f-9a17288ecc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:22.142202 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a44dfe-0c44-4770-ba9f-9a17288ecc95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:22.147435 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a44dfe-0c44-4770-ba9f-9a17288ecc95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:22.151405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a44dfe-0c44-4770-ba9f-9a17288ecc95 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:22.158614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1881d66-8bae-4558-9178-f0862d6807bd admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:22.161841 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a1881d66-8bae-4558-9178-f0862d6807bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:22.188053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1881d66-8bae-4558-9178-f0862d6807bd admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:22.196055 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000fde3-0cf3-4090-b616-7fe0f9411e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:22.197296 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000fde3-0cf3-4090-b616-7fe0f9411e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:22.197758 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000fde3-0cf3-4090-b616-7fe0f9411e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:22.198272 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000fde3-0cf3-4090-b616-7fe0f9411e98 admin admin] PATH_INFO: `/v3/projects/bf1cdabbb51e4c3cbb3a7c2c7a5a3062` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:22.199901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000fde3-0cf3-4090-b616-7fe0f9411e98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf1cdabbb51e4c3cbb3a7c2c7a5a3062)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:22.202984 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000fde3-0cf3-4090-b616-7fe0f9411e98 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:22.210381 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1111/2223] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:10:22 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:10:22.216218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a44dfe-0c44-4770-ba9f-9a17288ecc95 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:22.283802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a000fde3-0cf3-4090-b616-7fe0f9411e98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf1cdabbb51e4c3cbb3a7c2c7a5a3062', 'request_id': 'req-a000fde3-0cf3-4090-b616-7fe0f9411e98'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:22.294047 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a000fde3-0cf3-4090-b616-7fe0f9411e98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf1cdabbb51e4c3cbb3a7c2c7a5a3062', 'request_id': 'req-a000fde3-0cf3-4090-b616-7fe0f9411e98'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:22.299767 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:22.301425 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a000fde3-0cf3-4090-b616-7fe0f9411e98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf1cdabbb51e4c3cbb3a7c2c7a5a3062', 'request_id': 'req-a000fde3-0cf3-4090-b616-7fe0f9411e98'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:22.342681 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a000fde3-0cf3-4090-b616-7fe0f9411e98 admin admin] The token cache is being invalidate because project bf1cdabbb51e4c3cbb3a7c2c7a5a3062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:10:22.343777 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a000fde3-0cf3-4090-b616-7fe0f9411e98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:22.346384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a000fde3-0cf3-4090-b616-7fe0f9411e98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:22.350925 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1113/2224] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:10:22 2022] DELETE /identity/v3/projects/bf1cdabbb51e4c3cbb3a7c2c7a5a3062 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:22.357956 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db45358-9910-48f6-881f-d8da617d09c4 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:22.358377 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db45358-9910-48f6-881f-d8da617d09c4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:22.358781 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db45358-9910-48f6-881f-d8da617d09c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:22.395004 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a44dfe-0c44-4770-ba9f-9a17288ecc95 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:22.402366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-8db45358-9910-48f6-881f-d8da617d09c4 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:22.404855 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8db45358-9910-48f6-881f-d8da617d09c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:22.482350 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8985a4-7ccd-4ee3-8dce-545c80877acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:22.483068 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8985a4-7ccd-4ee3-8dce-545c80877acb admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:22.483357 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8985a4-7ccd-4ee3-8dce-545c80877acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:22.483635 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8985a4-7ccd-4ee3-8dce-545c80877acb admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:22.484471 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8985a4-7ccd-4ee3-8dce-545c80877acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:22.484732 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1114/2225] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:22.487218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8985a4-7ccd-4ee3-8dce-545c80877acb admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:22.492884 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa890fe-1ac7-4294-ae3b-a794bd28f3ed None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:22.493200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa890fe-1ac7-4294-ae3b-a794bd28f3ed None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:22.493613 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa890fe-1ac7-4294-ae3b-a794bd28f3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:22.512226 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1112/2226] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:10:22 2022] POST /identity/v3/users => generated 289 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:10:22.516118 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6fa890fe-1ac7-4294-ae3b-a794bd28f3ed None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:22.517415 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8985a4-7ccd-4ee3-8dce-545c80877acb admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:22.517633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6fa890fe-1ac7-4294-ae3b-a794bd28f3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:22.523488 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-9a8985a4-7ccd-4ee3-8dce-545c80877acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:22.528298 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1115/2227] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:10:22.533728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa890fe-1ac7-4294-ae3b-a794bd28f3ed None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:22.545495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8985a4-7ccd-4ee3-8dce-545c80877acb admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:22.549959 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa890fe-1ac7-4294-ae3b-a794bd28f3ed None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:22.554022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9a9ee-c988-406c-86f1-807e905935cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:22.555125 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9a9ee-c988-406c-86f1-807e905935cf admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:22.555571 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9a9ee-c988-406c-86f1-807e905935cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:22.556045 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9a9ee-c988-406c-86f1-807e905935cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:22.557315 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9a9ee-c988-406c-86f1-807e905935cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:22.558148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14acf08-8117-44b5-94da-7776bd57e624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:22.559406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14acf08-8117-44b5-94da-7776bd57e624 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:22.560633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14acf08-8117-44b5-94da-7776bd57e624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:22.560802 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9a9ee-c988-406c-86f1-807e905935cf admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:22.561418 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14acf08-8117-44b5-94da-7776bd57e624 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:22.562991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14acf08-8117-44b5-94da-7776bd57e624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:10:22.563696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14acf08-8117-44b5-94da-7776bd57e624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:22.566869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14acf08-8117-44b5-94da-7776bd57e624 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:22.580399 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1113/2228] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:10:22.585143 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9a9ee-c988-406c-86f1-807e905935cf admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:22.587247 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1116/2229] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:10:22.591369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14acf08-8117-44b5-94da-7776bd57e624 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:22.598161 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9a9ee-c988-406c-86f1-807e905935cf admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:22.604388 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091aa5c7-9502-4b1a-9165-cc76addc4923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:22.605052 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091aa5c7-9502-4b1a-9165-cc76addc4923 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:22.605330 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091aa5c7-9502-4b1a-9165-cc76addc4923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:22.606602 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091aa5c7-9502-4b1a-9165-cc76addc4923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:22.606774 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14acf08-8117-44b5-94da-7776bd57e624 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:22.606913 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091aa5c7-9502-4b1a-9165-cc76addc4923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:22.609508 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091aa5c7-9502-4b1a-9165-cc76addc4923 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:22.613145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6fb5c-ee51-48a6-8bcc-7d504142b811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:22.614382 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6fb5c-ee51-48a6-8bcc-7d504142b811 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:22.614742 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6fb5c-ee51-48a6-8bcc-7d504142b811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:22.615060 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6fb5c-ee51-48a6-8bcc-7d504142b811 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:22.615785 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6fb5c-ee51-48a6-8bcc-7d504142b811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:22.618003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6fb5c-ee51-48a6-8bcc-7d504142b811 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:22.620690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1114/2230] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:10:22.625289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091aa5c7-9502-4b1a-9165-cc76addc4923 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:22.639038 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091aa5c7-9502-4b1a-9165-cc76addc4923 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:22.643927 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e14110-aa11-415b-985d-ac209fa00a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:22.644884 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e14110-aa11-415b-985d-ac209fa00a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:22.645154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e14110-aa11-415b-985d-ac209fa00a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:22.645436 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e14110-aa11-415b-985d-ac209fa00a53 admin admin] PATH_INFO: `/v3/projects/6ed95082bb1c418e95ab330c1d2c50da/users/4298ec08b40c44678cd7dbbb145939f1/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:22.663277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e14110-aa11-415b-985d-ac209fa00a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed95082bb1c418e95ab330c1d2c50da, user_id=4298ec08b40c44678cd7dbbb145939f1, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:22.666276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e14110-aa11-415b-985d-ac209fa00a53 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:22.673863 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1117/2231] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:10:22 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:10:22.678790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6fb5c-ee51-48a6-8bcc-7d504142b811 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:22.687087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1115/2232] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:10:22 2022] PUT /identity/v3/projects/6ed95082bb1c418e95ab330c1d2c50da/users/4298ec08b40c44678cd7dbbb145939f1/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:10:22.697427 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d1eb4-b567-425e-b66e-65ceca7b9646 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:22.697721 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d1eb4-b567-425e-b66e-65ceca7b9646 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:22.697995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d1eb4-b567-425e-b66e-65ceca7b9646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:22.706863 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:DELETE=3,keystone:SELECT=91,keystone:INSERT=6 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:22.729642 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-e67d1eb4-b567-425e-b66e-65ceca7b9646 None None] MFA Rules not processed for user `4298ec08b40c44678cd7dbbb145939f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:22.731018 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e67d1eb4-b567-425e-b66e-65ceca7b9646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:22.790618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6fb5c-ee51-48a6-8bcc-7d504142b811 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:22.812265 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1116/2233] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:10:22.817031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d1eb4-b567-425e-b66e-65ceca7b9646 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:22.855176 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:22.866051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba62e88-8805-4d97-a1da-f50185403dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:22.867219 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba62e88-8805-4d97-a1da-f50185403dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:22.867898 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba62e88-8805-4d97-a1da-f50185403dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:22.867898 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba62e88-8805-4d97-a1da-f50185403dd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:22.868617 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba62e88-8805-4d97-a1da-f50185403dd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:22.870906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba62e88-8805-4d97-a1da-f50185403dd3 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:22.894263 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1118/2234] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:10:22 2022] POST /identity/v3/users => generated 286 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:10:22.894736 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d1eb4-b567-425e-b66e-65ceca7b9646 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:22.898900 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba62e88-8805-4d97-a1da-f50185403dd3 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:22.899666 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf6363-c505-4640-8895-ef45f73d84b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:22.900352 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf6363-c505-4640-8895-ef45f73d84b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:22.900639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf6363-c505-4640-8895-ef45f73d84b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:22.900916 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf6363-c505-4640-8895-ef45f73d84b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:22.901681 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf6363-c505-4640-8895-ef45f73d84b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:22.903703 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf6363-c505-4640-8895-ef45f73d84b4 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:22.909837 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba62e88-8805-4d97-a1da-f50185403dd3 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:22.915156 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdfe4e-473c-4e75-a5a4-227ae03bbba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:22.915845 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdfe4e-473c-4e75-a5a4-227ae03bbba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:22.916205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdfe4e-473c-4e75-a5a4-227ae03bbba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:22.916461 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdfe4e-473c-4e75-a5a4-227ae03bbba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:22.917410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bdfe4e-473c-4e75-a5a4-227ae03bbba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:22.919224 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bdfe4e-473c-4e75-a5a4-227ae03bbba4 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:22.936153 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1119/2235] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:10:22.936784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1117/2236] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:10:22 2022] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:10:22.937461 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdfe4e-473c-4e75-a5a4-227ae03bbba4 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:22.937606 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf6363-c505-4640-8895-ef45f73d84b4 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:22.947624 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdfe4e-473c-4e75-a5a4-227ae03bbba4 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:23.004645 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf6363-c505-4640-8895-ef45f73d84b4 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:23.010995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8db984-8ec7-4a10-8a7f-c13b0a274872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:23.011784 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8db984-8ec7-4a10-8a7f-c13b0a274872 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:23.012141 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8db984-8ec7-4a10-8a7f-c13b0a274872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:23.012576 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8db984-8ec7-4a10-8a7f-c13b0a274872 admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:23.013332 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8db984-8ec7-4a10-8a7f-c13b0a274872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:23.015602 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8db984-8ec7-4a10-8a7f-c13b0a274872 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:23.021012 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f45b9-365f-478c-9e3d-71f30e971df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:23.021999 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f45b9-365f-478c-9e3d-71f30e971df6 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:23.022291 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f45b9-365f-478c-9e3d-71f30e971df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:23.022605 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f45b9-365f-478c-9e3d-71f30e971df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:23.023377 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f45b9-365f-478c-9e3d-71f30e971df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:23.025046 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f45b9-365f-478c-9e3d-71f30e971df6 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:23.036627 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1120/2237] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:10:23.042287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1118/2238] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:10:22 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:10:23.042436 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f45b9-365f-478c-9e3d-71f30e971df6 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:23.044986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8db984-8ec7-4a10-8a7f-c13b0a274872 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:23.053889 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f45b9-365f-478c-9e3d-71f30e971df6 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:23.056357 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8db984-8ec7-4a10-8a7f-c13b0a274872 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:23.059369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8e71c-176e-4818-9352-fa571baba778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:23.060852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8e71c-176e-4818-9352-fa571baba778 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:23.061143 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8e71c-176e-4818-9352-fa571baba778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:23.061570 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8e71c-176e-4818-9352-fa571baba778 admin admin] PATH_INFO: `/v3/projects/200c30a4a1eb4f239b663c05fa815869/users/2b063941ac8448ad868375366cdb9267/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:23.062001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9252c-4cb3-4f96-8fcc-7d8b70886c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:23.062706 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9252c-4cb3-4f96-8fcc-7d8b70886c3b admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:23.063019 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9252c-4cb3-4f96-8fcc-7d8b70886c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:23.063300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9252c-4cb3-4f96-8fcc-7d8b70886c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:23.064047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9252c-4cb3-4f96-8fcc-7d8b70886c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:23.065691 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9252c-4cb3-4f96-8fcc-7d8b70886c3b admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:23.073492 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:23.079148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1119/2239] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:10:23.083164 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9252c-4cb3-4f96-8fcc-7d8b70886c3b admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:23.083975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8e71c-176e-4818-9352-fa571baba778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=200c30a4a1eb4f239b663c05fa815869, user_id=2b063941ac8448ad868375366cdb9267, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:23.087207 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8e71c-176e-4818-9352-fa571baba778 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:23.095253 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9252c-4cb3-4f96-8fcc-7d8b70886c3b admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:23.103083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1121/2240] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:10:23 2022] PUT /identity/v3/projects/200c30a4a1eb4f239b663c05fa815869/users/2b063941ac8448ad868375366cdb9267/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:23.114475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696661f3-c2fc-4faf-9cff-1acd3c76a662 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:23.114921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696661f3-c2fc-4faf-9cff-1acd3c76a662 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:23.115198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696661f3-c2fc-4faf-9cff-1acd3c76a662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:23.149939 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-696661f3-c2fc-4faf-9cff-1acd3c76a662 None None] MFA Rules not processed for user `2b063941ac8448ad868375366cdb9267`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:23.151111 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-696661f3-c2fc-4faf-9cff-1acd3c76a662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:23.182476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4d95a-a694-47ee-8725-4e74b3e541c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:23.183417 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4d95a-a694-47ee-8725-4e74b3e541c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:23.183702 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4d95a-a694-47ee-8725-4e74b3e541c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:23.183980 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4d95a-a694-47ee-8725-4e74b3e541c4 admin admin] PATH_INFO: `/v3/projects/b8001cded0514d4f9317fe5091bc53b2/users/1d4eb199289e46ee9566cdd88a1fb0d4/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:23.201916 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4d95a-a694-47ee-8725-4e74b3e541c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8001cded0514d4f9317fe5091bc53b2, user_id=1d4eb199289e46ee9566cdd88a1fb0d4, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:23.204918 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4d95a-a694-47ee-8725-4e74b3e541c4 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:23.220657 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1120/2241] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:10:23 2022] PUT /identity/v3/projects/b8001cded0514d4f9317fe5091bc53b2/users/1d4eb199289e46ee9566cdd88a1fb0d4/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:10:23.227084 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4d95a-a694-47ee-8725-4e74b3e541c4 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:23.236889 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1122/2242] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:10:23.249507 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696661f3-c2fc-4faf-9cff-1acd3c76a662 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:23.250993 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-696661f3-c2fc-4faf-9cff-1acd3c76a662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:23.314871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:23.322735 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4d95a-a694-47ee-8725-4e74b3e541c4 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:23.328227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78116ae-d079-4a45-acc0-240ceab48966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:23.328912 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78116ae-d079-4a45-acc0-240ceab48966 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:23.329193 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78116ae-d079-4a45-acc0-240ceab48966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:23.329470 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78116ae-d079-4a45-acc0-240ceab48966 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:23.330214 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78116ae-d079-4a45-acc0-240ceab48966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:23.331961 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78116ae-d079-4a45-acc0-240ceab48966 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:23.341786 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696661f3-c2fc-4faf-9cff-1acd3c76a662 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:23.347493 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1121/2243] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:10:23.348800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78116ae-d079-4a45-acc0-240ceab48966 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:23.361388 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78116ae-d079-4a45-acc0-240ceab48966 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:23.367939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ca9d7-4138-4c9a-b388-71369bbb1b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:23.369363 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ca9d7-4138-4c9a-b388-71369bbb1b65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:23.370349 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ca9d7-4138-4c9a-b388-71369bbb1b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:23.370762 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ca9d7-4138-4c9a-b388-71369bbb1b65 admin admin] PATH_INFO: `/v3/projects/b8001cded0514d4f9317fe5091bc53b2/users/1d4eb199289e46ee9566cdd88a1fb0d4/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:23.373365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ca9d7-4138-4c9a-b388-71369bbb1b65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8001cded0514d4f9317fe5091bc53b2, user_id=1d4eb199289e46ee9566cdd88a1fb0d4, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:23.376264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ca9d7-4138-4c9a-b388-71369bbb1b65 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:23.397529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1122/2244] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:10:23 2022] PUT /identity/v3/projects/b8001cded0514d4f9317fe5091bc53b2/users/1d4eb199289e46ee9566cdd88a1fb0d4/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:23.412607 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e65b26-5950-458f-bde0-fb42f6cd2551 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:23.413635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e65b26-5950-458f-bde0-fb42f6cd2551 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:23.413986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e65b26-5950-458f-bde0-fb42f6cd2551 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:23.414338 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e65b26-5950-458f-bde0-fb42f6cd2551 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:23.415796 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0584df-d390-464a-a1d4-5f70418c3fd0 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:23.416651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0584df-d390-464a-a1d4-5f70418c3fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:23.417381 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0584df-d390-464a-a1d4-5f70418c3fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:23.465509 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-ce0584df-d390-464a-a1d4-5f70418c3fd0 None None] MFA Rules not processed for user `1d4eb199289e46ee9566cdd88a1fb0d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:23.468683 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ce0584df-d390-464a-a1d4-5f70418c3fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:23.524912 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e65b26-5950-458f-bde0-fb42f6cd2551 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:23.527103 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e65b26-5950-458f-bde0-fb42f6cd2551 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:23.537784 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1123/2245] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:10:23.548479 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:23.570292 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e65b26-5950-458f-bde0-fb42f6cd2551 service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:23.582041 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1123/2246] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:23.582241 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e65b26-5950-458f-bde0-fb42f6cd2551 service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:23.594610 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0584df-d390-464a-a1d4-5f70418c3fd0 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:23.662724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78699e82-804e-4bc4-a844-f3ce2f473531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:23.663630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78699e82-804e-4bc4-a844-f3ce2f473531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:23.663922 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78699e82-804e-4bc4-a844-f3ce2f473531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:23.664203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78699e82-804e-4bc4-a844-f3ce2f473531 admin admin] PATH_INFO: `/v3/users/2b063941ac8448ad868375366cdb9267` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:23.665627 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78699e82-804e-4bc4-a844-f3ce2f473531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b063941ac8448ad868375366cdb9267)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:23.667541 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0584df-d390-464a-a1d4-5f70418c3fd0 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:23.667891 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78699e82-804e-4bc4-a844-f3ce2f473531 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:23.672931 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b091a24-a7b6-4d69-b84d-a6360c4a8691 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:23.673722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b091a24-a7b6-4d69-b84d-a6360c4a8691 service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:23.674055 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b091a24-a7b6-4d69-b84d-a6360c4a8691 service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:23.674343 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b091a24-a7b6-4d69-b84d-a6360c4a8691 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:23.693810 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b091a24-a7b6-4d69-b84d-a6360c4a8691 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:23.695399 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b091a24-a7b6-4d69-b84d-a6360c4a8691 service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:23.708360 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1124/2247] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:10:23.736964 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-78699e82-804e-4bc4-a844-f3ce2f473531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b063941ac8448ad868375366cdb9267'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:23.742772 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:23.765221 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-78699e82-804e-4bc4-a844-f3ce2f473531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b063941ac8448ad868375366cdb9267'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:23.780530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-78699e82-804e-4bc4-a844-f3ce2f473531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b063941ac8448ad868375366cdb9267'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:23.800797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-78699e82-804e-4bc4-a844-f3ce2f473531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b063941ac8448ad868375366cdb9267'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:23.801719 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-78699e82-804e-4bc4-a844-f3ce2f473531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b063941ac8448ad868375366cdb9267'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:23.813288 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1124/2248] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:10:23 2022] DELETE /identity/v3/users/2b063941ac8448ad868375366cdb9267 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:10:23.819407 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ba95e-bbb1-47b0-8e19-1cd90a0f9d43 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:23.819941 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ba95e-bbb1-47b0-8e19-1cd90a0f9d43 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:23.820061 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ba95e-bbb1-47b0-8e19-1cd90a0f9d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:23.853653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-608ba95e-bbb1-47b0-8e19-1cd90a0f9d43 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:23.855838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-608ba95e-bbb1-47b0-8e19-1cd90a0f9d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:23.949885 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1125/2249] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:10:23.960159 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78699e82-804e-4bc4-a844-f3ce2f473531 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:23.962179 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-78699e82-804e-4bc4-a844-f3ce2f473531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:24.038733 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78699e82-804e-4bc4-a844-f3ce2f473531 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:24.042647 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43215b6c-b59a-4ff7-975f-44639d2751b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:24.043299 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43215b6c-b59a-4ff7-975f-44639d2751b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:24.043578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43215b6c-b59a-4ff7-975f-44639d2751b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:24.043878 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43215b6c-b59a-4ff7-975f-44639d2751b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:24.055559 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43215b6c-b59a-4ff7-975f-44639d2751b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:24.057160 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43215b6c-b59a-4ff7-975f-44639d2751b1 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:24.067905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1125/2250] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:10:24.197444 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ba95e-bbb1-47b0-8e19-1cd90a0f9d43 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:24.198931 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-608ba95e-bbb1-47b0-8e19-1cd90a0f9d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:24.210944 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ba95e-bbb1-47b0-8e19-1cd90a0f9d43 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:24.217015 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcbf4b-da8c-41f1-805a-cd88aa11125c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:24.217900 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcbf4b-da8c-41f1-805a-cd88aa11125c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:24.218204 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcbf4b-da8c-41f1-805a-cd88aa11125c admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:24.218470 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcbf4b-da8c-41f1-805a-cd88aa11125c admin admin] PATH_INFO: `/v3/users/4298ec08b40c44678cd7dbbb145939f1` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:24.219958 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dcbf4b-da8c-41f1-805a-cd88aa11125c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4298ec08b40c44678cd7dbbb145939f1)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:24.221816 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dcbf4b-da8c-41f1-805a-cd88aa11125c admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:24.287887 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-83dcbf4b-da8c-41f1-805a-cd88aa11125c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4298ec08b40c44678cd7dbbb145939f1'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:24.300985 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-83dcbf4b-da8c-41f1-805a-cd88aa11125c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4298ec08b40c44678cd7dbbb145939f1'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:24.301995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-83dcbf4b-da8c-41f1-805a-cd88aa11125c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4298ec08b40c44678cd7dbbb145939f1'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:24.323566 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-83dcbf4b-da8c-41f1-805a-cd88aa11125c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4298ec08b40c44678cd7dbbb145939f1'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:24.325052 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-83dcbf4b-da8c-41f1-805a-cd88aa11125c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4298ec08b40c44678cd7dbbb145939f1'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:24.349270 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1126/2251] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:10:24 2022] DELETE /identity/v3/users/4298ec08b40c44678cd7dbbb145939f1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:10:24.351064 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa580f-332e-44f1-a400-0fb742d28144 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:24.351364 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa580f-332e-44f1-a400-0fb742d28144 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:24.351651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa580f-332e-44f1-a400-0fb742d28144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:24.372592 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-46fa580f-332e-44f1-a400-0fb742d28144 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:24.374060 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-46fa580f-332e-44f1-a400-0fb742d28144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:24.416064 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcbf4b-da8c-41f1-805a-cd88aa11125c admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:24.417765 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-83dcbf4b-da8c-41f1-805a-cd88aa11125c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:24.426519 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:24.471822 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1126/2252] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:24.484597 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa580f-332e-44f1-a400-0fb742d28144 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:24.486656 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-46fa580f-332e-44f1-a400-0fb742d28144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:24.527177 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcbf4b-da8c-41f1-805a-cd88aa11125c admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:24.533020 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc030f7-e05d-4622-8257-7619786df83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:24.533997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc030f7-e05d-4622-8257-7619786df83d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:24.534353 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc030f7-e05d-4622-8257-7619786df83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:24.534660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc030f7-e05d-4622-8257-7619786df83d admin admin] PATH_INFO: `/v3/projects/200c30a4a1eb4f239b663c05fa815869` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:24.540681 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc030f7-e05d-4622-8257-7619786df83d admin admin] RBAC: Authorizing `identity:delete_project(project_id=200c30a4a1eb4f239b663c05fa815869)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:24.540681 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc030f7-e05d-4622-8257-7619786df83d admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:24.558444 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa580f-332e-44f1-a400-0fb742d28144 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:24.562569 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12271a-c566-4577-97c6-063237a5e802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:24.563241 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12271a-c566-4577-97c6-063237a5e802 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:24.563536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12271a-c566-4577-97c6-063237a5e802 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:24.563816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12271a-c566-4577-97c6-063237a5e802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:24.574466 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12271a-c566-4577-97c6-063237a5e802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:24.576460 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12271a-c566-4577-97c6-063237a5e802 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:24.586607 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1127/2253] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:10:24.588186 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ccc030f7-e05d-4622-8257-7619786df83d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '200c30a4a1eb4f239b663c05fa815869', 'request_id': 'req-ccc030f7-e05d-4622-8257-7619786df83d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:24.596919 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ccc030f7-e05d-4622-8257-7619786df83d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '200c30a4a1eb4f239b663c05fa815869', 'request_id': 'req-ccc030f7-e05d-4622-8257-7619786df83d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:24.603663 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ccc030f7-e05d-4622-8257-7619786df83d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '200c30a4a1eb4f239b663c05fa815869', 'request_id': 'req-ccc030f7-e05d-4622-8257-7619786df83d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:24.617389 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ccc030f7-e05d-4622-8257-7619786df83d admin admin] The token cache is being invalidate because project 200c30a4a1eb4f239b663c05fa815869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:10:24.617679 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ccc030f7-e05d-4622-8257-7619786df83d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:24.623043 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ccc030f7-e05d-4622-8257-7619786df83d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:24.628150 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1127/2254] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:10:24 2022] DELETE /identity/v3/projects/200c30a4a1eb4f239b663c05fa815869 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:10:24.630142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d942c1-2cc2-4d28-a837-84c5689c0bac None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:24.630542 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d942c1-2cc2-4d28-a837-84c5689c0bac None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:24.630892 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d942c1-2cc2-4d28-a837-84c5689c0bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:24.651554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-27d942c1-2cc2-4d28-a837-84c5689c0bac None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:24.652777 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-27d942c1-2cc2-4d28-a837-84c5689c0bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:24.666249 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:24.738797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1128/2255] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:24.741213 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c5827-d3fe-4872-ac15-fa3fff453196 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:24.741497 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c5827-d3fe-4872-ac15-fa3fff453196 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:24.741787 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c5827-d3fe-4872-ac15-fa3fff453196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:24.766238 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-453c5827-d3fe-4872-ac15-fa3fff453196 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:24.767548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-453c5827-d3fe-4872-ac15-fa3fff453196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:24.795746 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d942c1-2cc2-4d28-a837-84c5689c0bac None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:24.799518 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1128/2256] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:24.812102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d942c1-2cc2-4d28-a837-84c5689c0bac None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:24.817841 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85e074-c642-4a7a-b4be-b6fb0bea53ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:24.818560 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85e074-c642-4a7a-b4be-b6fb0bea53ca admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:24.818856 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85e074-c642-4a7a-b4be-b6fb0bea53ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:24.819140 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85e074-c642-4a7a-b4be-b6fb0bea53ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:24.820441 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85e074-c642-4a7a-b4be-b6fb0bea53ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:10:24.820441 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85e074-c642-4a7a-b4be-b6fb0bea53ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:24.822950 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85e074-c642-4a7a-b4be-b6fb0bea53ca admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:24.842545 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1129/2257] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:10:24.844702 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c5827-d3fe-4872-ac15-fa3fff453196 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:24.855446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c5827-d3fe-4872-ac15-fa3fff453196 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:24.867646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb778f2-3514-4b5d-8ed0-0fddb0b3a9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:24.867646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb778f2-3514-4b5d-8ed0-0fddb0b3a9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:24.867646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb778f2-3514-4b5d-8ed0-0fddb0b3a9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:24.867646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb778f2-3514-4b5d-8ed0-0fddb0b3a9f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:24.868244 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb778f2-3514-4b5d-8ed0-0fddb0b3a9f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:24.868244 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb778f2-3514-4b5d-8ed0-0fddb0b3a9f4 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:24.912053 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1129/2258] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:10:24 2022] POST /identity/v3/projects => generated 399 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:10:24.915989 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85e074-c642-4a7a-b4be-b6fb0bea53ca admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:24.927882 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85e074-c642-4a7a-b4be-b6fb0bea53ca admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:24.996545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb778f2-3514-4b5d-8ed0-0fddb0b3a9f4 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:24.999191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-9bb778f2-3514-4b5d-8ed0-0fddb0b3a9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:25.056284 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a7015-c0b9-4f1d-b9b1-85439620f1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:25.057412 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a7015-c0b9-4f1d-b9b1-85439620f1fc admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:25.057895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a7015-c0b9-4f1d-b9b1-85439620f1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:25.058329 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a7015-c0b9-4f1d-b9b1-85439620f1fc admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:25.059779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a7015-c0b9-4f1d-b9b1-85439620f1fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:25.064720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a7015-c0b9-4f1d-b9b1-85439620f1fc admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:25.104784 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1130/2259] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:10:24 2022] POST /identity/v3/users => generated 300 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:10:25.109447 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a7015-c0b9-4f1d-b9b1-85439620f1fc admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:25.130093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a7015-c0b9-4f1d-b9b1-85439620f1fc admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:25.136919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d1907-4c34-4f12-916f-a684b8e5eda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:25.137605 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb778f2-3514-4b5d-8ed0-0fddb0b3a9f4 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:25.138801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d1907-4c34-4f12-916f-a684b8e5eda2 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:25.139193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d1907-4c34-4f12-916f-a684b8e5eda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:25.139483 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d1907-4c34-4f12-916f-a684b8e5eda2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:25.140243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d1907-4c34-4f12-916f-a684b8e5eda2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:25.141967 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d1907-4c34-4f12-916f-a684b8e5eda2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:25.145538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bec8d-6814-405c-8c68-ab429832e5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:25.146175 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bec8d-6814-405c-8c68-ab429832e5d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:25.146462 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bec8d-6814-405c-8c68-ab429832e5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:25.146811 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bec8d-6814-405c-8c68-ab429832e5d8 admin admin] PATH_INFO: `/v3/projects/6ed95082bb1c418e95ab330c1d2c50da` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:25.148103 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bec8d-6814-405c-8c68-ab429832e5d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed95082bb1c418e95ab330c1d2c50da)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:25.150395 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bec8d-6814-405c-8c68-ab429832e5d8 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:25.158863 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1131/2260] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:10:25.160129 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:25.167433 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d1907-4c34-4f12-916f-a684b8e5eda2 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:25.186988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d1907-4c34-4f12-916f-a684b8e5eda2 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:25.199093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbde6ae-420d-4a84-8198-9dbe2ff5d6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:25.200226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbde6ae-420d-4a84-8198-9dbe2ff5d6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:25.200558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbde6ae-420d-4a84-8198-9dbe2ff5d6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:25.200816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbde6ae-420d-4a84-8198-9dbe2ff5d6e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:25.202169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbde6ae-420d-4a84-8198-9dbe2ff5d6e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:25.203674 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbde6ae-420d-4a84-8198-9dbe2ff5d6e0 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:25.217671 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1132/2261] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:10:25.220241 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-333bec8d-6814-405c-8c68-ab429832e5d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed95082bb1c418e95ab330c1d2c50da', 'request_id': 'req-333bec8d-6814-405c-8c68-ab429832e5d8'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:25.223621 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbde6ae-420d-4a84-8198-9dbe2ff5d6e0 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:25.229823 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-333bec8d-6814-405c-8c68-ab429832e5d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed95082bb1c418e95ab330c1d2c50da', 'request_id': 'req-333bec8d-6814-405c-8c68-ab429832e5d8'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:25.239883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-333bec8d-6814-405c-8c68-ab429832e5d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed95082bb1c418e95ab330c1d2c50da', 'request_id': 'req-333bec8d-6814-405c-8c68-ab429832e5d8'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:25.245700 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbde6ae-420d-4a84-8198-9dbe2ff5d6e0 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:25.257410 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-333bec8d-6814-405c-8c68-ab429832e5d8 admin admin] The token cache is being invalidate because project 6ed95082bb1c418e95ab330c1d2c50da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:10:25.257962 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-333bec8d-6814-405c-8c68-ab429832e5d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:25.258793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-333bec8d-6814-405c-8c68-ab429832e5d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:25.260720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1130/2262] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:10:24 2022] DELETE /identity/v3/projects/6ed95082bb1c418e95ab330c1d2c50da => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:25.266241 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bec8d-6814-405c-8c68-ab429832e5d8 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:25.270027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-333bec8d-6814-405c-8c68-ab429832e5d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:25.337598 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20073d5-95a2-48ea-919e-e33c8c5fcf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:25.338541 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20073d5-95a2-48ea-919e-e33c8c5fcf32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:25.338847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20073d5-95a2-48ea-919e-e33c8c5fcf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:25.339125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20073d5-95a2-48ea-919e-e33c8c5fcf32 admin admin] PATH_INFO: `/v3/projects/ac96af4f7d3f409492eb67a7bdc9d091/users/631cc9a03b884d45a24c0cc4525fb67d/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:25.352361 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:25.358405 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20073d5-95a2-48ea-919e-e33c8c5fcf32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac96af4f7d3f409492eb67a7bdc9d091, user_id=631cc9a03b884d45a24c0cc4525fb67d, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:25.362362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20073d5-95a2-48ea-919e-e33c8c5fcf32 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:25.378829 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1133/2263] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:10:25 2022] PUT /identity/v3/projects/ac96af4f7d3f409492eb67a7bdc9d091/users/631cc9a03b884d45a24c0cc4525fb67d/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:10:25.389296 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb21e3-74cb-4d10-a5cc-40087daf5fae None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:25.389662 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb21e3-74cb-4d10-a5cc-40087daf5fae None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:25.390061 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb21e3-74cb-4d10-a5cc-40087daf5fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:25.410511 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bec8d-6814-405c-8c68-ab429832e5d8 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:25.428092 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-54bb21e3-74cb-4d10-a5cc-40087daf5fae None None] MFA Rules not processed for user `631cc9a03b884d45a24c0cc4525fb67d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:25.430393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-54bb21e3-74cb-4d10-a5cc-40087daf5fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:25.530937 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25744a0e-5a97-45ac-b0ed-1215daa0b3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:25.555580 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25744a0e-5a97-45ac-b0ed-1215daa0b3c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:25.555580 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25744a0e-5a97-45ac-b0ed-1215daa0b3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:25.555580 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25744a0e-5a97-45ac-b0ed-1215daa0b3c6 admin admin] PATH_INFO: `/v3/users/1d4eb199289e46ee9566cdd88a1fb0d4` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:25.555963 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1134/2264] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:10:25.557658 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25744a0e-5a97-45ac-b0ed-1215daa0b3c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d4eb199289e46ee9566cdd88a1fb0d4)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:25.559725 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25744a0e-5a97-45ac-b0ed-1215daa0b3c6 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:25.567725 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb21e3-74cb-4d10-a5cc-40087daf5fae None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:25.569411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-54bb21e3-74cb-4d10-a5cc-40087daf5fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:25.622456 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:25.624294 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-25744a0e-5a97-45ac-b0ed-1215daa0b3c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d4eb199289e46ee9566cdd88a1fb0d4'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:25.637414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-25744a0e-5a97-45ac-b0ed-1215daa0b3c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d4eb199289e46ee9566cdd88a1fb0d4'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:25.639454 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-25744a0e-5a97-45ac-b0ed-1215daa0b3c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d4eb199289e46ee9566cdd88a1fb0d4'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:25.643328 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb21e3-74cb-4d10-a5cc-40087daf5fae None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:25.647470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65506fe2-5132-4ab0-bbcd-97fae5deb866 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:25.648220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65506fe2-5132-4ab0-bbcd-97fae5deb866 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:25.648499 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65506fe2-5132-4ab0-bbcd-97fae5deb866 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:25.648777 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65506fe2-5132-4ab0-bbcd-97fae5deb866 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:25.658134 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-65506fe2-5132-4ab0-bbcd-97fae5deb866 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:25.662613 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-25744a0e-5a97-45ac-b0ed-1215daa0b3c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d4eb199289e46ee9566cdd88a1fb0d4'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:25.663512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-25744a0e-5a97-45ac-b0ed-1215daa0b3c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d4eb199289e46ee9566cdd88a1fb0d4'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:25.672982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65506fe2-5132-4ab0-bbcd-97fae5deb866 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:25.674337 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65506fe2-5132-4ab0-bbcd-97fae5deb866 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:25.679129 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1131/2265] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:10:25 2022] DELETE /identity/v3/users/1d4eb199289e46ee9566cdd88a1fb0d4 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:10:25.687807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1135/2266] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:25 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:10:26.025703 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25744a0e-5a97-45ac-b0ed-1215daa0b3c6 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:26.028413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-25744a0e-5a97-45ac-b0ed-1215daa0b3c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:26.133244 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25744a0e-5a97-45ac-b0ed-1215daa0b3c6 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:26.139245 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768f33f-25d3-41e9-a53f-d2379059c683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:26.140218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768f33f-25d3-41e9-a53f-d2379059c683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:26.140580 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768f33f-25d3-41e9-a53f-d2379059c683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:26.140933 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768f33f-25d3-41e9-a53f-d2379059c683 admin admin] PATH_INFO: `/v3/projects/b8001cded0514d4f9317fe5091bc53b2` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:26.142256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768f33f-25d3-41e9-a53f-d2379059c683 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8001cded0514d4f9317fe5091bc53b2)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:26.144248 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768f33f-25d3-41e9-a53f-d2379059c683 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:26.217196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-d768f33f-25d3-41e9-a53f-d2379059c683 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8001cded0514d4f9317fe5091bc53b2', 'request_id': 'req-d768f33f-25d3-41e9-a53f-d2379059c683'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:26.227028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-d768f33f-25d3-41e9-a53f-d2379059c683 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8001cded0514d4f9317fe5091bc53b2', 'request_id': 'req-d768f33f-25d3-41e9-a53f-d2379059c683'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:26.238900 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-d768f33f-25d3-41e9-a53f-d2379059c683 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8001cded0514d4f9317fe5091bc53b2', 'request_id': 'req-d768f33f-25d3-41e9-a53f-d2379059c683'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:26.265724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-d768f33f-25d3-41e9-a53f-d2379059c683 admin admin] The token cache is being invalidate because project b8001cded0514d4f9317fe5091bc53b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:10:26.266033 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-d768f33f-25d3-41e9-a53f-d2379059c683 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:26.266906 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-d768f33f-25d3-41e9-a53f-d2379059c683 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:26.269314 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1132/2267] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:10:26 2022] DELETE /identity/v3/projects/b8001cded0514d4f9317fe5091bc53b2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:26.274416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca958a-634b-4f4b-8b04-e24ff383e59f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:26.274906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca958a-634b-4f4b-8b04-e24ff383e59f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:26.275090 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca958a-634b-4f4b-8b04-e24ff383e59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:26.296743 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-02ca958a-634b-4f4b-8b04-e24ff383e59f None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:26.297991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-02ca958a-634b-4f4b-8b04-e24ff383e59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:26.385857 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1136/2268] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:26.394142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd03b67-19a2-4519-aaa3-c69b3d540437 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:26.394481 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd03b67-19a2-4519-aaa3-c69b3d540437 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:26.394787 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd03b67-19a2-4519-aaa3-c69b3d540437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:26.414289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-dbd03b67-19a2-4519-aaa3-c69b3d540437 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:26.415580 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-dbd03b67-19a2-4519-aaa3-c69b3d540437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:26.424753 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1133/2269] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:26.429743 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca958a-634b-4f4b-8b04-e24ff383e59f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:26.444133 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca958a-634b-4f4b-8b04-e24ff383e59f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:26.450110 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82be26-cde9-46f4-a128-c603f2eb8961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:26.451483 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82be26-cde9-46f4-a128-c603f2eb8961 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:26.451774 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82be26-cde9-46f4-a128-c603f2eb8961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:26.452049 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82be26-cde9-46f4-a128-c603f2eb8961 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:26.452800 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82be26-cde9-46f4-a128-c603f2eb8961 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:10:26.453112 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82be26-cde9-46f4-a128-c603f2eb8961 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:26.454842 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82be26-cde9-46f4-a128-c603f2eb8961 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:26.468766 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1137/2270] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:10:26.474110 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd03b67-19a2-4519-aaa3-c69b3d540437 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:26.484400 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd03b67-19a2-4519-aaa3-c69b3d540437 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:26.489998 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab59ae-681c-4765-91a4-86de5f9a85db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:26.490985 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab59ae-681c-4765-91a4-86de5f9a85db admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:26.491440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab59ae-681c-4765-91a4-86de5f9a85db admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:26.491729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab59ae-681c-4765-91a4-86de5f9a85db admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:26.492496 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab59ae-681c-4765-91a4-86de5f9a85db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:26.494452 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab59ae-681c-4765-91a4-86de5f9a85db admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:26.524096 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1134/2271] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:10:26 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:10:26.528671 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82be26-cde9-46f4-a128-c603f2eb8961 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:26.539340 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82be26-cde9-46f4-a128-c603f2eb8961 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:26.544826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:26.635764 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec206f-d336-43a4-b486-baab01e0fd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:26.636452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec206f-d336-43a4-b486-baab01e0fd57 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:26.636741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec206f-d336-43a4-b486-baab01e0fd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:26.637023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec206f-d336-43a4-b486-baab01e0fd57 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:26.637729 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec206f-d336-43a4-b486-baab01e0fd57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:26.640324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec206f-d336-43a4-b486-baab01e0fd57 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:26.663023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1138/2272] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:10:26 2022] POST /identity/v3/users => generated 291 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:10:26.670196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab59ae-681c-4765-91a4-86de5f9a85db admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:26.684547 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab59ae-681c-4765-91a4-86de5f9a85db admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:26.690197 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112bbdb-172d-49e1-a2f9-2db14ec5a9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:26.690970 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112bbdb-172d-49e1-a2f9-2db14ec5a9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:26.691290 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112bbdb-172d-49e1-a2f9-2db14ec5a9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:26.691514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112bbdb-172d-49e1-a2f9-2db14ec5a9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:26.692249 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112bbdb-172d-49e1-a2f9-2db14ec5a9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:26.693887 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112bbdb-172d-49e1-a2f9-2db14ec5a9e1 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:26.706348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1135/2273] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:10:26.710618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec206f-d336-43a4-b486-baab01e0fd57 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:26.721695 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec206f-d336-43a4-b486-baab01e0fd57 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:26.726741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96de57c-5077-4189-9d9e-fdd35cb9180c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:26.727472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96de57c-5077-4189-9d9e-fdd35cb9180c admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:26.735168 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96de57c-5077-4189-9d9e-fdd35cb9180c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:26.735168 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96de57c-5077-4189-9d9e-fdd35cb9180c admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:26.735168 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96de57c-5077-4189-9d9e-fdd35cb9180c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:26.735168 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96de57c-5077-4189-9d9e-fdd35cb9180c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:26.742781 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1139/2274] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:10:26.748187 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112bbdb-172d-49e1-a2f9-2db14ec5a9e1 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:26.758906 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112bbdb-172d-49e1-a2f9-2db14ec5a9e1 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:26.764030 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c3c28-eadd-42be-af9e-c473bf2054f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:26.764930 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c3c28-eadd-42be-af9e-c473bf2054f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:26.765225 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c3c28-eadd-42be-af9e-c473bf2054f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:26.765500 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c3c28-eadd-42be-af9e-c473bf2054f9 admin admin] PATH_INFO: `/v3/projects/52b2a5b0ad5948a18d25fcd19e8b0016/users/2ec5fde867dd4a799bf6740b3786481f/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:26.777682 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:26.782158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c3c28-eadd-42be-af9e-c473bf2054f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b2a5b0ad5948a18d25fcd19e8b0016, user_id=2ec5fde867dd4a799bf6740b3786481f, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:26.785996 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c3c28-eadd-42be-af9e-c473bf2054f9 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:26.804292 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1136/2275] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:10:26 2022] PUT /identity/v3/projects/52b2a5b0ad5948a18d25fcd19e8b0016/users/2ec5fde867dd4a799bf6740b3786481f/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:26.876394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5a62f-6a9e-4a1b-8d12-40135436bd23 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:26.876878 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5a62f-6a9e-4a1b-8d12-40135436bd23 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:26.877269 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5a62f-6a9e-4a1b-8d12-40135436bd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:26.913306 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-aec5a62f-6a9e-4a1b-8d12-40135436bd23 None None] MFA Rules not processed for user `2ec5fde867dd4a799bf6740b3786481f`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:26.914671 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-aec5a62f-6a9e-4a1b-8d12-40135436bd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:27.009682 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1140/2276] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:27.015363 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c3c28-eadd-42be-af9e-c473bf2054f9 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:27.125058 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c3c28-eadd-42be-af9e-c473bf2054f9 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:27.132827 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b195c3-c80c-4e67-b46b-dde1ca6553e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:27.133738 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b195c3-c80c-4e67-b46b-dde1ca6553e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:27.134464 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b195c3-c80c-4e67-b46b-dde1ca6553e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:27.134726 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b195c3-c80c-4e67-b46b-dde1ca6553e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:27.135440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b195c3-c80c-4e67-b46b-dde1ca6553e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:27.137706 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b195c3-c80c-4e67-b46b-dde1ca6553e2 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:27.172434 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1137/2277] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:10:27 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:10:27.177661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5a62f-6a9e-4a1b-8d12-40135436bd23 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:27.189256 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5a62f-6a9e-4a1b-8d12-40135436bd23 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:27.275680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef866063-97b4-4c7e-9270-046d9f3018a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:27.276585 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef866063-97b4-4c7e-9270-046d9f3018a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:27.276877 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef866063-97b4-4c7e-9270-046d9f3018a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:27.277163 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef866063-97b4-4c7e-9270-046d9f3018a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:27.279354 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef866063-97b4-4c7e-9270-046d9f3018a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:27.281700 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef866063-97b4-4c7e-9270-046d9f3018a2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:27.317816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1141/2278] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:10:27 2022] POST /identity/v3/users => generated 298 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:10:27.322211 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b195c3-c80c-4e67-b46b-dde1ca6553e2 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:27.334364 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b195c3-c80c-4e67-b46b-dde1ca6553e2 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:27.340934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb07047-1b1f-4a12-9b6d-611375620c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:27.343278 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb07047-1b1f-4a12-9b6d-611375620c3e admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:27.343278 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb07047-1b1f-4a12-9b6d-611375620c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:27.343278 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb07047-1b1f-4a12-9b6d-611375620c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:27.344239 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb07047-1b1f-4a12-9b6d-611375620c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:27.346140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb07047-1b1f-4a12-9b6d-611375620c3e admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:27.370136 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1138/2279] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:10:27.374414 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef866063-97b4-4c7e-9270-046d9f3018a2 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:27.387099 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef866063-97b4-4c7e-9270-046d9f3018a2 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:27.394813 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1dcc2-baeb-4301-baa5-752512b4667b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:27.396040 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1dcc2-baeb-4301-baa5-752512b4667b admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:27.396529 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1dcc2-baeb-4301-baa5-752512b4667b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:27.397023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1dcc2-baeb-4301-baa5-752512b4667b admin admin] PATH_INFO: `/v3/projects/2a88d8944d0f4e86a081f69a7dd5a08c/users/3a3472070a154100a4610e613015eaa7/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:27.401369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:27.429960 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1dcc2-baeb-4301-baa5-752512b4667b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a88d8944d0f4e86a081f69a7dd5a08c, user_id=3a3472070a154100a4610e613015eaa7, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:27.433645 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1dcc2-baeb-4301-baa5-752512b4667b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:27.451148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1142/2280] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:10:27 2022] PUT /identity/v3/projects/2a88d8944d0f4e86a081f69a7dd5a08c/users/3a3472070a154100a4610e613015eaa7/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:27.456196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb07047-1b1f-4a12-9b6d-611375620c3e admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:27.471732 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb07047-1b1f-4a12-9b6d-611375620c3e admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:27.564454 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10ab90-472b-4919-a5d3-6991a38d8939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:27.565074 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10ab90-472b-4919-a5d3-6991a38d8939 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:27.565365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10ab90-472b-4919-a5d3-6991a38d8939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:27.565647 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10ab90-472b-4919-a5d3-6991a38d8939 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:27.566391 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10ab90-472b-4919-a5d3-6991a38d8939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:27.568092 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10ab90-472b-4919-a5d3-6991a38d8939 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:27.582472 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1139/2281] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:10:27.583708 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1dcc2-baeb-4301-baa5-752512b4667b admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:27.596102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1dcc2-baeb-4301-baa5-752512b4667b admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:27.604094 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a414b88-9817-434f-a3c4-1e500df81877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:27.605118 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a414b88-9817-434f-a3c4-1e500df81877 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:27.605591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a414b88-9817-434f-a3c4-1e500df81877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:27.606162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a414b88-9817-434f-a3c4-1e500df81877 admin admin] PATH_INFO: `/v3/projects/2a88d8944d0f4e86a081f69a7dd5a08c/users/3a3472070a154100a4610e613015eaa7/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:27.608697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a414b88-9817-434f-a3c4-1e500df81877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a88d8944d0f4e86a081f69a7dd5a08c, user_id=3a3472070a154100a4610e613015eaa7, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:27.611859 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a414b88-9817-434f-a3c4-1e500df81877 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:27.624398 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1143/2282] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:10:27 2022] PUT /identity/v3/projects/2a88d8944d0f4e86a081f69a7dd5a08c/users/3a3472070a154100a4610e613015eaa7/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:10:27.634534 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f91cb-34f0-4e53-8ddc-5ad1989b6cf4 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:27.634916 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f91cb-34f0-4e53-8ddc-5ad1989b6cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:27.635163 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f91cb-34f0-4e53-8ddc-5ad1989b6cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:27.669669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-a11f91cb-34f0-4e53-8ddc-5ad1989b6cf4 None None] MFA Rules not processed for user `3a3472070a154100a4610e613015eaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:27.670959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a11f91cb-34f0-4e53-8ddc-5ad1989b6cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:27.737740 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:27.770207 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1140/2283] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:27.876221 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a414b88-9817-434f-a3c4-1e500df81877 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:27.878270 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7a414b88-9817-434f-a3c4-1e500df81877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:27.970273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a414b88-9817-434f-a3c4-1e500df81877 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:27.975251 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00560b-6ce7-40c8-886d-80568bb5fb98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:27.975996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00560b-6ce7-40c8-886d-80568bb5fb98 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:27.976229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00560b-6ce7-40c8-886d-80568bb5fb98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:27.976511 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00560b-6ce7-40c8-886d-80568bb5fb98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:27.990652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00560b-6ce7-40c8-886d-80568bb5fb98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:27.992138 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00560b-6ce7-40c8-886d-80568bb5fb98 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:28.003555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1144/2284] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:10:28.096354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f91cb-34f0-4e53-8ddc-5ad1989b6cf4 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:28.107341 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f91cb-34f0-4e53-8ddc-5ad1989b6cf4 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:28.111417 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483c682-5dd5-4978-bad4-255d4ae2e257 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:28.111723 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483c682-5dd5-4978-bad4-255d4ae2e257 service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:28.112040 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483c682-5dd5-4978-bad4-255d4ae2e257 service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:28.112290 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483c682-5dd5-4978-bad4-255d4ae2e257 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:28.175118 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483c682-5dd5-4978-bad4-255d4ae2e257 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:28.178991 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483c682-5dd5-4978-bad4-255d4ae2e257 service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:28.187260 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1141/2285] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:10:28.466459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00560b-6ce7-40c8-886d-80568bb5fb98 service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:28.543875 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00560b-6ce7-40c8-886d-80568bb5fb98 service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:28.550725 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028aeb4-69e2-4e28-9d22-83128f199ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:28.552673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028aeb4-69e2-4e28-9d22-83128f199ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:28.553589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028aeb4-69e2-4e28-9d22-83128f199ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:28.553938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028aeb4-69e2-4e28-9d22-83128f199ed5 admin admin] PATH_INFO: `/v3/users/2ec5fde867dd4a799bf6740b3786481f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:28.555528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028aeb4-69e2-4e28-9d22-83128f199ed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ec5fde867dd4a799bf6740b3786481f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:28.557571 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028aeb4-69e2-4e28-9d22-83128f199ed5 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:28.622343 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c028aeb4-69e2-4e28-9d22-83128f199ed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ec5fde867dd4a799bf6740b3786481f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:28.633173 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c028aeb4-69e2-4e28-9d22-83128f199ed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ec5fde867dd4a799bf6740b3786481f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:28.643332 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c028aeb4-69e2-4e28-9d22-83128f199ed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ec5fde867dd4a799bf6740b3786481f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:28.653070 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:28.660275 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c028aeb4-69e2-4e28-9d22-83128f199ed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ec5fde867dd4a799bf6740b3786481f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:28.661097 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c028aeb4-69e2-4e28-9d22-83128f199ed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ec5fde867dd4a799bf6740b3786481f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:28.671851 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1145/2286] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:10:28 2022] DELETE /identity/v3/users/2ec5fde867dd4a799bf6740b3786481f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:10:28.677955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f060498-5a33-4a9d-b01f-513731de3763 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:28.678461 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f060498-5a33-4a9d-b01f-513731de3763 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:28.678844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f060498-5a33-4a9d-b01f-513731de3763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:28.706369 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-1f060498-5a33-4a9d-b01f-513731de3763 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:28.707791 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-1f060498-5a33-4a9d-b01f-513731de3763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:28.787242 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1142/2287] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:28.798695 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028aeb4-69e2-4e28-9d22-83128f199ed5 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:28.800355 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c028aeb4-69e2-4e28-9d22-83128f199ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:28.861693 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028aeb4-69e2-4e28-9d22-83128f199ed5 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:28.865486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277da78f-bed4-4ade-bcd2-bfcff7c72d8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:28.866141 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277da78f-bed4-4ade-bcd2-bfcff7c72d8e service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:28.866422 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277da78f-bed4-4ade-bcd2-bfcff7c72d8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:28.866797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277da78f-bed4-4ade-bcd2-bfcff7c72d8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:28.876074 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277da78f-bed4-4ade-bcd2-bfcff7c72d8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:28.877540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277da78f-bed4-4ade-bcd2-bfcff7c72d8e service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:28.887466 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1146/2288] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:10:29.190212 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f060498-5a33-4a9d-b01f-513731de3763 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:29.192593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-1f060498-5a33-4a9d-b01f-513731de3763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:29.218702 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f060498-5a33-4a9d-b01f-513731de3763 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:29.226441 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de923a7e-c6dc-4a4d-afe1-fd60e8af5cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:29.227555 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de923a7e-c6dc-4a4d-afe1-fd60e8af5cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:29.228022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de923a7e-c6dc-4a4d-afe1-fd60e8af5cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:29.228370 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de923a7e-c6dc-4a4d-afe1-fd60e8af5cd2 admin admin] PATH_INFO: `/v3/projects/52b2a5b0ad5948a18d25fcd19e8b0016` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:29.229847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de923a7e-c6dc-4a4d-afe1-fd60e8af5cd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b2a5b0ad5948a18d25fcd19e8b0016)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:29.232707 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de923a7e-c6dc-4a4d-afe1-fd60e8af5cd2 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:29.290518 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-de923a7e-c6dc-4a4d-afe1-fd60e8af5cd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b2a5b0ad5948a18d25fcd19e8b0016', 'request_id': 'req-de923a7e-c6dc-4a4d-afe1-fd60e8af5cd2'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:29.297315 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-de923a7e-c6dc-4a4d-afe1-fd60e8af5cd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b2a5b0ad5948a18d25fcd19e8b0016', 'request_id': 'req-de923a7e-c6dc-4a4d-afe1-fd60e8af5cd2'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:29.305349 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-de923a7e-c6dc-4a4d-afe1-fd60e8af5cd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b2a5b0ad5948a18d25fcd19e8b0016', 'request_id': 'req-de923a7e-c6dc-4a4d-afe1-fd60e8af5cd2'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:29.322988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-de923a7e-c6dc-4a4d-afe1-fd60e8af5cd2 admin admin] The token cache is being invalidate because project 52b2a5b0ad5948a18d25fcd19e8b0016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:10:29.323419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-de923a7e-c6dc-4a4d-afe1-fd60e8af5cd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:29.324205 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-de923a7e-c6dc-4a4d-afe1-fd60e8af5cd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:29.329680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1143/2289] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:10:29 2022] DELETE /identity/v3/projects/52b2a5b0ad5948a18d25fcd19e8b0016 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:29.331397 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277da78f-bed4-4ade-bcd2-bfcff7c72d8e service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:29.343881 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de923a7e-c6dc-4a4d-afe1-fd60e8af5cd2 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:29.347597 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-de923a7e-c6dc-4a4d-afe1-fd60e8af5cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:29.349971 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277da78f-bed4-4ade-bcd2-bfcff7c72d8e service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:29.361565 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:29.436268 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de923a7e-c6dc-4a4d-afe1-fd60e8af5cd2 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:29.438402 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee6446-0932-416d-b518-e8d03832d7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:29.439514 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee6446-0932-416d-b518-e8d03832d7cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:29.440024 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee6446-0932-416d-b518-e8d03832d7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:29.440737 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee6446-0932-416d-b518-e8d03832d7cc admin admin] PATH_INFO: `/v3/users/3a3472070a154100a4610e613015eaa7` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:29.442320 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee6446-0932-416d-b518-e8d03832d7cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a3472070a154100a4610e613015eaa7)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:29.442463 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac6314-276b-4720-aa8a-bfccac502597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:29.444582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee6446-0932-416d-b518-e8d03832d7cc admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:29.445944 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac6314-276b-4720-aa8a-bfccac502597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:29.446271 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac6314-276b-4720-aa8a-bfccac502597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:29.446636 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac6314-276b-4720-aa8a-bfccac502597 admin admin] PATH_INFO: `/v3/users/bf3e8ee5f8ff41118d4bd885f73d85c4` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:29.448175 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac6314-276b-4720-aa8a-bfccac502597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf3e8ee5f8ff41118d4bd885f73d85c4)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:29.450160 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac6314-276b-4720-aa8a-bfccac502597 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:29.520695 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f6ee6446-0932-416d-b518-e8d03832d7cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a3472070a154100a4610e613015eaa7'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:29.525957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-86ac6314-276b-4720-aa8a-bfccac502597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf3e8ee5f8ff41118d4bd885f73d85c4'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:29.533826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f6ee6446-0932-416d-b518-e8d03832d7cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a3472070a154100a4610e613015eaa7'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:29.538648 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-86ac6314-276b-4720-aa8a-bfccac502597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf3e8ee5f8ff41118d4bd885f73d85c4'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:29.539452 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-86ac6314-276b-4720-aa8a-bfccac502597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf3e8ee5f8ff41118d4bd885f73d85c4'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:29.545286 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f6ee6446-0932-416d-b518-e8d03832d7cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a3472070a154100a4610e613015eaa7'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:29.560389 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-86ac6314-276b-4720-aa8a-bfccac502597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf3e8ee5f8ff41118d4bd885f73d85c4'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:29.561184 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-86ac6314-276b-4720-aa8a-bfccac502597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf3e8ee5f8ff41118d4bd885f73d85c4'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:29.570248 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f6ee6446-0932-416d-b518-e8d03832d7cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a3472070a154100a4610e613015eaa7'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:29.571446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f6ee6446-0932-416d-b518-e8d03832d7cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a3472070a154100a4610e613015eaa7'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:29.578447 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1144/2290] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:10:29 2022] DELETE /identity/v3/users/bf3e8ee5f8ff41118d4bd885f73d85c4 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:29.583152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1147/2291] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:10:29 2022] DELETE /identity/v3/users/3a3472070a154100a4610e613015eaa7 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:29.586639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d024c38-536e-4cc6-abe7-6f07ba4f24ef None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:29.586947 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d024c38-536e-4cc6-abe7-6f07ba4f24ef None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:29.587241 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d024c38-536e-4cc6-abe7-6f07ba4f24ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:29.608175 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-1d024c38-536e-4cc6-abe7-6f07ba4f24ef None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:29.609611 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-1d024c38-536e-4cc6-abe7-6f07ba4f24ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:29.685490 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1145/2292] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:29.700499 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee6446-0932-416d-b518-e8d03832d7cc admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:29.702382 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f6ee6446-0932-416d-b518-e8d03832d7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:29.725907 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:29.806629 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee6446-0932-416d-b518-e8d03832d7cc admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:29.811266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60923f50-7296-43fa-a6bd-44f3a8880faa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:29.812021 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60923f50-7296-43fa-a6bd-44f3a8880faa service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:29.812307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60923f50-7296-43fa-a6bd-44f3a8880faa service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:29.812581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60923f50-7296-43fa-a6bd-44f3a8880faa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:29.822896 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60923f50-7296-43fa-a6bd-44f3a8880faa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:29.824442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60923f50-7296-43fa-a6bd-44f3a8880faa service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:29.838671 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1148/2293] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:10:30.058414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d024c38-536e-4cc6-abe7-6f07ba4f24ef None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:30.060188 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-1d024c38-536e-4cc6-abe7-6f07ba4f24ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:30.074375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d024c38-536e-4cc6-abe7-6f07ba4f24ef None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:30.087264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbb660-f347-4594-9479-023cfe9f4ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:30.088274 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbb660-f347-4594-9479-023cfe9f4ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:30.088705 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbb660-f347-4594-9479-023cfe9f4ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:30.088953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbb660-f347-4594-9479-023cfe9f4ebd admin admin] PATH_INFO: `/v3/projects/2a88d8944d0f4e86a081f69a7dd5a08c` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:30.090260 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbb660-f347-4594-9479-023cfe9f4ebd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a88d8944d0f4e86a081f69a7dd5a08c)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:30.093216 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbb660-f347-4594-9479-023cfe9f4ebd admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:30.125582 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:30.152404 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-bffbb660-f347-4594-9479-023cfe9f4ebd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a88d8944d0f4e86a081f69a7dd5a08c', 'request_id': 'req-bffbb660-f347-4594-9479-023cfe9f4ebd'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:30.160271 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-bffbb660-f347-4594-9479-023cfe9f4ebd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a88d8944d0f4e86a081f69a7dd5a08c', 'request_id': 'req-bffbb660-f347-4594-9479-023cfe9f4ebd'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:30.166347 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-bffbb660-f347-4594-9479-023cfe9f4ebd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a88d8944d0f4e86a081f69a7dd5a08c', 'request_id': 'req-bffbb660-f347-4594-9479-023cfe9f4ebd'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:30.177988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60923f50-7296-43fa-a6bd-44f3a8880faa service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:30.179525 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-60923f50-7296-43fa-a6bd-44f3a8880faa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:30.182893 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-bffbb660-f347-4594-9479-023cfe9f4ebd admin admin] The token cache is being invalidate because project 2a88d8944d0f4e86a081f69a7dd5a08c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:10:30.183426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-bffbb660-f347-4594-9479-023cfe9f4ebd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:30.184724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-bffbb660-f347-4594-9479-023cfe9f4ebd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:30.187341 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1146/2294] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:10:30 2022] DELETE /identity/v3/projects/2a88d8944d0f4e86a081f69a7dd5a08c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:30.193273 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955e595-87d2-46f8-93cf-b8731d39d34c None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:30.193886 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955e595-87d2-46f8-93cf-b8731d39d34c None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:30.194586 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955e595-87d2-46f8-93cf-b8731d39d34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:30.200574 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60923f50-7296-43fa-a6bd-44f3a8880faa service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:30.214995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-e955e595-87d2-46f8-93cf-b8731d39d34c None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:30.216743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e955e595-87d2-46f8-93cf-b8731d39d34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:30.282388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25df8fb-dda9-4356-9f08-41cbdf5c50ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:30.283076 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25df8fb-dda9-4356-9f08-41cbdf5c50ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:30.283830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25df8fb-dda9-4356-9f08-41cbdf5c50ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:30.284075 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25df8fb-dda9-4356-9f08-41cbdf5c50ab admin admin] PATH_INFO: `/v3/projects/339c23fb856b49878b6ffbe467a87220` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:30.286081 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25df8fb-dda9-4356-9f08-41cbdf5c50ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=339c23fb856b49878b6ffbe467a87220)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:30.288876 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25df8fb-dda9-4356-9f08-41cbdf5c50ab admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:30.294146 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1147/2295] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:10:30.303104 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7585c-0dbe-4da0-8c2b-809e7156adbb None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:30.303920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7585c-0dbe-4da0-8c2b-809e7156adbb None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:30.304285 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7585c-0dbe-4da0-8c2b-809e7156adbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:30.329164 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-61a7585c-0dbe-4da0-8c2b-809e7156adbb None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:30.331169 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-61a7585c-0dbe-4da0-8c2b-809e7156adbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:30.343703 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1148/2296] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:30.349436 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7585c-0dbe-4da0-8c2b-809e7156adbb None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:30.360566 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7585c-0dbe-4da0-8c2b-809e7156adbb None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:30.366043 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12077114-4b97-4222-a6ce-80f7c7e9f3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:30.366545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12077114-4b97-4222-a6ce-80f7c7e9f3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:30.366842 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12077114-4b97-4222-a6ce-80f7c7e9f3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:30.367119 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12077114-4b97-4222-a6ce-80f7c7e9f3d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:30.367947 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12077114-4b97-4222-a6ce-80f7c7e9f3d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:10:30.368267 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12077114-4b97-4222-a6ce-80f7c7e9f3d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:30.370100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12077114-4b97-4222-a6ce-80f7c7e9f3d4 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:30.383298 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-e25df8fb-dda9-4356-9f08-41cbdf5c50ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '339c23fb856b49878b6ffbe467a87220', 'request_id': 'req-e25df8fb-dda9-4356-9f08-41cbdf5c50ab'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:30.386861 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1149/2297] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:10:30.391374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12077114-4b97-4222-a6ce-80f7c7e9f3d4 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:30.394015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-e25df8fb-dda9-4356-9f08-41cbdf5c50ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '339c23fb856b49878b6ffbe467a87220', 'request_id': 'req-e25df8fb-dda9-4356-9f08-41cbdf5c50ab'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:30.404201 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12077114-4b97-4222-a6ce-80f7c7e9f3d4 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:30.406696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-e25df8fb-dda9-4356-9f08-41cbdf5c50ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '339c23fb856b49878b6ffbe467a87220', 'request_id': 'req-e25df8fb-dda9-4356-9f08-41cbdf5c50ab'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:30.433096 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-e25df8fb-dda9-4356-9f08-41cbdf5c50ab admin admin] The token cache is being invalidate because project 339c23fb856b49878b6ffbe467a87220 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:10:30.433567 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-e25df8fb-dda9-4356-9f08-41cbdf5c50ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:30.434644 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-e25df8fb-dda9-4356-9f08-41cbdf5c50ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:30.437821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1149/2298] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:10:30 2022] DELETE /identity/v3/projects/339c23fb856b49878b6ffbe467a87220 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:10:30.499873 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95b04d-93b6-4f72-8239-9e4cd1cf9548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:30.500562 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95b04d-93b6-4f72-8239-9e4cd1cf9548 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:30.501267 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95b04d-93b6-4f72-8239-9e4cd1cf9548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:30.501267 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95b04d-93b6-4f72-8239-9e4cd1cf9548 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:30.501978 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95b04d-93b6-4f72-8239-9e4cd1cf9548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:30.504017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95b04d-93b6-4f72-8239-9e4cd1cf9548 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:30.540626 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1150/2299] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:10:30 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:10:30.545590 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25df8fb-dda9-4356-9f08-41cbdf5c50ab admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:30.551437 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e25df8fb-dda9-4356-9f08-41cbdf5c50ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:30.569499 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25df8fb-dda9-4356-9f08-41cbdf5c50ab admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:30.653309 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:30.689865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a1beb-0740-4e5f-b6f5-ec98272e8218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:30.690610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a1beb-0740-4e5f-b6f5-ec98272e8218 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:30.690905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a1beb-0740-4e5f-b6f5-ec98272e8218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:30.691184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a1beb-0740-4e5f-b6f5-ec98272e8218 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:30.691906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a1beb-0740-4e5f-b6f5-ec98272e8218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:30.693961 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a1beb-0740-4e5f-b6f5-ec98272e8218 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:30.724244 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1150/2300] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:10:30 2022] POST /identity/v3/users => generated 291 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:10:30.725416 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95b04d-93b6-4f72-8239-9e4cd1cf9548 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:30.737244 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95b04d-93b6-4f72-8239-9e4cd1cf9548 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:30.742996 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d498a73-fe0c-489f-8352-526863ce15da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:30.743630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d498a73-fe0c-489f-8352-526863ce15da admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:30.743948 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d498a73-fe0c-489f-8352-526863ce15da admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:30.744290 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d498a73-fe0c-489f-8352-526863ce15da admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:30.746537 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d498a73-fe0c-489f-8352-526863ce15da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:30.747144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d498a73-fe0c-489f-8352-526863ce15da admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:30.762148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1151/2301] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:10:30.764496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a1beb-0740-4e5f-b6f5-ec98272e8218 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:30.774775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a1beb-0740-4e5f-b6f5-ec98272e8218 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:30.780547 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45707d9-5b29-4ca7-8779-1f625d09f07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:30.781346 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45707d9-5b29-4ca7-8779-1f625d09f07b admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:30.781606 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45707d9-5b29-4ca7-8779-1f625d09f07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:30.781906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45707d9-5b29-4ca7-8779-1f625d09f07b admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:30.782697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45707d9-5b29-4ca7-8779-1f625d09f07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:30.784382 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45707d9-5b29-4ca7-8779-1f625d09f07b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:30.798551 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1151/2302] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:10:30.802642 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d498a73-fe0c-489f-8352-526863ce15da admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:30.809419 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:30.814452 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d498a73-fe0c-489f-8352-526863ce15da admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:30.821281 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1bb54-68bb-4492-863f-4e31392b8d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:30.822325 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1bb54-68bb-4492-863f-4e31392b8d5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:30.822808 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1bb54-68bb-4492-863f-4e31392b8d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:30.823475 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1bb54-68bb-4492-863f-4e31392b8d5c admin admin] PATH_INFO: `/v3/projects/6c2753358fa04332910b4f91b162a889/users/1ec3eeaf42af4d658e9d9ccbc3483d39/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:30.847028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1bb54-68bb-4492-863f-4e31392b8d5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2753358fa04332910b4f91b162a889, user_id=1ec3eeaf42af4d658e9d9ccbc3483d39, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:30.850034 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1bb54-68bb-4492-863f-4e31392b8d5c admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:30.877531 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1152/2303] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:10:30 2022] PUT /identity/v3/projects/6c2753358fa04332910b4f91b162a889/users/1ec3eeaf42af4d658e9d9ccbc3483d39/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:10:30.878919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24acf-5908-4774-9bfc-fe1e2c38a4ce None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:30.879220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24acf-5908-4774-9bfc-fe1e2c38a4ce None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:30.879501 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24acf-5908-4774-9bfc-fe1e2c38a4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:30.911665 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-24f24acf-5908-4774-9bfc-fe1e2c38a4ce None None] MFA Rules not processed for user `1ec3eeaf42af4d658e9d9ccbc3483d39`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:30.914199 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-24f24acf-5908-4774-9bfc-fe1e2c38a4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:30.986529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1bb54-68bb-4492-863f-4e31392b8d5c admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:30.988343 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-3dd1bb54-68bb-4492-863f-4e31392b8d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:31.063956 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1152/2304] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:10:31.079624 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f24acf-5908-4774-9bfc-fe1e2c38a4ce None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:31.082772 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-24f24acf-5908-4774-9bfc-fe1e2c38a4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:31.115408 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1bb54-68bb-4492-863f-4e31392b8d5c admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:31.124125 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeca3fb-cff7-4892-8d56-d95ee95eda47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:31.125026 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeca3fb-cff7-4892-8d56-d95ee95eda47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:31.125310 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeca3fb-cff7-4892-8d56-d95ee95eda47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:31.125586 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeca3fb-cff7-4892-8d56-d95ee95eda47 admin admin] PATH_INFO: `/v3/users/631cc9a03b884d45a24c0cc4525fb67d` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:31.127293 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeca3fb-cff7-4892-8d56-d95ee95eda47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=631cc9a03b884d45a24c0cc4525fb67d)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:31.130393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeca3fb-cff7-4892-8d56-d95ee95eda47 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:31.194421 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f24acf-5908-4774-9bfc-fe1e2c38a4ce None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:31.199137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12108e0f-6e69-4249-a009-bdd4d0431c31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:31.199816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12108e0f-6e69-4249-a009-bdd4d0431c31 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:31.200099 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12108e0f-6e69-4249-a009-bdd4d0431c31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:31.200404 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12108e0f-6e69-4249-a009-bdd4d0431c31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:31.202827 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-fdeca3fb-cff7-4892-8d56-d95ee95eda47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '631cc9a03b884d45a24c0cc4525fb67d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:31.213323 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12108e0f-6e69-4249-a009-bdd4d0431c31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:31.213654 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-fdeca3fb-cff7-4892-8d56-d95ee95eda47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '631cc9a03b884d45a24c0cc4525fb67d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:31.214449 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-fdeca3fb-cff7-4892-8d56-d95ee95eda47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '631cc9a03b884d45a24c0cc4525fb67d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:31.214970 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12108e0f-6e69-4249-a009-bdd4d0431c31 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:31.227100 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1153/2305] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:10:31.240306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-fdeca3fb-cff7-4892-8d56-d95ee95eda47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '631cc9a03b884d45a24c0cc4525fb67d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:31.241629 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-fdeca3fb-cff7-4892-8d56-d95ee95eda47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '631cc9a03b884d45a24c0cc4525fb67d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:31.261435 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1153/2306] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:10:30 2022] DELETE /identity/v3/users/631cc9a03b884d45a24c0cc4525fb67d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:10:31.266236 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3a405-099e-4381-ba8d-7b8667de0a45 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:31.266661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3a405-099e-4381-ba8d-7b8667de0a45 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:31.267058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3a405-099e-4381-ba8d-7b8667de0a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:31.291160 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-17b3a405-099e-4381-ba8d-7b8667de0a45 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:31.293874 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-17b3a405-099e-4381-ba8d-7b8667de0a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:31.370372 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:31.384203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1154/2307] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:31.394018 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeca3fb-cff7-4892-8d56-d95ee95eda47 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:31.395879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-fdeca3fb-cff7-4892-8d56-d95ee95eda47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:31.473702 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeca3fb-cff7-4892-8d56-d95ee95eda47 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:31.478332 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342e37c-d47a-4210-b9db-a954ac8d4267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:31.479143 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342e37c-d47a-4210-b9db-a954ac8d4267 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:31.479501 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342e37c-d47a-4210-b9db-a954ac8d4267 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:31.479852 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342e37c-d47a-4210-b9db-a954ac8d4267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:31.496452 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342e37c-d47a-4210-b9db-a954ac8d4267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:31.512009 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342e37c-d47a-4210-b9db-a954ac8d4267 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:31.524793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1154/2308] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:10:31.865291 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3a405-099e-4381-ba8d-7b8667de0a45 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:31.866917 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-17b3a405-099e-4381-ba8d-7b8667de0a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:31.881023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3a405-099e-4381-ba8d-7b8667de0a45 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:31.886805 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe160b3-f85d-46d5-95be-68c70f766aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:31.887780 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe160b3-f85d-46d5-95be-68c70f766aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:31.888112 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe160b3-f85d-46d5-95be-68c70f766aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:31.888399 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe160b3-f85d-46d5-95be-68c70f766aee admin admin] PATH_INFO: `/v3/projects/ac96af4f7d3f409492eb67a7bdc9d091` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:31.889615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe160b3-f85d-46d5-95be-68c70f766aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac96af4f7d3f409492eb67a7bdc9d091)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:31.891759 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe160b3-f85d-46d5-95be-68c70f766aee admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:31.955274 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-9fe160b3-f85d-46d5-95be-68c70f766aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac96af4f7d3f409492eb67a7bdc9d091', 'request_id': 'req-9fe160b3-f85d-46d5-95be-68c70f766aee'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:31.962012 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-9fe160b3-f85d-46d5-95be-68c70f766aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac96af4f7d3f409492eb67a7bdc9d091', 'request_id': 'req-9fe160b3-f85d-46d5-95be-68c70f766aee'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:31.968129 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-9fe160b3-f85d-46d5-95be-68c70f766aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac96af4f7d3f409492eb67a7bdc9d091', 'request_id': 'req-9fe160b3-f85d-46d5-95be-68c70f766aee'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:31.982474 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-9fe160b3-f85d-46d5-95be-68c70f766aee admin admin] The token cache is being invalidate because project ac96af4f7d3f409492eb67a7bdc9d091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:10:31.982793 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-9fe160b3-f85d-46d5-95be-68c70f766aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:31.983938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-9fe160b3-f85d-46d5-95be-68c70f766aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:31.985229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1155/2309] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:10:31 2022] DELETE /identity/v3/projects/ac96af4f7d3f409492eb67a7bdc9d091 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:32.266379 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b7de8-3a37-4864-b36b-5a7ffa1f3a2d None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:32.267021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b7de8-3a37-4864-b36b-5a7ffa1f3a2d None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:32.267021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b7de8-3a37-4864-b36b-5a7ffa1f3a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:32.273326 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:32.286574 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-246b7de8-3a37-4864-b36b-5a7ffa1f3a2d None None] MFA Rules not processed for user `5eb3da4d1e5e4a67830767d040e15a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:32.287779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-246b7de8-3a37-4864-b36b-5a7ffa1f3a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:32.343677 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1155/2310] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:10:36.796645 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe160b3-f85d-46d5-95be-68c70f766aee admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:36.798253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9fe160b3-f85d-46d5-95be-68c70f766aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:36.888431 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe160b3-f85d-46d5-95be-68c70f766aee admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:36.893969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d49b4-b6df-4b72-acbe-c4ae517a5571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:36.895923 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d49b4-b6df-4b72-acbe-c4ae517a5571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:36.896473 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d49b4-b6df-4b72-acbe-c4ae517a5571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:36.897207 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d49b4-b6df-4b72-acbe-c4ae517a5571 admin admin] PATH_INFO: `/v3/users/1ec3eeaf42af4d658e9d9ccbc3483d39` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:36.898854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d49b4-b6df-4b72-acbe-c4ae517a5571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ec3eeaf42af4d658e9d9ccbc3483d39)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:36.900895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d49b4-b6df-4b72-acbe-c4ae517a5571 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:36.995084 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-694d49b4-b6df-4b72-acbe-c4ae517a5571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ec3eeaf42af4d658e9d9ccbc3483d39'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:37.005929 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-694d49b4-b6df-4b72-acbe-c4ae517a5571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ec3eeaf42af4d658e9d9ccbc3483d39'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:37.016558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-694d49b4-b6df-4b72-acbe-c4ae517a5571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ec3eeaf42af4d658e9d9ccbc3483d39'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:37.034428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-694d49b4-b6df-4b72-acbe-c4ae517a5571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ec3eeaf42af4d658e9d9ccbc3483d39'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:37.035329 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-694d49b4-b6df-4b72-acbe-c4ae517a5571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ec3eeaf42af4d658e9d9ccbc3483d39'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:37.038132 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:37.046458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1156/2311] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:10:36 2022] DELETE /identity/v3/users/1ec3eeaf42af4d658e9d9ccbc3483d39 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:37.048300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b361f-d36a-49af-ad16-ca07c7dc0fdf None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:37.048839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b361f-d36a-49af-ad16-ca07c7dc0fdf None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:37.048936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b361f-d36a-49af-ad16-ca07c7dc0fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:37.070000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-808b361f-d36a-49af-ad16-ca07c7dc0fdf None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:37.071414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-808b361f-d36a-49af-ad16-ca07c7dc0fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:37.151292 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1156/2312] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:37.160739 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d49b4-b6df-4b72-acbe-c4ae517a5571 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:37.168293 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-694d49b4-b6df-4b72-acbe-c4ae517a5571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:37.253414 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d49b4-b6df-4b72-acbe-c4ae517a5571 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:37.257270 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1c86f-4ac2-4c55-9a3d-2aff4c1a4d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:37.258111 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1c86f-4ac2-4c55-9a3d-2aff4c1a4d9c service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:37.258408 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1c86f-4ac2-4c55-9a3d-2aff4c1a4d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:37.258706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1c86f-4ac2-4c55-9a3d-2aff4c1a4d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:37.271375 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1c86f-4ac2-4c55-9a3d-2aff4c1a4d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:37.273032 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1c86f-4ac2-4c55-9a3d-2aff4c1a4d9c service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:37.285945 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1157/2313] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:10:37.785884 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b361f-d36a-49af-ad16-ca07c7dc0fdf None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:37.787476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-808b361f-d36a-49af-ad16-ca07c7dc0fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:37.800809 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b361f-d36a-49af-ad16-ca07c7dc0fdf None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:37.805897 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3a083-9a55-40a5-a1ac-81b46875137c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:37.807381 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3a083-9a55-40a5-a1ac-81b46875137c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:37.807665 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3a083-9a55-40a5-a1ac-81b46875137c admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:37.808678 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3a083-9a55-40a5-a1ac-81b46875137c admin admin] PATH_INFO: `/v3/projects/6c2753358fa04332910b4f91b162a889` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:37.809432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3a083-9a55-40a5-a1ac-81b46875137c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c2753358fa04332910b4f91b162a889)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:37.812197 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3a083-9a55-40a5-a1ac-81b46875137c admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:37.865694 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e7e3a083-9a55-40a5-a1ac-81b46875137c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c2753358fa04332910b4f91b162a889', 'request_id': 'req-e7e3a083-9a55-40a5-a1ac-81b46875137c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:37.871886 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e7e3a083-9a55-40a5-a1ac-81b46875137c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c2753358fa04332910b4f91b162a889', 'request_id': 'req-e7e3a083-9a55-40a5-a1ac-81b46875137c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:37.878382 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e7e3a083-9a55-40a5-a1ac-81b46875137c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c2753358fa04332910b4f91b162a889', 'request_id': 'req-e7e3a083-9a55-40a5-a1ac-81b46875137c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:37.890812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e7e3a083-9a55-40a5-a1ac-81b46875137c admin admin] The token cache is being invalidate because project 6c2753358fa04332910b4f91b162a889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:10:37.891099 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e7e3a083-9a55-40a5-a1ac-81b46875137c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:37.891716 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e7e3a083-9a55-40a5-a1ac-81b46875137c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:10:37.893235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1157/2314] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:10:37 2022] DELETE /identity/v3/projects/6c2753358fa04332910b4f91b162a889 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:10:47.279315 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=26 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:47.887565 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:50.291298 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c409d-0c98-4d6a-b440-48c6d3b0fecc None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:50.292124 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c409d-0c98-4d6a-b440-48c6d3b0fecc None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:50.292124 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c409d-0c98-4d6a-b440-48c6d3b0fecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:50.310610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-431c409d-0c98-4d6a-b440-48c6d3b0fecc None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:50.312314 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-431c409d-0c98-4d6a-b440-48c6d3b0fecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:50.372508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1158/2315] 10.222.0.61 () {58 vars in 1016 bytes} [Thu Jul 14 12:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:50.394891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3a083-9a55-40a5-a1ac-81b46875137c admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:50.396380 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e7e3a083-9a55-40a5-a1ac-81b46875137c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:50.467758 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3a083-9a55-40a5-a1ac-81b46875137c admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:50.473167 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73330d4-a5ae-43dd-a6d2-4caed23516b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:50.473807 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73330d4-a5ae-43dd-a6d2-4caed23516b0 service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:50.474090 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73330d4-a5ae-43dd-a6d2-4caed23516b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:50.474367 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73330d4-a5ae-43dd-a6d2-4caed23516b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:50.482594 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73330d4-a5ae-43dd-a6d2-4caed23516b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:50.484178 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73330d4-a5ae-43dd-a6d2-4caed23516b0 service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:50.493888 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1158/2316] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:10:55.359851 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc6031-3120-4f78-8e31-b631c6a64133 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:55.360303 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc6031-3120-4f78-8e31-b631c6a64133 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:55.360406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc6031-3120-4f78-8e31-b631c6a64133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:55.378941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e8cc6031-3120-4f78-8e31-b631c6a64133 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:55.380126 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e8cc6031-3120-4f78-8e31-b631c6a64133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:55.387989 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1159/2317] 10.222.0.61 () {58 vars in 1016 bytes} [Thu Jul 14 12:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:55.409105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73330d4-a5ae-43dd-a6d2-4caed23516b0 service nova] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:55.420622 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73330d4-a5ae-43dd-a6d2-4caed23516b0 service nova] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:55.426718 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469f644-7e9c-44c2-89d4-c797bedd4c5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:55.427354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469f644-7e9c-44c2-89d4-c797bedd4c5d service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:55.427642 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469f644-7e9c-44c2-89d4-c797bedd4c5d service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:55.427950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469f644-7e9c-44c2-89d4-c797bedd4c5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:55.436303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469f644-7e9c-44c2-89d4-c797bedd4c5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:55.438553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469f644-7e9c-44c2-89d4-c797bedd4c5d service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:55.447959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1159/2318] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:10:58.587139 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda1327-e3f0-4b01-bddf-2b87c4720fc3 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:58.587679 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda1327-e3f0-4b01-bddf-2b87c4720fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:58.587782 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda1327-e3f0-4b01-bddf-2b87c4720fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:58.606556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3bda1327-e3f0-4b01-bddf-2b87c4720fc3 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:10:58.607763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3bda1327-e3f0-4b01-bddf-2b87c4720fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:58.616251 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1160/2319] 10.222.0.61 () {58 vars in 1016 bytes} [Thu Jul 14 12:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:10:58.641475 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469f644-7e9c-44c2-89d4-c797bedd4c5d service nova] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:10:58.642919 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-2469f644-7e9c-44c2-89d4-c797bedd4c5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:10:58.657828 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469f644-7e9c-44c2-89d4-c797bedd4c5d service nova] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:10:58.663277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807674c-9be0-422c-9a7b-c48c7abcbc6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:10:58.663913 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807674c-9be0-422c-9a7b-c48c7abcbc6f service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:10:58.664200 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807674c-9be0-422c-9a7b-c48c7abcbc6f service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:10:58.664479 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807674c-9be0-422c-9a7b-c48c7abcbc6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:10:58.673547 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807674c-9be0-422c-9a7b-c48c7abcbc6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:10:58.675180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807674c-9be0-422c-9a7b-c48c7abcbc6f service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:10:58.684656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1160/2320] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:10:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:11:07.849816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaaca4-6731-4d3d-aef8-79519ccda98f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:11:07.850328 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaaca4-6731-4d3d-aef8-79519ccda98f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:11:07.850444 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaaca4-6731-4d3d-aef8-79519ccda98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:11:07.869157 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-7eaaaca4-6731-4d3d-aef8-79519ccda98f None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:11:07.870361 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7eaaaca4-6731-4d3d-aef8-79519ccda98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:11:07.879002 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1161/2321] 10.222.0.61 () {58 vars in 1016 bytes} [Thu Jul 14 12:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:11:07.899791 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807674c-9be0-422c-9a7b-c48c7abcbc6f service nova] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:11:07.910899 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807674c-9be0-422c-9a7b-c48c7abcbc6f service nova] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:11:07.916279 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3025820-eb87-4be7-9ac5-c9da9672890c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:11:07.917171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3025820-eb87-4be7-9ac5-c9da9672890c service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:11:07.917453 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3025820-eb87-4be7-9ac5-c9da9672890c service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:11:07.917729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3025820-eb87-4be7-9ac5-c9da9672890c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:11:07.926333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3025820-eb87-4be7-9ac5-c9da9672890c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:11:07.927942 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3025820-eb87-4be7-9ac5-c9da9672890c service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:11:07.937778 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1161/2322] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:11:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:11:12.407012 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad5e51-2459-4669-8a70-166127a10a8b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:11:12.407516 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad5e51-2459-4669-8a70-166127a10a8b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:11:12.407616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad5e51-2459-4669-8a70-166127a10a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:11:12.427155 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-fdad5e51-2459-4669-8a70-166127a10a8b None None] MFA Rules not processed for user `f64d942793a5493787c3e5c7815bc134`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:11:12.428935 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-fdad5e51-2459-4669-8a70-166127a10a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:11:12.482996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1162/2323] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Jul 14 12:11:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:11:12.528949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3025820-eb87-4be7-9ac5-c9da9672890c service nova] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:11:12.530387 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e3025820-eb87-4be7-9ac5-c9da9672890c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:11:12.601381 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3025820-eb87-4be7-9ac5-c9da9672890c service nova] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:11:12.606642 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02184fb0-d143-42f9-a571-058b6778a3f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969ee98dfe644ef2a016860aa1585317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:11:12.607297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02184fb0-d143-42f9-a571-058b6778a3f7 service swift] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:11:12.607580 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02184fb0-d143-42f9-a571-058b6778a3f7 service swift] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:11:12.607856 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02184fb0-d143-42f9-a571-058b6778a3f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:11:12.616329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02184fb0-d143-42f9-a571-058b6778a3f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:11:12.617872 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02184fb0-d143-42f9-a571-058b6778a3f7 service swift] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:11:12.627058 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1162/2324] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Jul 14 12:11:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 12:11:13.070691 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5c9e4-0362-4ad3-9f28-b51395430ac2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:11:13.071123 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5c9e4-0362-4ad3-9f28-b51395430ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:11:13.071288 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5c9e4-0362-4ad3-9f28-b51395430ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:11:13.094202 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-58b5c9e4-0362-4ad3-9f28-b51395430ac2 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:11:13.095483 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-58b5c9e4-0362-4ad3-9f28-b51395430ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:11:13.105780 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1163/2325] 10.222.0.61 () {58 vars in 1016 bytes} [Thu Jul 14 12:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:11:13.134834 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02184fb0-d143-42f9-a571-058b6778a3f7 service swift] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:11:13.155744 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02184fb0-d143-42f9-a571-058b6778a3f7 service swift] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:11:13.167972 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c4689-77ce-4ff3-b67a-170b304370ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:11:13.168646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c4689-77ce-4ff3-b67a-170b304370ee service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:11:13.168935 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c4689-77ce-4ff3-b67a-170b304370ee service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:11:13.169243 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c4689-77ce-4ff3-b67a-170b304370ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:11:13.184730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c4689-77ce-4ff3-b67a-170b304370ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:11:13.186369 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c4689-77ce-4ff3-b67a-170b304370ee service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:11:13.213293 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1163/2326] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:11:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:11:17.360054 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6921f-5479-4ac5-861d-5af3411a68d4 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:11:17.360737 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6921f-5479-4ac5-861d-5af3411a68d4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:11:17.360737 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6921f-5479-4ac5-861d-5af3411a68d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:11:17.371045 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=65 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:11:17.388037 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e2e6921f-5479-4ac5-861d-5af3411a68d4 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:11:17.389274 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e2e6921f-5479-4ac5-861d-5af3411a68d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:11:17.398326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1164/2327] 10.222.0.61 () {58 vars in 1016 bytes} [Thu Jul 14 12:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:11:17.422480 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c4689-77ce-4ff3-b67a-170b304370ee service nova] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:11:17.438519 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c4689-77ce-4ff3-b67a-170b304370ee service nova] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:11:17.445380 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b1182-9e16-4740-b3fb-869e16fc929e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:11:17.446043 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b1182-9e16-4740-b3fb-869e16fc929e service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:11:17.446331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b1182-9e16-4740-b3fb-869e16fc929e service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:11:17.446661 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b1182-9e16-4740-b3fb-869e16fc929e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:11:17.456013 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b1182-9e16-4740-b3fb-869e16fc929e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:11:17.457619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b1182-9e16-4740-b3fb-869e16fc929e service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:11:17.487336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1164/2328] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:11:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:11:27.380211 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:11:27.463878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=96 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:11:32.071806 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1c259-7318-45ac-81e8-63adfc848dab None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:11:32.072448 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1c259-7318-45ac-81e8-63adfc848dab None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:11:32.072448 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1c259-7318-45ac-81e8-63adfc848dab None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:11:32.073746 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1165/2329] 10.222.0.79 () {54 vars in 921 bytes} [Thu Jul 14 12:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:11:32.080807 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee1db2-e8f1-44fa-bf93-4f8318a2f9f7 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:11:32.081325 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee1db2-e8f1-44fa-bf93-4f8318a2f9f7 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:11:32.081325 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee1db2-e8f1-44fa-bf93-4f8318a2f9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:11:32.100692 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-37ee1db2-e8f1-44fa-bf93-4f8318a2f9f7 None None] MFA Rules not processed for user `e41a4d3a822c403fad048764a0edf209`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:11:32.101897 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-37ee1db2-e8f1-44fa-bf93-4f8318a2f9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:11:32.111507 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1165/2330] 10.222.0.79 () {58 vars in 1018 bytes} [Thu Jul 14 12:11:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:11:32.125008 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1c259-7318-45ac-81e8-63adfc848dab None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:11:32.126911 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-81c1c259-7318-45ac-81e8-63adfc848dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:11:32.190478 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1c259-7318-45ac-81e8-63adfc848dab None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:11:32.194031 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6acb0c-325b-458e-85d8-720a12505e64 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6921990ec98492f8f4420f911208b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:11:32.194722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6acb0c-325b-458e-85d8-720a12505e64 service glance] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:11:32.195009 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6acb0c-325b-458e-85d8-720a12505e64 service glance] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:11:32.195286 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6acb0c-325b-458e-85d8-720a12505e64 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:11:32.213050 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6acb0c-325b-458e-85d8-720a12505e64 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:11:32.214758 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6acb0c-325b-458e-85d8-720a12505e64 service glance] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:11:32.230662 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1166/2331] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:11:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:11:32.295662 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104d706-5d0c-4801-8df1-fe83e06359aa None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:11:32.295955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104d706-5d0c-4801-8df1-fe83e06359aa None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:11:32.296235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104d706-5d0c-4801-8df1-fe83e06359aa None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:11:32.297622 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1166/2332] 10.222.0.79 () {54 vars in 921 bytes} [Thu Jul 14 12:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:11:32.302158 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e1ca0-8509-49c8-9eec-e19b45040664 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:11:32.302659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e1ca0-8509-49c8-9eec-e19b45040664 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:11:32.302838 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e1ca0-8509-49c8-9eec-e19b45040664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:11:32.320995 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ef2e1ca0-8509-49c8-9eec-e19b45040664 None None] MFA Rules not processed for user `2fedd4e015384379bf41c2e01ecc0a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:11:32.322233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ef2e1ca0-8509-49c8-9eec-e19b45040664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:11:32.373541 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1167/2333] 10.222.0.79 () {58 vars in 1018 bytes} [Thu Jul 14 12:11:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:11:32.385068 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104d706-5d0c-4801-8df1-fe83e06359aa None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:11:32.386843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-f104d706-5d0c-4801-8df1-fe83e06359aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:11:32.400500 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104d706-5d0c-4801-8df1-fe83e06359aa None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:11:32.404077 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760f0e6-36cc-45ab-b496-4aa566f581dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:11:32.404713 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760f0e6-36cc-45ab-b496-4aa566f581dd service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:11:32.405003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760f0e6-36cc-45ab-b496-4aa566f581dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:11:32.405281 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760f0e6-36cc-45ab-b496-4aa566f581dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:11:32.413186 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760f0e6-36cc-45ab-b496-4aa566f581dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:11:32.414637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760f0e6-36cc-45ab-b496-4aa566f581dd service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:11:32.422992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1167/2334] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:11:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:11:32.510319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a530c-332b-48f3-bf31-6c7afc9f223a None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:11:32.510657 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a530c-332b-48f3-bf31-6c7afc9f223a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:11:32.510934 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a530c-332b-48f3-bf31-6c7afc9f223a None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:11:32.512307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1168/2335] 10.222.0.79 () {54 vars in 921 bytes} [Thu Jul 14 12:11:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:11:32.518296 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc470c-1034-460b-81c5-13b3d8250ec6 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:11:32.518714 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc470c-1034-460b-81c5-13b3d8250ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:11:32.519087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc470c-1034-460b-81c5-13b3d8250ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:11:32.538277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-46bc470c-1034-460b-81c5-13b3d8250ec6 None None] MFA Rules not processed for user `e41a4d3a822c403fad048764a0edf209`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:11:32.539513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-46bc470c-1034-460b-81c5-13b3d8250ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:11:32.548988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1168/2336] 10.222.0.79 () {58 vars in 1018 bytes} [Thu Jul 14 12:11:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:11:32.559498 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a530c-332b-48f3-bf31-6c7afc9f223a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:11:32.561652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-453a530c-332b-48f3-bf31-6c7afc9f223a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:11:32.576995 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a530c-332b-48f3-bf31-6c7afc9f223a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:11:32.580622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf96868-849e-4ff3-85e4-8514019a2185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:11:32.581266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf96868-849e-4ff3-85e4-8514019a2185 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:11:32.581570 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf96868-849e-4ff3-85e4-8514019a2185 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:11:32.581839 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf96868-849e-4ff3-85e4-8514019a2185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:11:32.592768 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf96868-849e-4ff3-85e4-8514019a2185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:11:32.594185 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf96868-849e-4ff3-85e4-8514019a2185 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:11:32.605006 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1169/2337] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:11:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:11:36.914640 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267149ed-1b72-4d9d-aaf5-5684ee40effd None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:11:36.915173 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267149ed-1b72-4d9d-aaf5-5684ee40effd None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:11:36.915314 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267149ed-1b72-4d9d-aaf5-5684ee40effd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:11:36.936405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-267149ed-1b72-4d9d-aaf5-5684ee40effd None None] MFA Rules not processed for user `31cf6712c5ec4fc993640d5afcf3e6a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:11:36.938237 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-267149ed-1b72-4d9d-aaf5-5684ee40effd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:11:37.010924 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1169/2338] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:11:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:11:37.025088 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171f421-29e2-4e83-b14f-fb46a646926a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:11:37.025544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171f421-29e2-4e83-b14f-fb46a646926a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:11:37.025649 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171f421-29e2-4e83-b14f-fb46a646926a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:11:37.044390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-0171f421-29e2-4e83-b14f-fb46a646926a None None] MFA Rules not processed for user `f64d942793a5493787c3e5c7815bc134`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:11:37.045664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0171f421-29e2-4e83-b14f-fb46a646926a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:11:37.052985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1170/2339] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Jul 14 12:11:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:11:37.064714 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267149ed-1b72-4d9d-aaf5-5684ee40effd None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:11:37.078883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267149ed-1b72-4d9d-aaf5-5684ee40effd None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:11:37.085477 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f594f-9190-48ee-a02b-1104bfd3152c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969ee98dfe644ef2a016860aa1585317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:11:37.086242 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f594f-9190-48ee-a02b-1104bfd3152c service swift] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:11:37.086593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f594f-9190-48ee-a02b-1104bfd3152c service swift] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:11:37.086874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f594f-9190-48ee-a02b-1104bfd3152c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:11:37.096056 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f594f-9190-48ee-a02b-1104bfd3152c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:11:37.097678 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f594f-9190-48ee-a02b-1104bfd3152c service swift] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:11:37.107680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1170/2340] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Jul 14 12:11:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 12:11:47.039159 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=58 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:11:47.103714 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=43 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:11:49.547891 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171f421-29e2-4e83-b14f-fb46a646926a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:11:49.549434 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0171f421-29e2-4e83-b14f-fb46a646926a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:11:49.628403 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171f421-29e2-4e83-b14f-fb46a646926a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:11:49.634672 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ad7e7-6973-44bd-b7c4-6fe8b00e8673 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6070c6b901f4e2ebe621a3e42dd2d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:11:49.635335 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ad7e7-6973-44bd-b7c4-6fe8b00e8673 service placement] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:11:49.635628 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ad7e7-6973-44bd-b7c4-6fe8b00e8673 service placement] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:11:49.635937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ad7e7-6973-44bd-b7c4-6fe8b00e8673 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:11:49.637875 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ea3ad7e7-6973-44bd-b7c4-6fe8b00e8673 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:11:49.650261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ad7e7-6973-44bd-b7c4-6fe8b00e8673 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:11:49.651978 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ad7e7-6973-44bd-b7c4-6fe8b00e8673 service placement] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:11:49.663301 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1171/2341] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:11:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:11:59.658618 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=32 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:11:59.662519 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d6cf3-e144-4522-be3d-dbc9b23b969c None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:11:59.662960 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d6cf3-e144-4522-be3d-dbc9b23b969c None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:11:59.663069 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d6cf3-e144-4522-be3d-dbc9b23b969c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:11:59.680835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-e32d6cf3-e144-4522-be3d-dbc9b23b969c None None] MFA Rules not processed for user `2c19c490070a405ab2f48336c5b842df`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:11:59.682043 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e32d6cf3-e144-4522-be3d-dbc9b23b969c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:11:59.737487 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1171/2342] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:11:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:12:00.020372 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be2af6-39d8-440b-9f7d-d9408d036d15 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:12:00.020665 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be2af6-39d8-440b-9f7d-d9408d036d15 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:12:00.021460 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be2af6-39d8-440b-9f7d-d9408d036d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:12:00.041683 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-68be2af6-39d8-440b-9f7d-d9408d036d15 None None] MFA Rules not processed for user `f64d942793a5493787c3e5c7815bc134`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:12:00.043240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-68be2af6-39d8-440b-9f7d-d9408d036d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:12:00.051865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1172/2343] 10.222.0.79 () {58 vars in 967 bytes} [Thu Jul 14 12:12:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:12:00.066235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d6cf3-e144-4522-be3d-dbc9b23b969c None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:12:00.081521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d6cf3-e144-4522-be3d-dbc9b23b969c None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:12:00.088583 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc6273-ee0d-4903-b659-052f92dfe65c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969ee98dfe644ef2a016860aa1585317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:12:00.090413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc6273-ee0d-4903-b659-052f92dfe65c service swift] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:12:00.090909 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc6273-ee0d-4903-b659-052f92dfe65c service swift] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:12:00.091524 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc6273-ee0d-4903-b659-052f92dfe65c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:12:00.101870 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc6273-ee0d-4903-b659-052f92dfe65c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:12:00.103534 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc6273-ee0d-4903-b659-052f92dfe65c service swift] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:12:00.113254 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1172/2344] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Jul 14 12:12:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 12:12:09.162934 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b67d8d-b188-46dc-a383-e0a45b14f211 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:12:09.163442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b67d8d-b188-46dc-a383-e0a45b14f211 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:12:09.163536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b67d8d-b188-46dc-a383-e0a45b14f211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:12:09.181610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-44b67d8d-b188-46dc-a383-e0a45b14f211 None None] MFA Rules not processed for user `5eb3da4d1e5e4a67830767d040e15a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:12:09.182804 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-44b67d8d-b188-46dc-a383-e0a45b14f211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:12:09.237568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1173/2345] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:12:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:12:10.109792 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=31 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:12:10.432301 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65270b60-9019-49c6-98b2-485dce4a6282 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:12:10.432597 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65270b60-9019-49c6-98b2-485dce4a6282 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:12:10.432874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65270b60-9019-49c6-98b2-485dce4a6282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:12:10.452284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-65270b60-9019-49c6-98b2-485dce4a6282 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:12:10.453680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-65270b60-9019-49c6-98b2-485dce4a6282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:12:10.462286 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1173/2346] 10.222.0.61 () {58 vars in 1016 bytes} [Thu Jul 14 12:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:12:10.496576 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b67d8d-b188-46dc-a383-e0a45b14f211 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:12:10.510788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b67d8d-b188-46dc-a383-e0a45b14f211 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:12:10.516901 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df4374-2e7b-4207-abf6-e5d9514a3875 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:12:10.517739 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df4374-2e7b-4207-abf6-e5d9514a3875 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:12:10.518037 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df4374-2e7b-4207-abf6-e5d9514a3875 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:12:10.518315 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df4374-2e7b-4207-abf6-e5d9514a3875 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:12:10.529206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df4374-2e7b-4207-abf6-e5d9514a3875 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:12:10.530770 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df4374-2e7b-4207-abf6-e5d9514a3875 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:12:10.547055 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1174/2347] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:12:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:12:14.816619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212a247-f1fd-45f1-ab0b-f0d228febda0 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:12:14.817151 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212a247-f1fd-45f1-ab0b-f0d228febda0 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:12:14.817267 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212a247-f1fd-45f1-ab0b-f0d228febda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:12:14.839683 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-f212a247-f1fd-45f1-ab0b-f0d228febda0 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:12:14.841074 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-f212a247-f1fd-45f1-ab0b-f0d228febda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:12:14.849917 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1174/2348] 10.222.0.61 () {58 vars in 1016 bytes} [Thu Jul 14 12:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:12:14.924820 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df4374-2e7b-4207-abf6-e5d9514a3875 service nova] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:12:14.936583 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df4374-2e7b-4207-abf6-e5d9514a3875 service nova] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:12:14.942388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c1624-57f4-42e9-ba7e-9448061ec0a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:12:14.943224 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c1624-57f4-42e9-ba7e-9448061ec0a0 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:12:14.943582 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c1624-57f4-42e9-ba7e-9448061ec0a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:12:14.943869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c1624-57f4-42e9-ba7e-9448061ec0a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:12:14.953838 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c1624-57f4-42e9-ba7e-9448061ec0a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:12:14.956080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c1624-57f4-42e9-ba7e-9448061ec0a0 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:12:14.969941 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1175/2349] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:12:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:12:17.826835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2cb93-e95e-4b10-96b4-3eedfe3d0fb1 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:12:17.827403 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2cb93-e95e-4b10-96b4-3eedfe3d0fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:12:17.827403 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2cb93-e95e-4b10-96b4-3eedfe3d0fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:12:17.847248 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-3cc2cb93-e95e-4b10-96b4-3eedfe3d0fb1 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:12:17.848501 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-3cc2cb93-e95e-4b10-96b4-3eedfe3d0fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:12:17.856662 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1175/2350] 10.222.0.61 () {58 vars in 1016 bytes} [Thu Jul 14 12:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:12:17.894440 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c1624-57f4-42e9-ba7e-9448061ec0a0 service nova] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:12:17.905700 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c1624-57f4-42e9-ba7e-9448061ec0a0 service nova] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:12:17.911418 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3b6cf-d045-439c-9b32-7016e37b2618 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:12:17.912046 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3b6cf-d045-439c-9b32-7016e37b2618 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:12:17.912328 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3b6cf-d045-439c-9b32-7016e37b2618 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:12:17.912600 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3b6cf-d045-439c-9b32-7016e37b2618 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:12:17.921340 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3b6cf-d045-439c-9b32-7016e37b2618 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:12:17.923076 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3b6cf-d045-439c-9b32-7016e37b2618 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:12:17.934172 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1176/2351] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:12:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:12:23.056257 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618646b-87fd-48d3-8ac4-ab9474360610 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:12:23.056748 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618646b-87fd-48d3-8ac4-ab9474360610 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:12:23.056748 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618646b-87fd-48d3-8ac4-ab9474360610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:12:23.074793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-3618646b-87fd-48d3-8ac4-ab9474360610 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:12:23.076024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-3618646b-87fd-48d3-8ac4-ab9474360610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:12:23.083917 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1176/2352] 10.222.0.61 () {58 vars in 1016 bytes} [Thu Jul 14 12:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:12:23.125225 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3b6cf-d045-439c-9b32-7016e37b2618 service nova] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:12:23.136622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3b6cf-d045-439c-9b32-7016e37b2618 service nova] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:12:23.142245 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba309aa3-94e5-492f-bda6-c245c90d23a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:12:23.142915 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba309aa3-94e5-492f-bda6-c245c90d23a0 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:12:23.143202 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba309aa3-94e5-492f-bda6-c245c90d23a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:12:23.143487 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba309aa3-94e5-492f-bda6-c245c90d23a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:12:23.152712 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba309aa3-94e5-492f-bda6-c245c90d23a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:12:23.154296 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba309aa3-94e5-492f-bda6-c245c90d23a0 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:12:23.164210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1177/2353] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:12:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:12:28.279342 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590262e3-9e6b-41f6-9664-b0aca5c4d589 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:12:28.279934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590262e3-9e6b-41f6-9664-b0aca5c4d589 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:12:28.279934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590262e3-9e6b-41f6-9664-b0aca5c4d589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:12:28.297898 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-590262e3-9e6b-41f6-9664-b0aca5c4d589 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:12:28.299140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-590262e3-9e6b-41f6-9664-b0aca5c4d589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:12:28.307584 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1177/2354] 10.222.0.61 () {58 vars in 1016 bytes} [Thu Jul 14 12:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:12:28.330882 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba309aa3-94e5-492f-bda6-c245c90d23a0 service nova] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:12:28.341957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba309aa3-94e5-492f-bda6-c245c90d23a0 service nova] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:12:28.347517 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93160b87-d9c2-49b3-ad54-f35583bf56b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:12:28.348152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93160b87-d9c2-49b3-ad54-f35583bf56b7 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:12:28.348436 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93160b87-d9c2-49b3-ad54-f35583bf56b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:12:28.348715 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93160b87-d9c2-49b3-ad54-f35583bf56b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:12:28.356910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93160b87-d9c2-49b3-ad54-f35583bf56b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:12:28.358477 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93160b87-d9c2-49b3-ad54-f35583bf56b7 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:12:28.367857 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1178/2355] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:12:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:12:38.292817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=15 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:12:38.363741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=58 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:12:58.847585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e4d3b-573b-4210-9bfe-151bd778a822 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:12:58.848298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e4d3b-573b-4210-9bfe-151bd778a822 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:12:58.848401 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e4d3b-573b-4210-9bfe-151bd778a822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:12:58.868500 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-6e1e4d3b-573b-4210-9bfe-151bd778a822 None None] MFA Rules not processed for user `5f89347016394f69bde41b3632e94c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:12:58.869720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-6e1e4d3b-573b-4210-9bfe-151bd778a822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:12:58.931973 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1178/2356] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:12:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:13:00.503401 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93160b87-d9c2-49b3-ad54-f35583bf56b7 service nova] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:13:00.510713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-93160b87-d9c2-49b3-ad54-f35583bf56b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:13:00.524885 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93160b87-d9c2-49b3-ad54-f35583bf56b7 service nova] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:13:00.530544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b5298-f8d2-461e-9d31-eb76930d2172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:13:00.531436 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b5298-f8d2-461e-9d31-eb76930d2172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:00.531728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b5298-f8d2-461e-9d31-eb76930d2172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:00.532017 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b5298-f8d2-461e-9d31-eb76930d2172 admin admin] PATH_INFO: `/v3/users/31cf6712c5ec4fc993640d5afcf3e6a4` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:00.533228 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b5298-f8d2-461e-9d31-eb76930d2172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31cf6712c5ec4fc993640d5afcf3e6a4)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:13:00.535358 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b5298-f8d2-461e-9d31-eb76930d2172 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:13:00.583866 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-263b5298-f8d2-461e-9d31-eb76930d2172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31cf6712c5ec4fc993640d5afcf3e6a4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:13:00.594392 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-263b5298-f8d2-461e-9d31-eb76930d2172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31cf6712c5ec4fc993640d5afcf3e6a4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:13:00.602815 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-263b5298-f8d2-461e-9d31-eb76930d2172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31cf6712c5ec4fc993640d5afcf3e6a4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:13:00.616836 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-263b5298-f8d2-461e-9d31-eb76930d2172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31cf6712c5ec4fc993640d5afcf3e6a4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:13:00.617789 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-263b5298-f8d2-461e-9d31-eb76930d2172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31cf6712c5ec4fc993640d5afcf3e6a4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:13:00.624080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1179/2357] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:13:00 2022] DELETE /identity/v3/users/31cf6712c5ec4fc993640d5afcf3e6a4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:13:00.895136 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e4d3b-573b-4210-9bfe-151bd778a822 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:13:00.912965 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e4d3b-573b-4210-9bfe-151bd778a822 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:13:00.979297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f437d2-d1f4-4e15-9f1b-2959d0c41b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:13:00.980187 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f437d2-d1f4-4e15-9f1b-2959d0c41b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:00.980473 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f437d2-d1f4-4e15-9f1b-2959d0c41b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:00.980749 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f437d2-d1f4-4e15-9f1b-2959d0c41b7d admin admin] PATH_INFO: `/v3/projects/eb1ec6cdf3e444fabde6ef47e45b6a99` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:00.982583 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f437d2-d1f4-4e15-9f1b-2959d0c41b7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb1ec6cdf3e444fabde6ef47e45b6a99)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:13:00.984697 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f437d2-d1f4-4e15-9f1b-2959d0c41b7d admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:13:01.034480 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-20f437d2-d1f4-4e15-9f1b-2959d0c41b7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb1ec6cdf3e444fabde6ef47e45b6a99', 'request_id': 'req-20f437d2-d1f4-4e15-9f1b-2959d0c41b7d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:13:01.041009 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-20f437d2-d1f4-4e15-9f1b-2959d0c41b7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb1ec6cdf3e444fabde6ef47e45b6a99', 'request_id': 'req-20f437d2-d1f4-4e15-9f1b-2959d0c41b7d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:13:01.047186 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-20f437d2-d1f4-4e15-9f1b-2959d0c41b7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb1ec6cdf3e444fabde6ef47e45b6a99', 'request_id': 'req-20f437d2-d1f4-4e15-9f1b-2959d0c41b7d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:13:01.063467 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-20f437d2-d1f4-4e15-9f1b-2959d0c41b7d admin admin] The token cache is being invalidate because project eb1ec6cdf3e444fabde6ef47e45b6a99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:13:01.063701 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-20f437d2-d1f4-4e15-9f1b-2959d0c41b7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:13:01.064469 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-20f437d2-d1f4-4e15-9f1b-2959d0c41b7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:13:01.066274 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1179/2358] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:13:00 2022] DELETE /identity/v3/projects/eb1ec6cdf3e444fabde6ef47e45b6a99 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:13:01.071410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e361cae-ac9a-42b5-b096-d7e3bd898e91 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:01.071704 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e361cae-ac9a-42b5-b096-d7e3bd898e91 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:01.071986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e361cae-ac9a-42b5-b096-d7e3bd898e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:01.092922 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-0e361cae-ac9a-42b5-b096-d7e3bd898e91 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:13:01.094140 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0e361cae-ac9a-42b5-b096-d7e3bd898e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:13:01.179774 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1180/2359] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:13:01.189908 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4d8ad-12e7-4ad1-964b-fce6e8cc944a None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:01.190267 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4d8ad-12e7-4ad1-964b-fce6e8cc944a None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:01.190744 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4d8ad-12e7-4ad1-964b-fce6e8cc944a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:01.214140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-70e4d8ad-12e7-4ad1-964b-fce6e8cc944a None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:13:01.216293 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-70e4d8ad-12e7-4ad1-964b-fce6e8cc944a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:13:01.227308 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1180/2360] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:13:01.233895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e361cae-ac9a-42b5-b096-d7e3bd898e91 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:13:01.248894 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e361cae-ac9a-42b5-b096-d7e3bd898e91 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:13:01.255304 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946cdb7-efb7-4f67-acaf-ac4c09cf44c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:13:01.256291 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946cdb7-efb7-4f67-acaf-ac4c09cf44c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:01.256793 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946cdb7-efb7-4f67-acaf-ac4c09cf44c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:01.257324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946cdb7-efb7-4f67-acaf-ac4c09cf44c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:01.258895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946cdb7-efb7-4f67-acaf-ac4c09cf44c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:13:01.259490 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946cdb7-efb7-4f67-acaf-ac4c09cf44c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:13:01.262059 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946cdb7-efb7-4f67-acaf-ac4c09cf44c1 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:13:01.276441 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1181/2361] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:13:01.283354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4d8ad-12e7-4ad1-964b-fce6e8cc944a None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:13:01.295483 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4d8ad-12e7-4ad1-964b-fce6e8cc944a None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:13:01.301602 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4e9a0-21d3-494b-877e-8b2288008aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:13:01.302270 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4e9a0-21d3-494b-877e-8b2288008aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:01.302584 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4e9a0-21d3-494b-877e-8b2288008aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:01.302865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4e9a0-21d3-494b-877e-8b2288008aa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:01.303573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4e9a0-21d3-494b-877e-8b2288008aa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:13:01.305999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4e9a0-21d3-494b-877e-8b2288008aa7 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:13:01.338653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1181/2362] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:13:01 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:13:01.343306 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946cdb7-efb7-4f67-acaf-ac4c09cf44c1 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:13:01.353898 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946cdb7-efb7-4f67-acaf-ac4c09cf44c1 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:13:01.419324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641bd51-bac0-477f-8f44-562f32ce62d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:13:01.420016 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641bd51-bac0-477f-8f44-562f32ce62d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:01.420305 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641bd51-bac0-477f-8f44-562f32ce62d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:01.420587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641bd51-bac0-477f-8f44-562f32ce62d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:01.421311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641bd51-bac0-477f-8f44-562f32ce62d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:13:01.423310 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641bd51-bac0-477f-8f44-562f32ce62d5 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:13:01.430117 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:13:01.452835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1182/2363] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:13:01 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:13:01.454785 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4e9a0-21d3-494b-877e-8b2288008aa7 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:13:01.468164 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4e9a0-21d3-494b-877e-8b2288008aa7 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:13:01.480031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc48d6-ba6f-4efa-9d82-a0d76c47d6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:13:01.480727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc48d6-ba6f-4efa-9d82-a0d76c47d6ca admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:01.481054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc48d6-ba6f-4efa-9d82-a0d76c47d6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:01.481857 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc48d6-ba6f-4efa-9d82-a0d76c47d6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:01.482635 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc48d6-ba6f-4efa-9d82-a0d76c47d6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:13:01.484286 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc48d6-ba6f-4efa-9d82-a0d76c47d6ca admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:13:01.487075 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:13:01.503418 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1182/2364] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:13:01.504589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641bd51-bac0-477f-8f44-562f32ce62d5 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:13:01.518630 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641bd51-bac0-477f-8f44-562f32ce62d5 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:13:01.523604 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df4b30-f7a3-4ac0-bdd0-4565b5197174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:13:01.524385 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df4b30-f7a3-4ac0-bdd0-4565b5197174 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:01.524664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df4b30-f7a3-4ac0-bdd0-4565b5197174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:01.524946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df4b30-f7a3-4ac0-bdd0-4565b5197174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:01.525692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df4b30-f7a3-4ac0-bdd0-4565b5197174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:13:01.527391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df4b30-f7a3-4ac0-bdd0-4565b5197174 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:13:01.540977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1183/2365] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:13:01.545670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc48d6-ba6f-4efa-9d82-a0d76c47d6ca admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:13:01.555983 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc48d6-ba6f-4efa-9d82-a0d76c47d6ca admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:13:01.561087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b6232-94f4-4951-8984-70b5a0ec0162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:13:01.562241 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b6232-94f4-4951-8984-70b5a0ec0162 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:01.562553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b6232-94f4-4951-8984-70b5a0ec0162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:01.562831 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b6232-94f4-4951-8984-70b5a0ec0162 admin admin] PATH_INFO: `/v3/projects/86e0a15cb51d4bdabb4624909143a1da/users/8066c3b7ce244c27a8c5dae3431a7235/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:01.585536 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b6232-94f4-4951-8984-70b5a0ec0162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e0a15cb51d4bdabb4624909143a1da, user_id=8066c3b7ce244c27a8c5dae3431a7235, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:13:01.588269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b6232-94f4-4951-8984-70b5a0ec0162 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:13:01.607958 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1183/2366] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:13:01 2022] PUT /identity/v3/projects/86e0a15cb51d4bdabb4624909143a1da/users/8066c3b7ce244c27a8c5dae3431a7235/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:13:01.609286 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dd4e4-9073-4c57-ac1c-a783de2cfe4d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:01.609644 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dd4e4-9073-4c57-ac1c-a783de2cfe4d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:01.609998 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dd4e4-9073-4c57-ac1c-a783de2cfe4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:01.631048 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-579dd4e4-9073-4c57-ac1c-a783de2cfe4d None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:13:01.632140 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-579dd4e4-9073-4c57-ac1c-a783de2cfe4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:13:01.696440 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1184/2367] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:13:01.707098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b6232-94f4-4951-8984-70b5a0ec0162 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:13:01.708917 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-169b6232-94f4-4951-8984-70b5a0ec0162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:13:01.784895 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b6232-94f4-4951-8984-70b5a0ec0162 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:13:01.789665 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39db7cb-a755-46e0-89a7-3a557124521d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:13:01.790323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39db7cb-a755-46e0-89a7-3a557124521d service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:01.790894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39db7cb-a755-46e0-89a7-3a557124521d service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:01.791195 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39db7cb-a755-46e0-89a7-3a557124521d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:01.801203 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39db7cb-a755-46e0-89a7-3a557124521d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:13:01.802696 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39db7cb-a755-46e0-89a7-3a557124521d service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:13:01.813764 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1184/2368] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:13:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:13:06.468979 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcf0bb-3cde-4c42-b468-d4b4e99bb4bc None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:06.469502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcf0bb-3cde-4c42-b468-d4b4e99bb4bc None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:06.469599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcf0bb-3cde-4c42-b468-d4b4e99bb4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:06.499798 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-4fbcf0bb-3cde-4c42-b468-d4b4e99bb4bc None None] MFA Rules not processed for user `8066c3b7ce244c27a8c5dae3431a7235`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:13:06.501033 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4fbcf0bb-3cde-4c42-b468-d4b4e99bb4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:13:06.576762 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1185/2369] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:13:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:13:06.581812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39db7cb-a755-46e0-89a7-3a557124521d service neutron] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:13:06.593198 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39db7cb-a755-46e0-89a7-3a557124521d service neutron] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:13:06.598404 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb81e41-5442-4ced-9e58-1ceb97368539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:13:06.599222 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb81e41-5442-4ced-9e58-1ceb97368539 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:06.599512 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb81e41-5442-4ced-9e58-1ceb97368539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:06.599794 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb81e41-5442-4ced-9e58-1ceb97368539 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:06.600498 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb81e41-5442-4ced-9e58-1ceb97368539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:13:06.602431 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb81e41-5442-4ced-9e58-1ceb97368539 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:13:06.632723 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1185/2370] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:13:06 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:13:06.638532 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbcf0bb-3cde-4c42-b468-d4b4e99bb4bc None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:13:06.655633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbcf0bb-3cde-4c42-b468-d4b4e99bb4bc None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:13:06.722539 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5cbda8-bc25-4a4e-8302-4716f05c21cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:13:06.723165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cbda8-bc25-4a4e-8302-4716f05c21cf admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:06.723431 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cbda8-bc25-4a4e-8302-4716f05c21cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:06.723716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cbda8-bc25-4a4e-8302-4716f05c21cf admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:06.724549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cbda8-bc25-4a4e-8302-4716f05c21cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:13:06.726476 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cbda8-bc25-4a4e-8302-4716f05c21cf admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:13:06.745147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:13:06.755055 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1186/2371] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:13:06 2022] POST /identity/v3/users => generated 299 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:13:06.758832 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb81e41-5442-4ced-9e58-1ceb97368539 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:13:06.771555 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb81e41-5442-4ced-9e58-1ceb97368539 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:13:06.776664 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963f688-2be5-41a1-8d00-450f8eced0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:13:06.777352 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963f688-2be5-41a1-8d00-450f8eced0da admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:06.777672 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963f688-2be5-41a1-8d00-450f8eced0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:06.777953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963f688-2be5-41a1-8d00-450f8eced0da admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:06.778722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963f688-2be5-41a1-8d00-450f8eced0da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:13:06.780378 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963f688-2be5-41a1-8d00-450f8eced0da admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:13:06.797970 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1186/2372] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:13:06.799227 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5cbda8-bc25-4a4e-8302-4716f05c21cf admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:13:06.810446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5cbda8-bc25-4a4e-8302-4716f05c21cf admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:13:06.815610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50be12-ae1c-4d90-b03c-02288df52f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:13:06.817107 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50be12-ae1c-4d90-b03c-02288df52f8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:06.817107 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50be12-ae1c-4d90-b03c-02288df52f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:06.817350 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50be12-ae1c-4d90-b03c-02288df52f8e admin admin] PATH_INFO: `/v3/projects/6ad18761fc0f43b0aa9a1ead439ee444/users/9d82b7d9fc334a0e8145845d7ede186b/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:06.837926 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50be12-ae1c-4d90-b03c-02288df52f8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ad18761fc0f43b0aa9a1ead439ee444, user_id=9d82b7d9fc334a0e8145845d7ede186b, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:13:06.842022 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50be12-ae1c-4d90-b03c-02288df52f8e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:13:06.898914 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1187/2373] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:13:06 2022] PUT /identity/v3/projects/6ad18761fc0f43b0aa9a1ead439ee444/users/9d82b7d9fc334a0e8145845d7ede186b/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:13:06.900932 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963f688-2be5-41a1-8d00-450f8eced0da admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:13:06.912200 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963f688-2be5-41a1-8d00-450f8eced0da admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:13:06.997467 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7034b-34b5-4d88-830d-b444be566776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:13:06.998629 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7034b-34b5-4d88-830d-b444be566776 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:06.999900 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7034b-34b5-4d88-830d-b444be566776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:07.000667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7034b-34b5-4d88-830d-b444be566776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:07.001530 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7034b-34b5-4d88-830d-b444be566776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:13:07.004358 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7034b-34b5-4d88-830d-b444be566776 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:13:07.022087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1187/2374] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:13:07.026119 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50be12-ae1c-4d90-b03c-02288df52f8e admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:13:07.042213 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50be12-ae1c-4d90-b03c-02288df52f8e admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:13:07.052904 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7e899-e2ec-4d75-9e2c-79850a38b400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:13:07.053899 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7e899-e2ec-4d75-9e2c-79850a38b400 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:07.054194 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7e899-e2ec-4d75-9e2c-79850a38b400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:07.054474 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7e899-e2ec-4d75-9e2c-79850a38b400 admin admin] PATH_INFO: `/v3/projects/6ad18761fc0f43b0aa9a1ead439ee444/users/9d82b7d9fc334a0e8145845d7ede186b/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:07.056624 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7e899-e2ec-4d75-9e2c-79850a38b400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ad18761fc0f43b0aa9a1ead439ee444, user_id=9d82b7d9fc334a0e8145845d7ede186b, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:13:07.060689 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7e899-e2ec-4d75-9e2c-79850a38b400 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:13:07.086551 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1188/2375] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:13:07 2022] PUT /identity/v3/projects/6ad18761fc0f43b0aa9a1ead439ee444/users/9d82b7d9fc334a0e8145845d7ede186b/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:13:12.669933 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17c20a-2508-459e-ab27-b32304d063dd None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:12.670424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17c20a-2508-459e-ab27-b32304d063dd None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:12.670843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17c20a-2508-459e-ab27-b32304d063dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:12.718361 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-fd17c20a-2508-459e-ab27-b32304d063dd None None] MFA Rules not processed for user `9d82b7d9fc334a0e8145845d7ede186b`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:13:12.719778 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-fd17c20a-2508-459e-ab27-b32304d063dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:13:12.776041 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:13:12.859957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1188/2376] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:13:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:13:12.870308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7e899-e2ec-4d75-9e2c-79850a38b400 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:13:12.872758 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-82c7e899-e2ec-4d75-9e2c-79850a38b400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:13:12.947077 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7e899-e2ec-4d75-9e2c-79850a38b400 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:13:12.951080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb71ff-ac91-4133-b777-3189b5bbb3cb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6921990ec98492f8f4420f911208b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:13:12.951744 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb71ff-ac91-4133-b777-3189b5bbb3cb service glance] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:12.952028 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb71ff-ac91-4133-b777-3189b5bbb3cb service glance] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:12.952305 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb71ff-ac91-4133-b777-3189b5bbb3cb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:13.014459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb71ff-ac91-4133-b777-3189b5bbb3cb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:13:13.015923 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb71ff-ac91-4133-b777-3189b5bbb3cb service glance] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:13:13.025339 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1189/2377] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:13:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:13:13.161313 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db98a6-a895-4822-8e6e-7635c0a1f8ce None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:13.161628 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db98a6-a895-4822-8e6e-7635c0a1f8ce None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:13.161928 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db98a6-a895-4822-8e6e-7635c0a1f8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:13.183054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-f3db98a6-a895-4822-8e6e-7635c0a1f8ce None None] MFA Rules not processed for user `f64d942793a5493787c3e5c7815bc134`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:13:13.184845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-f3db98a6-a895-4822-8e6e-7635c0a1f8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:13:13.251260 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1189/2378] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Jul 14 12:13:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:13:13.310580 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb71ff-ac91-4133-b777-3189b5bbb3cb service glance] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:13:13.312092 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ecbb71ff-ac91-4133-b777-3189b5bbb3cb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:13:13.382458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb71ff-ac91-4133-b777-3189b5bbb3cb service glance] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:13:13.387544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdc928-6353-47ab-a361-e894a4027b5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969ee98dfe644ef2a016860aa1585317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:13:13.388202 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdc928-6353-47ab-a361-e894a4027b5f service swift] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:13.388498 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdc928-6353-47ab-a361-e894a4027b5f service swift] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:13.388758 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdc928-6353-47ab-a361-e894a4027b5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:13.397251 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdc928-6353-47ab-a361-e894a4027b5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:13:13.398953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdc928-6353-47ab-a361-e894a4027b5f service swift] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:13:13.416275 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1190/2379] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Jul 14 12:13:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 12:13:23.191336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ae070-ca7e-47a9-9e11-6d69aacbd579 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:23.191912 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ae070-ca7e-47a9-9e11-6d69aacbd579 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:23.191912 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ae070-ca7e-47a9-9e11-6d69aacbd579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:23.209579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-1a0ae070-ca7e-47a9-9e11-6d69aacbd579 None None] MFA Rules not processed for user `8066c3b7ce244c27a8c5dae3431a7235`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:13:23.210818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-1a0ae070-ca7e-47a9-9e11-6d69aacbd579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:13:23.222560 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1190/2380] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:13:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:13:23.405978 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=96,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:13:31.253200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0be131-1f49-4e5b-b7cf-d41d46a20c4d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:31.254146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0be131-1f49-4e5b-b7cf-d41d46a20c4d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:31.254626 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0be131-1f49-4e5b-b7cf-d41d46a20c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:31.276498 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6c0be131-1f49-4e5b-b7cf-d41d46a20c4d None None] MFA Rules not processed for user `f64d942793a5493787c3e5c7815bc134`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:13:31.278482 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6c0be131-1f49-4e5b-b7cf-d41d46a20c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:13:31.286467 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1191/2381] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Jul 14 12:13:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:13:31.302174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ae070-ca7e-47a9-9e11-6d69aacbd579 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:13:31.319456 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ae070-ca7e-47a9-9e11-6d69aacbd579 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:13:31.330018 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4f1e8-01ba-4ce3-a6a7-92e0889d89ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969ee98dfe644ef2a016860aa1585317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:13:31.330787 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4f1e8-01ba-4ce3-a6a7-92e0889d89ce service swift] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:31.331407 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4f1e8-01ba-4ce3-a6a7-92e0889d89ce service swift] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:31.331971 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4f1e8-01ba-4ce3-a6a7-92e0889d89ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:31.349735 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4f1e8-01ba-4ce3-a6a7-92e0889d89ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:13:31.351862 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4f1e8-01ba-4ce3-a6a7-92e0889d89ce service swift] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:13:31.362936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1191/2382] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Jul 14 12:13:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 12:13:35.691873 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127a297-3fca-4375-a208-236a15921d3d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:35.692766 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127a297-3fca-4375-a208-236a15921d3d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:35.693051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127a297-3fca-4375-a208-236a15921d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:35.711560 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-1127a297-3fca-4375-a208-236a15921d3d None None] MFA Rules not processed for user `651c540ef39e4c3ea316025e55b0208a`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:13:35.713121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1127a297-3fca-4375-a208-236a15921d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:13:35.803521 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1192/2383] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:13:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:13:35.843169 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4f1e8-01ba-4ce3-a6a7-92e0889d89ce service swift] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:13:35.853018 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4f1e8-01ba-4ce3-a6a7-92e0889d89ce service swift] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:13:35.857619 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127a297-3fca-4375-a208-236a15921d3d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:13:35.859174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1127a297-3fca-4375-a208-236a15921d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:13:35.861963 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf57d9-17a0-493b-80ea-4f6f66b7f92e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6921990ec98492f8f4420f911208b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:13:35.863782 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf57d9-17a0-493b-80ea-4f6f66b7f92e service glance] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:35.864214 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf57d9-17a0-493b-80ea-4f6f66b7f92e service glance] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:35.864638 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf57d9-17a0-493b-80ea-4f6f66b7f92e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:35.866852 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-1cdf57d9-17a0-493b-80ea-4f6f66b7f92e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:13:35.953613 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127a297-3fca-4375-a208-236a15921d3d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:13:35.960142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8145f-cfe7-45a7-8e0c-b23d3376b422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:13:35.961133 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8145f-cfe7-45a7-8e0c-b23d3376b422 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:35.961524 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8145f-cfe7-45a7-8e0c-b23d3376b422 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:35.961907 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8145f-cfe7-45a7-8e0c-b23d3376b422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:35.965387 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-92c8145f-cfe7-45a7-8e0c-b23d3376b422 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:13:36.004177 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf57d9-17a0-493b-80ea-4f6f66b7f92e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:13:36.005832 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf57d9-17a0-493b-80ea-4f6f66b7f92e service glance] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:13:36.032031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1192/2384] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:13:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:13:36.070408 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca66f5-4af9-48ea-a2ce-8bbf61596729 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:36.070988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca66f5-4af9-48ea-a2ce-8bbf61596729 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:36.071409 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca66f5-4af9-48ea-a2ce-8bbf61596729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:36.107962 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-6aca66f5-4af9-48ea-a2ce-8bbf61596729 None None] MFA Rules not processed for user `5eb3da4d1e5e4a67830767d040e15a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:13:36.109361 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-6aca66f5-4af9-48ea-a2ce-8bbf61596729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:13:36.121813 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8145f-cfe7-45a7-8e0c-b23d3376b422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:13:36.123492 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8145f-cfe7-45a7-8e0c-b23d3376b422 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:13:36.137763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1193/2385] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:13:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:13:36.175316 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:13:36.220984 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1193/2386] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:13:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:13:41.396535 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4983d-3b4a-4ff7-aa8b-460e1616da06 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:41.397149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4983d-3b4a-4ff7-aa8b-460e1616da06 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:41.397149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4983d-3b4a-4ff7-aa8b-460e1616da06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:41.415528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-36d4983d-3b4a-4ff7-aa8b-460e1616da06 None None] MFA Rules not processed for user `2c19c490070a405ab2f48336c5b842df`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:13:41.416742 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-36d4983d-3b4a-4ff7-aa8b-460e1616da06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:13:41.452964 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:13:41.475168 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1194/2387] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:13:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:13:42.455905 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca66f5-4af9-48ea-a2ce-8bbf61596729 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:13:42.457399 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-6aca66f5-4af9-48ea-a2ce-8bbf61596729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:13:42.474175 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca66f5-4af9-48ea-a2ce-8bbf61596729 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:13:42.480116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c7ef0-7674-41a8-b3d1-ea600eb37265 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:13:42.480949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c7ef0-7674-41a8-b3d1-ea600eb37265 service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:42.481307 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c7ef0-7674-41a8-b3d1-ea600eb37265 service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:42.481673 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c7ef0-7674-41a8-b3d1-ea600eb37265 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:42.484019 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-752c7ef0-7674-41a8-b3d1-ea600eb37265 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:13:42.496030 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c7ef0-7674-41a8-b3d1-ea600eb37265 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:13:42.497684 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c7ef0-7674-41a8-b3d1-ea600eb37265 service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:13:42.508795 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1194/2388] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:13:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:13:49.255537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4983d-3b4a-4ff7-aa8b-460e1616da06 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:13:49.269086 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4983d-3b4a-4ff7-aa8b-460e1616da06 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:13:49.274742 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e29e6-e6e4-4591-b820-9f56ac7f2de7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:13:49.275463 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e29e6-e6e4-4591-b820-9f56ac7f2de7 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:49.275839 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e29e6-e6e4-4591-b820-9f56ac7f2de7 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:49.276185 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e29e6-e6e4-4591-b820-9f56ac7f2de7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:49.278317 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-de0e29e6-e6e4-4591-b820-9f56ac7f2de7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:13:49.290415 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e29e6-e6e4-4591-b820-9f56ac7f2de7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:13:49.291981 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e29e6-e6e4-4591-b820-9f56ac7f2de7 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:13:49.302793 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1195/2389] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:13:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:13:52.503334 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=16 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:13:57.134262 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c7ef0-7674-41a8-b3d1-ea600eb37265 service nova] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:13:57.136430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-752c7ef0-7674-41a8-b3d1-ea600eb37265 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:13:57.152371 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c7ef0-7674-41a8-b3d1-ea600eb37265 service nova] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:13:57.158308 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad2edf-585d-4e3a-9bcb-91e1b2d8b40d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:13:57.159005 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad2edf-585d-4e3a-9bcb-91e1b2d8b40d service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:13:57.159290 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad2edf-585d-4e3a-9bcb-91e1b2d8b40d service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:13:57.159566 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad2edf-585d-4e3a-9bcb-91e1b2d8b40d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:13:57.161414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5aad2edf-585d-4e3a-9bcb-91e1b2d8b40d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:13:57.219572 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad2edf-585d-4e3a-9bcb-91e1b2d8b40d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:13:57.221184 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad2edf-585d-4e3a-9bcb-91e1b2d8b40d service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:13:57.231551 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1195/2390] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:13:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:13:59.297874 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=13 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:14:02.199566 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e29e6-e6e4-4591-b820-9f56ac7f2de7 service nova] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:14:02.208906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e29e6-e6e4-4591-b820-9f56ac7f2de7 service nova] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:14:02.212639 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325f5fd-fc93-4437-9075-d0c9649f83d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:14:02.213292 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325f5fd-fc93-4437-9075-d0c9649f83d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:14:02.213578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325f5fd-fc93-4437-9075-d0c9649f83d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:14:02.213858 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325f5fd-fc93-4437-9075-d0c9649f83d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:14:02.227553 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325f5fd-fc93-4437-9075-d0c9649f83d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:14:02.229028 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325f5fd-fc93-4437-9075-d0c9649f83d5 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:14:02.239820 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1196/2391] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:14:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:14:02.499220 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad2edf-585d-4e3a-9bcb-91e1b2d8b40d service nova] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:14:02.508701 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad2edf-585d-4e3a-9bcb-91e1b2d8b40d service nova] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:14:02.513667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bde01-d62d-4939-b5af-e55eafb0f2f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:14:02.514946 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bde01-d62d-4939-b5af-e55eafb0f2f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:14:02.515460 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bde01-d62d-4939-b5af-e55eafb0f2f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:14:02.515957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bde01-d62d-4939-b5af-e55eafb0f2f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:14:02.518012 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-f20bde01-d62d-4939-b5af-e55eafb0f2f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:14:02.529812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bde01-d62d-4939-b5af-e55eafb0f2f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:14:02.531441 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bde01-d62d-4939-b5af-e55eafb0f2f7 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:14:02.541584 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1196/2392] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:14:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:14:12.234964 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=6 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:14:12.536706 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=34 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:14:23.335995 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325f5fd-fc93-4437-9075-d0c9649f83d5 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:14:23.350483 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325f5fd-fc93-4437-9075-d0c9649f83d5 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:14:23.356714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a79a06-3e97-4c92-82b4-afc4e3782a1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:14:23.357360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a79a06-3e97-4c92-82b4-afc4e3782a1d service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:14:23.357642 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a79a06-3e97-4c92-82b4-afc4e3782a1d service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:14:23.357917 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a79a06-3e97-4c92-82b4-afc4e3782a1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:14:23.359706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-38a79a06-3e97-4c92-82b4-afc4e3782a1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:14:23.372913 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a79a06-3e97-4c92-82b4-afc4e3782a1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:14:23.374486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a79a06-3e97-4c92-82b4-afc4e3782a1d service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:14:23.385015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1197/2393] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:14:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:14:23.953642 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860a3b8-c359-4355-aff1-38d4068f162f None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:14:23.954141 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860a3b8-c359-4355-aff1-38d4068f162f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:14:23.954141 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860a3b8-c359-4355-aff1-38d4068f162f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:14:23.973191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-2860a3b8-c359-4355-aff1-38d4068f162f None None] MFA Rules not processed for user `f64d942793a5493787c3e5c7815bc134`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:14:23.974392 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-2860a3b8-c359-4355-aff1-38d4068f162f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:14:23.982515 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1197/2394] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Jul 14 12:14:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:14:24.004220 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a79a06-3e97-4c92-82b4-afc4e3782a1d service nova] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:14:24.016501 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a79a06-3e97-4c92-82b4-afc4e3782a1d service nova] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:14:24.021431 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f96882-e29e-4bd3-9057-de55bc1f1228 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969ee98dfe644ef2a016860aa1585317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:14:24.022089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f96882-e29e-4bd3-9057-de55bc1f1228 service swift] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:14:24.022373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f96882-e29e-4bd3-9057-de55bc1f1228 service swift] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:14:24.022684 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f96882-e29e-4bd3-9057-de55bc1f1228 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:14:24.031323 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f96882-e29e-4bd3-9057-de55bc1f1228 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:14:24.032906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f96882-e29e-4bd3-9057-de55bc1f1228 service swift] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:14:24.041098 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1198/2395] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Jul 14 12:14:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 12:14:33.967197 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:14:34.037623 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=12 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:14:37.253472 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2860a3b8-c359-4355-aff1-38d4068f162f None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:14:37.255015 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-2860a3b8-c359-4355-aff1-38d4068f162f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:14:37.326804 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2860a3b8-c359-4355-aff1-38d4068f162f None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:14:37.332121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14643cd-b45a-4f8c-9b57-f10c34e5d8ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6070c6b901f4e2ebe621a3e42dd2d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:14:37.332775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14643cd-b45a-4f8c-9b57-f10c34e5d8ea service placement] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:14:37.333133 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14643cd-b45a-4f8c-9b57-f10c34e5d8ea service placement] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:14:37.333354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14643cd-b45a-4f8c-9b57-f10c34e5d8ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:14:37.335158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-d14643cd-b45a-4f8c-9b57-f10c34e5d8ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:14:37.348799 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14643cd-b45a-4f8c-9b57-f10c34e5d8ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:14:37.350417 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14643cd-b45a-4f8c-9b57-f10c34e5d8ea service placement] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:14:37.362611 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1198/2396] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:14:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:14:42.693422 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f96882-e29e-4bd3-9057-de55bc1f1228 service swift] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:14:42.725580 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f96882-e29e-4bd3-9057-de55bc1f1228 service swift] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:14:42.735170 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041db06-b256-402a-a584-70d316958560 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:14:42.736238 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041db06-b256-402a-a584-70d316958560 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:14:42.736773 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041db06-b256-402a-a584-70d316958560 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:14:42.749342 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041db06-b256-402a-a584-70d316958560 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:14:42.754398 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9041db06-b256-402a-a584-70d316958560 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:14:42.782727 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041db06-b256-402a-a584-70d316958560 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:14:42.784683 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041db06-b256-402a-a584-70d316958560 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:14:42.799846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1199/2397] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:14:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:14:43.717876 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b6ae7-53bf-4b7d-b18c-951a659bd9f7 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:14:43.718847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b6ae7-53bf-4b7d-b18c-951a659bd9f7 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:14:43.719288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b6ae7-53bf-4b7d-b18c-951a659bd9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:14:43.737530 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-cf3b6ae7-53bf-4b7d-b18c-951a659bd9f7 None None] MFA Rules not processed for user `f64d942793a5493787c3e5c7815bc134`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:14:43.739283 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-cf3b6ae7-53bf-4b7d-b18c-951a659bd9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:14:43.748131 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1199/2398] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Jul 14 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:14:43.765043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041db06-b256-402a-a584-70d316958560 service nova] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:14:43.780519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041db06-b256-402a-a584-70d316958560 service nova] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:14:43.786038 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab6049-1755-4898-979d-64d99090e40a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969ee98dfe644ef2a016860aa1585317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:14:43.786784 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab6049-1755-4898-979d-64d99090e40a service swift] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:14:43.787074 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab6049-1755-4898-979d-64d99090e40a service swift] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:14:43.787355 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab6049-1755-4898-979d-64d99090e40a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:14:43.796655 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab6049-1755-4898-979d-64d99090e40a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:14:43.798258 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab6049-1755-4898-979d-64d99090e40a service swift] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:14:43.807196 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1200/2399] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Jul 14 12:14:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 12:14:53.732091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=35 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:14:53.803672 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=12 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:14:56.877789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b6ae7-53bf-4b7d-b18c-951a659bd9f7 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:14:56.893759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b6ae7-53bf-4b7d-b18c-951a659bd9f7 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:14:56.900960 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19ed4d-b872-4b29-b445-fce50f870bef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:14:56.902464 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19ed4d-b872-4b29-b445-fce50f870bef service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:14:56.903032 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19ed4d-b872-4b29-b445-fce50f870bef service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:14:56.903806 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19ed4d-b872-4b29-b445-fce50f870bef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:14:56.906180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-4b19ed4d-b872-4b29-b445-fce50f870bef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:14:56.918954 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19ed4d-b872-4b29-b445-fce50f870bef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:14:56.920734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19ed4d-b872-4b29-b445-fce50f870bef service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:14:56.931260 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1200/2400] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:14:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:15:06.926158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=6 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:07.631078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7063a-f57c-468f-a0dd-5b75ab57bbbc None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:07.631623 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7063a-f57c-468f-a0dd-5b75ab57bbbc None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:07.631623 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7063a-f57c-468f-a0dd-5b75ab57bbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:07.652277 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-57c7063a-f57c-468f-a0dd-5b75ab57bbbc None None] MFA Rules not processed for user `f64d942793a5493787c3e5c7815bc134`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:07.653546 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-57c7063a-f57c-468f-a0dd-5b75ab57bbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:07.661343 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1201/2401] 10.222.0.79 () {58 vars in 967 bytes} [Thu Jul 14 12:15:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:07.674767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19ed4d-b872-4b29-b445-fce50f870bef service nova] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:07.686780 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19ed4d-b872-4b29-b445-fce50f870bef service nova] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:07.691739 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f7fc9-e6fd-4339-8f0b-d1beca9612c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969ee98dfe644ef2a016860aa1585317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:07.692380 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f7fc9-e6fd-4339-8f0b-d1beca9612c7 service swift] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:07.692667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f7fc9-e6fd-4339-8f0b-d1beca9612c7 service swift] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:07.692967 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f7fc9-e6fd-4339-8f0b-d1beca9612c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:07.702111 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f7fc9-e6fd-4339-8f0b-d1beca9612c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:07.703761 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f7fc9-e6fd-4339-8f0b-d1beca9612c7 service swift] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:07.712521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1201/2402] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Jul 14 12:15:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 12:15:10.150182 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7063a-f57c-468f-a0dd-5b75ab57bbbc None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:10.163032 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7063a-f57c-468f-a0dd-5b75ab57bbbc None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:10.169644 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb11665-3e6a-4ce6-ad4a-b0c313309e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:10.170694 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb11665-3e6a-4ce6-ad4a-b0c313309e50 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:10.171191 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb11665-3e6a-4ce6-ad4a-b0c313309e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:10.171732 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb11665-3e6a-4ce6-ad4a-b0c313309e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:10.174599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8eb11665-3e6a-4ce6-ad4a-b0c313309e50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:10.255408 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb11665-3e6a-4ce6-ad4a-b0c313309e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:10.257141 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb11665-3e6a-4ce6-ad4a-b0c313309e50 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:10.286723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1202/2403] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:15:14.424996 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f7fc9-e6fd-4339-8f0b-d1beca9612c7 service swift] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:14.427482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-c03f7fc9-e6fd-4339-8f0b-d1beca9612c7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:14.444824 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f7fc9-e6fd-4339-8f0b-d1beca9612c7 service swift] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:14.451378 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95eddba-c5ff-4283-b3f7-d1b300c91b13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6070c6b901f4e2ebe621a3e42dd2d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:14.452186 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eddba-c5ff-4283-b3f7-d1b300c91b13 service placement] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:14.452621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eddba-c5ff-4283-b3f7-d1b300c91b13 service placement] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:14.452996 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eddba-c5ff-4283-b3f7-d1b300c91b13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:14.455201 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b95eddba-c5ff-4283-b3f7-d1b300c91b13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:14.481213 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95eddba-c5ff-4283-b3f7-d1b300c91b13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:14.485762 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95eddba-c5ff-4283-b3f7-d1b300c91b13 service placement] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:14.496488 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb11665-3e6a-4ce6-ad4a-b0c313309e50 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:14.503490 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8eb11665-3e6a-4ce6-ad4a-b0c313309e50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:14.509612 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1202/2404] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:15:14.529001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb11665-3e6a-4ce6-ad4a-b0c313309e50 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:14.537650 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574ed3d-f96d-4f9b-8df7-c2124094b462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:14.538581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574ed3d-f96d-4f9b-8df7-c2124094b462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:14.538846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574ed3d-f96d-4f9b-8df7-c2124094b462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:14.539499 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574ed3d-f96d-4f9b-8df7-c2124094b462 admin admin] PATH_INFO: `/v3/users/2c19c490070a405ab2f48336c5b842df` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:14.540674 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574ed3d-f96d-4f9b-8df7-c2124094b462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c19c490070a405ab2f48336c5b842df)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:14.542851 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574ed3d-f96d-4f9b-8df7-c2124094b462 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:14.601916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0574ed3d-f96d-4f9b-8df7-c2124094b462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c19c490070a405ab2f48336c5b842df'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:14.612763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0574ed3d-f96d-4f9b-8df7-c2124094b462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c19c490070a405ab2f48336c5b842df'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:14.626947 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0574ed3d-f96d-4f9b-8df7-c2124094b462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c19c490070a405ab2f48336c5b842df'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:14.646069 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0574ed3d-f96d-4f9b-8df7-c2124094b462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c19c490070a405ab2f48336c5b842df'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:14.647277 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0574ed3d-f96d-4f9b-8df7-c2124094b462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c19c490070a405ab2f48336c5b842df'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:14.656038 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1203/2405] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:15:14 2022] DELETE /identity/v3/users/2c19c490070a405ab2f48336c5b842df => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:15:14.884846 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95eddba-c5ff-4283-b3f7-d1b300c91b13 service placement] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:14.899341 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95eddba-c5ff-4283-b3f7-d1b300c91b13 service placement] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:14.975063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85967a57-bd33-4588-9932-e8a0b57ce733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:14.975950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85967a57-bd33-4588-9932-e8a0b57ce733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:14.976257 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85967a57-bd33-4588-9932-e8a0b57ce733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:14.976541 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85967a57-bd33-4588-9932-e8a0b57ce733 admin admin] PATH_INFO: `/v3/projects/3513dd87bbf243c8ae4d6090dbf7bd84` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:14.977755 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85967a57-bd33-4588-9932-e8a0b57ce733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3513dd87bbf243c8ae4d6090dbf7bd84)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:14.979826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85967a57-bd33-4588-9932-e8a0b57ce733 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:15.043329 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-85967a57-bd33-4588-9932-e8a0b57ce733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3513dd87bbf243c8ae4d6090dbf7bd84', 'request_id': 'req-85967a57-bd33-4588-9932-e8a0b57ce733'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:15.051062 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-85967a57-bd33-4588-9932-e8a0b57ce733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3513dd87bbf243c8ae4d6090dbf7bd84', 'request_id': 'req-85967a57-bd33-4588-9932-e8a0b57ce733'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:15.059349 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-85967a57-bd33-4588-9932-e8a0b57ce733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3513dd87bbf243c8ae4d6090dbf7bd84', 'request_id': 'req-85967a57-bd33-4588-9932-e8a0b57ce733'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:15.071683 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-85967a57-bd33-4588-9932-e8a0b57ce733 admin admin] The token cache is being invalidate because project 3513dd87bbf243c8ae4d6090dbf7bd84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:15:15.071969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-85967a57-bd33-4588-9932-e8a0b57ce733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:15.072578 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-85967a57-bd33-4588-9932-e8a0b57ce733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:15.074141 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1203/2406] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:15:14 2022] DELETE /identity/v3/projects/3513dd87bbf243c8ae4d6090dbf7bd84 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:15.079078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310d13d-b365-42d2-98f2-f3298880227b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:15.079361 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310d13d-b365-42d2-98f2-f3298880227b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:15.079635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310d13d-b365-42d2-98f2-f3298880227b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:15.098232 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e310d13d-b365-42d2-98f2-f3298880227b None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:15.099464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e310d13d-b365-42d2-98f2-f3298880227b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:15.150924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:15.161455 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1204/2407] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:15.171103 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec085b56-234f-4c94-ad9d-6a025bafa5eb None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:15.171396 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec085b56-234f-4c94-ad9d-6a025bafa5eb None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:15.171679 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec085b56-234f-4c94-ad9d-6a025bafa5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:15.189983 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-ec085b56-234f-4c94-ad9d-6a025bafa5eb None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:15.191226 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ec085b56-234f-4c94-ad9d-6a025bafa5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:15.199078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1204/2408] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:15.203208 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310d13d-b365-42d2-98f2-f3298880227b None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:15.212874 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310d13d-b365-42d2-98f2-f3298880227b None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:15.217910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3c706-d42b-4362-b86c-f35d9e055e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:15.218585 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3c706-d42b-4362-b86c-f35d9e055e6d admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:15.218870 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3c706-d42b-4362-b86c-f35d9e055e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:15.219145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3c706-d42b-4362-b86c-f35d9e055e6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:15.219891 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3c706-d42b-4362-b86c-f35d9e055e6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:15:15.220198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3c706-d42b-4362-b86c-f35d9e055e6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:15.221801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3c706-d42b-4362-b86c-f35d9e055e6d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:15.236010 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1205/2409] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:15:15.241506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec085b56-234f-4c94-ad9d-6a025bafa5eb None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:15.251275 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec085b56-234f-4c94-ad9d-6a025bafa5eb None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:15.255998 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60326d-a608-4c90-b0fa-6e1e57af1ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:15.256654 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60326d-a608-4c90-b0fa-6e1e57af1ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:15.256942 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60326d-a608-4c90-b0fa-6e1e57af1ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:15.257220 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60326d-a608-4c90-b0fa-6e1e57af1ae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:15.257945 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60326d-a608-4c90-b0fa-6e1e57af1ae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:15.259892 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60326d-a608-4c90-b0fa-6e1e57af1ae1 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:15.288090 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1205/2410] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:15:15 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:15.292736 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3c706-d42b-4362-b86c-f35d9e055e6d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:15.303511 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3c706-d42b-4362-b86c-f35d9e055e6d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:15.372537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066b7bf-209e-4cb5-b023-d77b551c63ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:15.374722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066b7bf-209e-4cb5-b023-d77b551c63ab admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:15.374722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066b7bf-209e-4cb5-b023-d77b551c63ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:15.374722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066b7bf-209e-4cb5-b023-d77b551c63ab admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:15.374722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066b7bf-209e-4cb5-b023-d77b551c63ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:15.379611 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066b7bf-209e-4cb5-b023-d77b551c63ab admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:15.400580 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1206/2411] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:15:15 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:15.410375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60326d-a608-4c90-b0fa-6e1e57af1ae1 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:15.424457 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60326d-a608-4c90-b0fa-6e1e57af1ae1 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:15.429228 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aabbd7-d70b-4d67-8e3b-211f8276afd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:15.429892 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aabbd7-d70b-4d67-8e3b-211f8276afd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:15.430174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aabbd7-d70b-4d67-8e3b-211f8276afd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:15.430448 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aabbd7-d70b-4d67-8e3b-211f8276afd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:15.431203 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aabbd7-d70b-4d67-8e3b-211f8276afd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:15.432836 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aabbd7-d70b-4d67-8e3b-211f8276afd7 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:15.443457 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1206/2412] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:15.447479 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066b7bf-209e-4cb5-b023-d77b551c63ab admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:15.458667 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066b7bf-209e-4cb5-b023-d77b551c63ab admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:15.463807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95935b-9315-412e-abbc-299bff322e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:15.465078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95935b-9315-412e-abbc-299bff322e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:15.465458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95935b-9315-412e-abbc-299bff322e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:15.465753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95935b-9315-412e-abbc-299bff322e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:15.466459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95935b-9315-412e-abbc-299bff322e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:15.468075 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95935b-9315-412e-abbc-299bff322e55 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:15.478621 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1207/2413] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:15:15.484275 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aabbd7-d70b-4d67-8e3b-211f8276afd7 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:15.494718 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aabbd7-d70b-4d67-8e3b-211f8276afd7 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:15.500138 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ccf51-5f01-4953-b831-b95dd2156334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:15.501080 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ccf51-5f01-4953-b831-b95dd2156334 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:15.501439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ccf51-5f01-4953-b831-b95dd2156334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:15.501718 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ccf51-5f01-4953-b831-b95dd2156334 admin admin] PATH_INFO: `/v3/projects/01ea45a641e241ae9a4b0d8deba6f689/users/e7d25f8957e74d8d8d88f9535c6f9b25/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:15.519364 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ccf51-5f01-4953-b831-b95dd2156334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ea45a641e241ae9a4b0d8deba6f689, user_id=e7d25f8957e74d8d8d88f9535c6f9b25, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:15.522477 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ccf51-5f01-4953-b831-b95dd2156334 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:15.533382 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:15.538773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1207/2414] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:15 2022] PUT /identity/v3/projects/01ea45a641e241ae9a4b0d8deba6f689/users/e7d25f8957e74d8d8d88f9535c6f9b25/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:15.549117 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc16334-b452-4b40-b8fa-586b78526a27 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:15.549588 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc16334-b452-4b40-b8fa-586b78526a27 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:15.549685 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc16334-b452-4b40-b8fa-586b78526a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:15.576303 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-dcc16334-b452-4b40-b8fa-586b78526a27 None None] MFA Rules not processed for user `e7d25f8957e74d8d8d88f9535c6f9b25`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:15.577524 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-dcc16334-b452-4b40-b8fa-586b78526a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:15.646979 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1208/2415] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:15.652375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ccf51-5f01-4953-b831-b95dd2156334 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:15.721145 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ccf51-5f01-4953-b831-b95dd2156334 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:15.726144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a15ec-950b-4755-bd3b-2e7d8f4266da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:15.726867 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a15ec-950b-4755-bd3b-2e7d8f4266da admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:15.727281 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a15ec-950b-4755-bd3b-2e7d8f4266da admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:15.727420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a15ec-950b-4755-bd3b-2e7d8f4266da admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:15.728160 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a15ec-950b-4755-bd3b-2e7d8f4266da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:15.730615 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a15ec-950b-4755-bd3b-2e7d8f4266da admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:15.758855 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1208/2416] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:15:15 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:15.763825 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc16334-b452-4b40-b8fa-586b78526a27 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:15.775336 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc16334-b452-4b40-b8fa-586b78526a27 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:15.839308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:15.847293 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648f000-6726-4310-94e5-8709b1e83625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:15.847975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648f000-6726-4310-94e5-8709b1e83625 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:15.848265 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648f000-6726-4310-94e5-8709b1e83625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:15.848545 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648f000-6726-4310-94e5-8709b1e83625 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:15.849246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648f000-6726-4310-94e5-8709b1e83625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:15.851242 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648f000-6726-4310-94e5-8709b1e83625 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:15.871571 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1209/2417] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:15:15 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:15.875668 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a15ec-950b-4755-bd3b-2e7d8f4266da admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:15.886930 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a15ec-950b-4755-bd3b-2e7d8f4266da admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:15.891693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601bf09-f26e-4b68-afee-c6c5da8d79c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:15.892375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601bf09-f26e-4b68-afee-c6c5da8d79c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:15.892661 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601bf09-f26e-4b68-afee-c6c5da8d79c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:15.892943 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601bf09-f26e-4b68-afee-c6c5da8d79c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:15.893679 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601bf09-f26e-4b68-afee-c6c5da8d79c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:15.895336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601bf09-f26e-4b68-afee-c6c5da8d79c8 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:15.906917 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1209/2418] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:15:15.911172 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648f000-6726-4310-94e5-8709b1e83625 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:15.922514 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648f000-6726-4310-94e5-8709b1e83625 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:15.928144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300844c-2ec5-4b0a-b023-20397b43b8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:15.929222 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300844c-2ec5-4b0a-b023-20397b43b8b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:15.929471 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300844c-2ec5-4b0a-b023-20397b43b8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:15.929821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300844c-2ec5-4b0a-b023-20397b43b8b4 admin admin] PATH_INFO: `/v3/projects/cd42b5ecc5bd4b3db785432c63fad83f/users/b16b8c7a8c054ab7b1c1beb84e3e125b/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:15.946632 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300844c-2ec5-4b0a-b023-20397b43b8b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd42b5ecc5bd4b3db785432c63fad83f, user_id=b16b8c7a8c054ab7b1c1beb84e3e125b, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:15.949368 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300844c-2ec5-4b0a-b023-20397b43b8b4 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:15.967537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1210/2419] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:15 2022] PUT /identity/v3/projects/cd42b5ecc5bd4b3db785432c63fad83f/users/b16b8c7a8c054ab7b1c1beb84e3e125b/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:15.973292 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601bf09-f26e-4b68-afee-c6c5da8d79c8 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:15.986674 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601bf09-f26e-4b68-afee-c6c5da8d79c8 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:16.048298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e4661-8475-43b0-a03c-d9feafe2e66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:16.049209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e4661-8475-43b0-a03c-d9feafe2e66d admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:16.049635 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e4661-8475-43b0-a03c-d9feafe2e66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:16.049953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e4661-8475-43b0-a03c-d9feafe2e66d admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:16.050726 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e4661-8475-43b0-a03c-d9feafe2e66d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:16.052359 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e4661-8475-43b0-a03c-d9feafe2e66d admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:16.063129 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1210/2420] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:16.067388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300844c-2ec5-4b0a-b023-20397b43b8b4 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:16.079689 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300844c-2ec5-4b0a-b023-20397b43b8b4 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:16.086031 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa60f8-535f-401f-897d-463cf367ef15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:16.086978 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa60f8-535f-401f-897d-463cf367ef15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:16.087261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa60f8-535f-401f-897d-463cf367ef15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:16.087539 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa60f8-535f-401f-897d-463cf367ef15 admin admin] PATH_INFO: `/v3/projects/cd42b5ecc5bd4b3db785432c63fad83f/users/b16b8c7a8c054ab7b1c1beb84e3e125b/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:16.089786 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa60f8-535f-401f-897d-463cf367ef15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd42b5ecc5bd4b3db785432c63fad83f, user_id=b16b8c7a8c054ab7b1c1beb84e3e125b, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:16.092426 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa60f8-535f-401f-897d-463cf367ef15 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:16.103715 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1211/2421] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:16 2022] PUT /identity/v3/projects/cd42b5ecc5bd4b3db785432c63fad83f/users/b16b8c7a8c054ab7b1c1beb84e3e125b/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:16.115121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185658b-c754-4b5a-8db1-c035a4b3e6cf None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:16.115508 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185658b-c754-4b5a-8db1-c035a4b3e6cf None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:16.115889 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185658b-c754-4b5a-8db1-c035a4b3e6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:16.144972 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-d185658b-c754-4b5a-8db1-c035a4b3e6cf None None] MFA Rules not processed for user `b16b8c7a8c054ab7b1c1beb84e3e125b`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:16.146193 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-d185658b-c754-4b5a-8db1-c035a4b3e6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:16.206873 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:16.219255 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1211/2422] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:16.232665 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa60f8-535f-401f-897d-463cf367ef15 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:16.234422 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6ffa60f8-535f-401f-897d-463cf367ef15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:16.292711 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa60f8-535f-401f-897d-463cf367ef15 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:16.296357 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a0f4f-f157-4d14-a984-23d53838ca4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:16.297007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a0f4f-f157-4d14-a984-23d53838ca4d service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:16.297293 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a0f4f-f157-4d14-a984-23d53838ca4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:16.297570 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a0f4f-f157-4d14-a984-23d53838ca4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:16.306859 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a0f4f-f157-4d14-a984-23d53838ca4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:16.308879 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a0f4f-f157-4d14-a984-23d53838ca4d service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:16.318949 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1212/2423] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:15:16.631198 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185658b-c754-4b5a-8db1-c035a4b3e6cf None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:16.642762 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185658b-c754-4b5a-8db1-c035a4b3e6cf None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:16.649803 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1a4a1-db51-40c6-bcb5-b70495c42633 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b16b8c7a8c054ab7b1c1beb84e3e125b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd42b5ecc5bd4b3db785432c63fad83f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:16.650637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1a4a1-db51-40c6-bcb5-b70495c42633 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:16.651034 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1a4a1-db51-40c6-bcb5-b70495c42633 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:16.651698 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1a4a1-db51-40c6-bcb5-b70495c42633 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:16.653065 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1a4a1-db51-40c6-bcb5-b70495c42633 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:15:16.653198 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a0f4f-f157-4d14-a984-23d53838ca4d service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:16.653618 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1a4a1-db51-40c6-bcb5-b70495c42633 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:16.654511 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-654a0f4f-f157-4d14-a984-23d53838ca4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:16.655128 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1a4a1-db51-40c6-bcb5-b70495c42633 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:16.670548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1212/2424] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:15:16.674648 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1a4a1-db51-40c6-bcb5-b70495c42633 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:16.686404 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1a4a1-db51-40c6-bcb5-b70495c42633 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:16.692041 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b96037-596b-4473-b91f-d96b76795393 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b16b8c7a8c054ab7b1c1beb84e3e125b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd42b5ecc5bd4b3db785432c63fad83f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:16.692714 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b96037-596b-4473-b91f-d96b76795393 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:16.694287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b96037-596b-4473-b91f-d96b76795393 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:16.694287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b96037-596b-4473-b91f-d96b76795393 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:16.694995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b96037-596b-4473-b91f-d96b76795393 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:16.700226 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b96037-596b-4473-b91f-d96b76795393 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:16.725183 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a0f4f-f157-4d14-a984-23d53838ca4d service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:16.733693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1213/2425] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:15:16 2022] POST /identity/v3/projects => generated 354 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:15:16.733910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b96037-596b-4473-b91f-d96b76795393 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:16.742332 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2f8c7-aaba-4e67-8331-54ae4b7b6dca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:16.743076 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2f8c7-aaba-4e67-8331-54ae4b7b6dca service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:16.743328 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2f8c7-aaba-4e67-8331-54ae4b7b6dca service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:16.743602 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2f8c7-aaba-4e67-8331-54ae4b7b6dca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:16.745593 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-54f2f8c7-aaba-4e67-8331-54ae4b7b6dca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:16.805195 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b96037-596b-4473-b91f-d96b76795393 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:16.810144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee845ccd-3905-4893-9dce-fc1a8e12192d tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b16b8c7a8c054ab7b1c1beb84e3e125b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd42b5ecc5bd4b3db785432c63fad83f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:16.810854 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee845ccd-3905-4893-9dce-fc1a8e12192d tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:16.811146 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee845ccd-3905-4893-9dce-fc1a8e12192d tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:16.811427 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee845ccd-3905-4893-9dce-fc1a8e12192d tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:16.812220 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee845ccd-3905-4893-9dce-fc1a8e12192d tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:15:16.812464 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee845ccd-3905-4893-9dce-fc1a8e12192d tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:16.814520 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee845ccd-3905-4893-9dce-fc1a8e12192d tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:16.819281 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2f8c7-aaba-4e67-8331-54ae4b7b6dca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:16.822515 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2f8c7-aaba-4e67-8331-54ae4b7b6dca service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:16.826674 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:16.835973 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1214/2426] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:15:16.836957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1213/2427] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:15:16.880338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee845ccd-3905-4893-9dce-fc1a8e12192d tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:16.895286 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee845ccd-3905-4893-9dce-fc1a8e12192d tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:16.904203 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff09df1-290d-4cf6-a88e-0d3a5b6efdd0 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b16b8c7a8c054ab7b1c1beb84e3e125b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd42b5ecc5bd4b3db785432c63fad83f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:16.905262 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff09df1-290d-4cf6-a88e-0d3a5b6efdd0 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:16.905557 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff09df1-290d-4cf6-a88e-0d3a5b6efdd0 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:16.905833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff09df1-290d-4cf6-a88e-0d3a5b6efdd0 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] PATH_INFO: `/v3/projects/35054ba9ddf14615bee139707abf7f29` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:16.907090 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff09df1-290d-4cf6-a88e-0d3a5b6efdd0 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] RBAC: Authorizing `identity:delete_project(project_id=35054ba9ddf14615bee139707abf7f29)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:16.909045 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff09df1-290d-4cf6-a88e-0d3a5b6efdd0 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:16.968351 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0ff09df1-290d-4cf6-a88e-0d3a5b6efdd0 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35054ba9ddf14615bee139707abf7f29', 'request_id': 'req-0ff09df1-290d-4cf6-a88e-0d3a5b6efdd0'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:16.976350 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0ff09df1-290d-4cf6-a88e-0d3a5b6efdd0 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35054ba9ddf14615bee139707abf7f29', 'request_id': 'req-0ff09df1-290d-4cf6-a88e-0d3a5b6efdd0'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:16.983688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0ff09df1-290d-4cf6-a88e-0d3a5b6efdd0 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35054ba9ddf14615bee139707abf7f29', 'request_id': 'req-0ff09df1-290d-4cf6-a88e-0d3a5b6efdd0'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:17.004097 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0ff09df1-290d-4cf6-a88e-0d3a5b6efdd0 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] The token cache is being invalidate because project 35054ba9ddf14615bee139707abf7f29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:15:17.004536 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0ff09df1-290d-4cf6-a88e-0d3a5b6efdd0 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:17.005899 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0ff09df1-290d-4cf6-a88e-0d3a5b6efdd0 tempest-VolumeQuotaClassesTest-2011864656 tempest-VolumeQuotaClassesTest-2011864656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:17.010539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1215/2428] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:15:16 2022] DELETE /identity/v3/projects/35054ba9ddf14615bee139707abf7f29 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:17.242337 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2f8c7-aaba-4e67-8331-54ae4b7b6dca service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:17.255404 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2f8c7-aaba-4e67-8331-54ae4b7b6dca service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:17.321708 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b87eb6-72a9-4300-99c5-5da475b55608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:17.322655 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b87eb6-72a9-4300-99c5-5da475b55608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:17.322927 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b87eb6-72a9-4300-99c5-5da475b55608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:17.323205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b87eb6-72a9-4300-99c5-5da475b55608 admin admin] PATH_INFO: `/v3/users/e7d25f8957e74d8d8d88f9535c6f9b25` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:17.325273 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b87eb6-72a9-4300-99c5-5da475b55608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7d25f8957e74d8d8d88f9535c6f9b25)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:17.327274 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b87eb6-72a9-4300-99c5-5da475b55608 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:17.376585 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c6b87eb6-72a9-4300-99c5-5da475b55608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7d25f8957e74d8d8d88f9535c6f9b25'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:17.384436 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c6b87eb6-72a9-4300-99c5-5da475b55608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7d25f8957e74d8d8d88f9535c6f9b25'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:17.392720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c6b87eb6-72a9-4300-99c5-5da475b55608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7d25f8957e74d8d8d88f9535c6f9b25'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:17.405129 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c6b87eb6-72a9-4300-99c5-5da475b55608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7d25f8957e74d8d8d88f9535c6f9b25'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:17.405936 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-c6b87eb6-72a9-4300-99c5-5da475b55608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7d25f8957e74d8d8d88f9535c6f9b25'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:17.412530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1214/2429] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:15:17 2022] DELETE /identity/v3/users/e7d25f8957e74d8d8d88f9535c6f9b25 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:17.417321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6df75e-b9a0-4587-8ccd-ddf218d23207 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:17.417611 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6df75e-b9a0-4587-8ccd-ddf218d23207 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:17.418012 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6df75e-b9a0-4587-8ccd-ddf218d23207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:17.437253 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-1a6df75e-b9a0-4587-8ccd-ddf218d23207 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:17.438473 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-1a6df75e-b9a0-4587-8ccd-ddf218d23207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:17.473552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:17.504508 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1216/2430] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:17.515911 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b87eb6-72a9-4300-99c5-5da475b55608 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:17.517461 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c6b87eb6-72a9-4300-99c5-5da475b55608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:17.579268 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b87eb6-72a9-4300-99c5-5da475b55608 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:17.583301 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95191a5-5722-4b27-ae3e-78882f86e7e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:17.584093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95191a5-5722-4b27-ae3e-78882f86e7e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:17.584647 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95191a5-5722-4b27-ae3e-78882f86e7e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:17.584944 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95191a5-5722-4b27-ae3e-78882f86e7e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:17.594866 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95191a5-5722-4b27-ae3e-78882f86e7e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:17.596332 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95191a5-5722-4b27-ae3e-78882f86e7e2 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:17.607357 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1215/2431] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:15:17.896534 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6df75e-b9a0-4587-8ccd-ddf218d23207 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:17.900037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-1a6df75e-b9a0-4587-8ccd-ddf218d23207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:17.933937 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6df75e-b9a0-4587-8ccd-ddf218d23207 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:17.941051 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369a03d-9c78-4fdf-8a3d-72e3816cf38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:17.942501 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369a03d-9c78-4fdf-8a3d-72e3816cf38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:17.942982 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369a03d-9c78-4fdf-8a3d-72e3816cf38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:17.943320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369a03d-9c78-4fdf-8a3d-72e3816cf38a admin admin] PATH_INFO: `/v3/projects/01ea45a641e241ae9a4b0d8deba6f689` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:17.944661 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369a03d-9c78-4fdf-8a3d-72e3816cf38a admin admin] RBAC: Authorizing `identity:delete_project(project_id=01ea45a641e241ae9a4b0d8deba6f689)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:17.947026 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369a03d-9c78-4fdf-8a3d-72e3816cf38a admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:17.997700 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-f369a03d-9c78-4fdf-8a3d-72e3816cf38a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01ea45a641e241ae9a4b0d8deba6f689', 'request_id': 'req-f369a03d-9c78-4fdf-8a3d-72e3816cf38a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:18.004278 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-f369a03d-9c78-4fdf-8a3d-72e3816cf38a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01ea45a641e241ae9a4b0d8deba6f689', 'request_id': 'req-f369a03d-9c78-4fdf-8a3d-72e3816cf38a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:18.010569 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-f369a03d-9c78-4fdf-8a3d-72e3816cf38a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01ea45a641e241ae9a4b0d8deba6f689', 'request_id': 'req-f369a03d-9c78-4fdf-8a3d-72e3816cf38a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:18.024847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-f369a03d-9c78-4fdf-8a3d-72e3816cf38a admin admin] The token cache is being invalidate because project 01ea45a641e241ae9a4b0d8deba6f689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:15:18.025147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-f369a03d-9c78-4fdf-8a3d-72e3816cf38a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:18.025858 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-f369a03d-9c78-4fdf-8a3d-72e3816cf38a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:18.028016 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1217/2432] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:15:17 2022] DELETE /identity/v3/projects/01ea45a641e241ae9a4b0d8deba6f689 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:18.034174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95191a5-5722-4b27-ae3e-78882f86e7e2 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:18.046446 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95191a5-5722-4b27-ae3e-78882f86e7e2 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:18.069101 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:18.117411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa73f59-7502-4de0-8b05-0372a9b79010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:18.118436 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa73f59-7502-4de0-8b05-0372a9b79010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:18.118798 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa73f59-7502-4de0-8b05-0372a9b79010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:18.119075 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa73f59-7502-4de0-8b05-0372a9b79010 admin admin] PATH_INFO: `/v3/users/b16b8c7a8c054ab7b1c1beb84e3e125b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:18.120345 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa73f59-7502-4de0-8b05-0372a9b79010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b16b8c7a8c054ab7b1c1beb84e3e125b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:18.122625 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa73f59-7502-4de0-8b05-0372a9b79010 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:18.195435 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-bfa73f59-7502-4de0-8b05-0372a9b79010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b16b8c7a8c054ab7b1c1beb84e3e125b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:18.205455 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-bfa73f59-7502-4de0-8b05-0372a9b79010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b16b8c7a8c054ab7b1c1beb84e3e125b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:18.215060 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-bfa73f59-7502-4de0-8b05-0372a9b79010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b16b8c7a8c054ab7b1c1beb84e3e125b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:18.237255 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-bfa73f59-7502-4de0-8b05-0372a9b79010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b16b8c7a8c054ab7b1c1beb84e3e125b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:18.237980 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-bfa73f59-7502-4de0-8b05-0372a9b79010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b16b8c7a8c054ab7b1c1beb84e3e125b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:18.245641 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1216/2433] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:15:18 2022] DELETE /identity/v3/users/b16b8c7a8c054ab7b1c1beb84e3e125b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:19.072607 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369a03d-9c78-4fdf-8a3d-72e3816cf38a admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:19.075738 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-f369a03d-9c78-4fdf-8a3d-72e3816cf38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:19.091212 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369a03d-9c78-4fdf-8a3d-72e3816cf38a admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:19.161550 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83161fe3-eb38-470a-977c-f6fec8285c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:19.162635 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83161fe3-eb38-470a-977c-f6fec8285c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:19.162996 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83161fe3-eb38-470a-977c-f6fec8285c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:19.163350 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83161fe3-eb38-470a-977c-f6fec8285c33 admin admin] PATH_INFO: `/v3/projects/cd42b5ecc5bd4b3db785432c63fad83f` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:19.164962 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83161fe3-eb38-470a-977c-f6fec8285c33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd42b5ecc5bd4b3db785432c63fad83f)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:19.167679 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83161fe3-eb38-470a-977c-f6fec8285c33 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:19.231567 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-83161fe3-eb38-470a-977c-f6fec8285c33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd42b5ecc5bd4b3db785432c63fad83f', 'request_id': 'req-83161fe3-eb38-470a-977c-f6fec8285c33'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:19.244989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-83161fe3-eb38-470a-977c-f6fec8285c33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd42b5ecc5bd4b3db785432c63fad83f', 'request_id': 'req-83161fe3-eb38-470a-977c-f6fec8285c33'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:19.258674 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-83161fe3-eb38-470a-977c-f6fec8285c33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd42b5ecc5bd4b3db785432c63fad83f', 'request_id': 'req-83161fe3-eb38-470a-977c-f6fec8285c33'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:19.262219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:19.293844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-83161fe3-eb38-470a-977c-f6fec8285c33 admin admin] The token cache is being invalidate because project cd42b5ecc5bd4b3db785432c63fad83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:15:19.295164 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-83161fe3-eb38-470a-977c-f6fec8285c33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:19.296993 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-83161fe3-eb38-470a-977c-f6fec8285c33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:19.303648 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1218/2434] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:15:19 2022] DELETE /identity/v3/projects/cd42b5ecc5bd4b3db785432c63fad83f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:19.305830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a20aa-723d-4459-aa6a-b6681bfd6a5f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:19.306743 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a20aa-723d-4459-aa6a-b6681bfd6a5f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:19.309394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a20aa-723d-4459-aa6a-b6681bfd6a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:19.331770 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-205a20aa-723d-4459-aa6a-b6681bfd6a5f None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:19.333257 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-205a20aa-723d-4459-aa6a-b6681bfd6a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:19.407453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1217/2435] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:19.415141 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c69ec1-3fed-4f85-a7e2-1be14aefb317 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:19.417900 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c69ec1-3fed-4f85-a7e2-1be14aefb317 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:19.418408 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c69ec1-3fed-4f85-a7e2-1be14aefb317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:19.463158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-92c69ec1-3fed-4f85-a7e2-1be14aefb317 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:19.467730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-92c69ec1-3fed-4f85-a7e2-1be14aefb317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:19.493019 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1219/2436] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:19.494405 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a20aa-723d-4459-aa6a-b6681bfd6a5f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:19.510236 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a20aa-723d-4459-aa6a-b6681bfd6a5f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:19.524456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a1b92-4608-4299-ad22-e4bc9b063ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:19.525354 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a1b92-4608-4299-ad22-e4bc9b063ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:19.525549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a1b92-4608-4299-ad22-e4bc9b063ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:19.527556 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a1b92-4608-4299-ad22-e4bc9b063ce7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:19.528391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a1b92-4608-4299-ad22-e4bc9b063ce7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:15:19.528714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a1b92-4608-4299-ad22-e4bc9b063ce7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:19.534351 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a1b92-4608-4299-ad22-e4bc9b063ce7 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:19.561649 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1218/2437] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:15:19.563735 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c69ec1-3fed-4f85-a7e2-1be14aefb317 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:19.578885 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c69ec1-3fed-4f85-a7e2-1be14aefb317 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:19.585671 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e0cbe-92e7-4940-8333-cf12a347d5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:19.586412 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e0cbe-92e7-4940-8333-cf12a347d5a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:19.586779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e0cbe-92e7-4940-8333-cf12a347d5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:19.587063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e0cbe-92e7-4940-8333-cf12a347d5a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:19.587822 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e0cbe-92e7-4940-8333-cf12a347d5a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:19.591267 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e0cbe-92e7-4940-8333-cf12a347d5a6 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:19.665506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1220/2438] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:15:19 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:19.666871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a1b92-4608-4299-ad22-e4bc9b063ce7 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:19.681354 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a1b92-4608-4299-ad22-e4bc9b063ce7 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:19.724212 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:19.771633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adbb68-a199-46d9-9938-55f43bf34350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:19.772562 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adbb68-a199-46d9-9938-55f43bf34350 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:19.772734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adbb68-a199-46d9-9938-55f43bf34350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:19.773018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adbb68-a199-46d9-9938-55f43bf34350 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:19.773612 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68adbb68-a199-46d9-9938-55f43bf34350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:19.775584 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68adbb68-a199-46d9-9938-55f43bf34350 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:19.809384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1219/2439] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:15:19 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:19.810261 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e0cbe-92e7-4940-8333-cf12a347d5a6 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:19.824438 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e0cbe-92e7-4940-8333-cf12a347d5a6 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:19.832663 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af9353-06ad-437b-bf0d-d7ef48241962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:19.833730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af9353-06ad-437b-bf0d-d7ef48241962 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:19.834262 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af9353-06ad-437b-bf0d-d7ef48241962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:19.834801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af9353-06ad-437b-bf0d-d7ef48241962 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:19.835783 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af9353-06ad-437b-bf0d-d7ef48241962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:19.837834 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af9353-06ad-437b-bf0d-d7ef48241962 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:19.866451 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1221/2440] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:15:19.870190 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adbb68-a199-46d9-9938-55f43bf34350 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:19.881834 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adbb68-a199-46d9-9938-55f43bf34350 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:19.888548 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b1bdd-a1c1-4ae2-b21b-85def2585580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:19.889793 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b1bdd-a1c1-4ae2-b21b-85def2585580 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:19.890269 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b1bdd-a1c1-4ae2-b21b-85def2585580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:19.890770 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b1bdd-a1c1-4ae2-b21b-85def2585580 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:19.891738 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b1bdd-a1c1-4ae2-b21b-85def2585580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:19.893797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b1bdd-a1c1-4ae2-b21b-85def2585580 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:19.910739 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1220/2441] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:15:19.915272 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af9353-06ad-437b-bf0d-d7ef48241962 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:19.927659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af9353-06ad-437b-bf0d-d7ef48241962 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:19.936762 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d97a0-f33c-4fcb-b221-08cf53fd4d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:19.937793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d97a0-f33c-4fcb-b221-08cf53fd4d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:19.938383 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d97a0-f33c-4fcb-b221-08cf53fd4d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:19.938955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d97a0-f33c-4fcb-b221-08cf53fd4d19 admin admin] PATH_INFO: `/v3/projects/b9faac4fc9d446f6b6621dc310cb40ae/users/63ed1f130c1147c0b224f8a0f3506139/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:19.960125 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d97a0-f33c-4fcb-b221-08cf53fd4d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9faac4fc9d446f6b6621dc310cb40ae, user_id=63ed1f130c1147c0b224f8a0f3506139, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:19.964766 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d97a0-f33c-4fcb-b221-08cf53fd4d19 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:19.984400 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1222/2442] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:19 2022] PUT /identity/v3/projects/b9faac4fc9d446f6b6621dc310cb40ae/users/63ed1f130c1147c0b224f8a0f3506139/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:19.995519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e5563-e393-43d0-b37b-0611fe454a73 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:19.995900 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e5563-e393-43d0-b37b-0611fe454a73 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:19.996282 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e5563-e393-43d0-b37b-0611fe454a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:20.038563 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ed5e5563-e393-43d0-b37b-0611fe454a73 None None] MFA Rules not processed for user `63ed1f130c1147c0b224f8a0f3506139`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:20.040748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ed5e5563-e393-43d0-b37b-0611fe454a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:20.131089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1221/2443] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:20.132552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d97a0-f33c-4fcb-b221-08cf53fd4d19 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:20.228675 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d97a0-f33c-4fcb-b221-08cf53fd4d19 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:20.243255 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2d75a-2a23-4e63-968e-22ec9aafac98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:20.244218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2d75a-2a23-4e63-968e-22ec9aafac98 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:20.244677 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2d75a-2a23-4e63-968e-22ec9aafac98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:20.245164 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2d75a-2a23-4e63-968e-22ec9aafac98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:20.246559 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2d75a-2a23-4e63-968e-22ec9aafac98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:20.248653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2d75a-2a23-4e63-968e-22ec9aafac98 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:20.293670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1223/2444] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:15:20 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:20.297548 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e5563-e393-43d0-b37b-0611fe454a73 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:20.309498 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e5563-e393-43d0-b37b-0611fe454a73 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:20.369333 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a83c4-0659-403f-9a5e-95662d7994e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:20.369923 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a83c4-0659-403f-9a5e-95662d7994e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:20.370308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a83c4-0659-403f-9a5e-95662d7994e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:20.370619 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a83c4-0659-403f-9a5e-95662d7994e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:20.371333 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a83c4-0659-403f-9a5e-95662d7994e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:20.373315 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a83c4-0659-403f-9a5e-95662d7994e9 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:20.393405 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1222/2445] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:15:20 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:20.397423 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2d75a-2a23-4e63-968e-22ec9aafac98 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:20.408750 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2d75a-2a23-4e63-968e-22ec9aafac98 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:20.413580 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d515faf-898a-4a80-ad00-07dc87b07e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:20.414524 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d515faf-898a-4a80-ad00-07dc87b07e84 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:20.414815 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d515faf-898a-4a80-ad00-07dc87b07e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:20.415111 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d515faf-898a-4a80-ad00-07dc87b07e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:20.415904 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d515faf-898a-4a80-ad00-07dc87b07e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:20.418130 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d515faf-898a-4a80-ad00-07dc87b07e84 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:20.429653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1224/2446] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:20.433751 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a83c4-0659-403f-9a5e-95662d7994e9 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:20.443940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a83c4-0659-403f-9a5e-95662d7994e9 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:20.448745 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7167b-0fee-472e-8425-4283a0c2dc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:20.449424 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7167b-0fee-472e-8425-4283a0c2dc5e admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:20.449757 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7167b-0fee-472e-8425-4283a0c2dc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:20.450044 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7167b-0fee-472e-8425-4283a0c2dc5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:20.450897 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7167b-0fee-472e-8425-4283a0c2dc5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:20.452567 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7167b-0fee-472e-8425-4283a0c2dc5e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:20.464674 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1223/2447] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:20.468808 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d515faf-898a-4a80-ad00-07dc87b07e84 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:20.484026 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d515faf-898a-4a80-ad00-07dc87b07e84 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:20.495605 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967657b-19eb-4b4f-ad02-740c7d347810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:20.496644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967657b-19eb-4b4f-ad02-740c7d347810 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:20.497024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967657b-19eb-4b4f-ad02-740c7d347810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:20.497404 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967657b-19eb-4b4f-ad02-740c7d347810 admin admin] PATH_INFO: `/v3/projects/bb04f96fce744740add41265d74df191/users/21d24fce014d48b89794de168b231d4e/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:20.517262 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5967657b-19eb-4b4f-ad02-740c7d347810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb04f96fce744740add41265d74df191, user_id=21d24fce014d48b89794de168b231d4e, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:20.520312 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5967657b-19eb-4b4f-ad02-740c7d347810 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:20.537102 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1225/2448] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:20 2022] PUT /identity/v3/projects/bb04f96fce744740add41265d74df191/users/21d24fce014d48b89794de168b231d4e/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:20.551213 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35829d-f705-4726-97d9-524efb66306e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:20.551561 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35829d-f705-4726-97d9-524efb66306e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:20.551813 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35829d-f705-4726-97d9-524efb66306e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:20.583380 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-fd35829d-f705-4726-97d9-524efb66306e None None] MFA Rules not processed for user `21d24fce014d48b89794de168b231d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:20.584639 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-fd35829d-f705-4726-97d9-524efb66306e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:20.589592 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:20.682327 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1224/2449] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:20.686950 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967657b-19eb-4b4f-ad02-740c7d347810 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:20.758372 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:20.805234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967657b-19eb-4b4f-ad02-740c7d347810 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:20.811506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b061a-74ba-4f3b-8164-167a1c8bd988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:20.812451 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b061a-74ba-4f3b-8164-167a1c8bd988 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:20.812741 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b061a-74ba-4f3b-8164-167a1c8bd988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:20.813025 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b061a-74ba-4f3b-8164-167a1c8bd988 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:20.813735 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b061a-74ba-4f3b-8164-167a1c8bd988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:20.815844 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b061a-74ba-4f3b-8164-167a1c8bd988 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:20.864749 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1226/2450] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:15:20 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:15:20.868874 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35829d-f705-4726-97d9-524efb66306e None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:20.883031 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35829d-f705-4726-97d9-524efb66306e None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:20.989449 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd65e5-6a7e-4ebc-9298-59a638e4fb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:20.990905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd65e5-6a7e-4ebc-9298-59a638e4fb06 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:20.991194 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd65e5-6a7e-4ebc-9298-59a638e4fb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:20.991523 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd65e5-6a7e-4ebc-9298-59a638e4fb06 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:20.992238 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd65e5-6a7e-4ebc-9298-59a638e4fb06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:20.994923 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd65e5-6a7e-4ebc-9298-59a638e4fb06 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:21.021855 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1225/2451] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:15:20 2022] POST /identity/v3/users => generated 296 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:21.023665 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b061a-74ba-4f3b-8164-167a1c8bd988 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:21.038245 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b061a-74ba-4f3b-8164-167a1c8bd988 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:21.045233 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80636c2-747e-4aa7-bbe6-d7170e54b594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:21.045903 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80636c2-747e-4aa7-bbe6-d7170e54b594 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:21.046421 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80636c2-747e-4aa7-bbe6-d7170e54b594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:21.046685 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80636c2-747e-4aa7-bbe6-d7170e54b594 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:21.047410 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80636c2-747e-4aa7-bbe6-d7170e54b594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:21.049098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80636c2-747e-4aa7-bbe6-d7170e54b594 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:21.067449 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1227/2452] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:21.071850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd65e5-6a7e-4ebc-9298-59a638e4fb06 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:21.084299 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd65e5-6a7e-4ebc-9298-59a638e4fb06 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:21.089323 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065be9f-f61e-458e-9c3e-24d75a38cb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:21.090362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065be9f-f61e-458e-9c3e-24d75a38cb5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:21.105584 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065be9f-f61e-458e-9c3e-24d75a38cb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:21.106331 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065be9f-f61e-458e-9c3e-24d75a38cb5d admin admin] PATH_INFO: `/v3/projects/6e5018405aa4491ea136a30fba963991/users/a00c276735bc4150affc32c780633fe0/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:21.143611 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065be9f-f61e-458e-9c3e-24d75a38cb5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5018405aa4491ea136a30fba963991, user_id=a00c276735bc4150affc32c780633fe0, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:21.146987 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065be9f-f61e-458e-9c3e-24d75a38cb5d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:21.173909 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1226/2453] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:21 2022] PUT /identity/v3/projects/6e5018405aa4491ea136a30fba963991/users/a00c276735bc4150affc32c780633fe0/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:21.178320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80636c2-747e-4aa7-bbe6-d7170e54b594 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:21.190086 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80636c2-747e-4aa7-bbe6-d7170e54b594 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:21.278953 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176bd17a-58d3-4c71-873c-c53656f30c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:21.279944 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bd17a-58d3-4c71-873c-c53656f30c7d admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:21.280320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bd17a-58d3-4c71-873c-c53656f30c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:21.281130 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bd17a-58d3-4c71-873c-c53656f30c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:21.282010 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176bd17a-58d3-4c71-873c-c53656f30c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:21.284168 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176bd17a-58d3-4c71-873c-c53656f30c7d admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:21.301278 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1228/2454] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:21.302085 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065be9f-f61e-458e-9c3e-24d75a38cb5d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:21.314254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065be9f-f61e-458e-9c3e-24d75a38cb5d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:21.322234 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edc77d-0ca3-4e8d-b6ba-777e8bc64b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:21.324086 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edc77d-0ca3-4e8d-b6ba-777e8bc64b43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:21.324604 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edc77d-0ca3-4e8d-b6ba-777e8bc64b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:21.325102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edc77d-0ca3-4e8d-b6ba-777e8bc64b43 admin admin] PATH_INFO: `/v3/projects/6e5018405aa4491ea136a30fba963991/users/a00c276735bc4150affc32c780633fe0/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:21.329342 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edc77d-0ca3-4e8d-b6ba-777e8bc64b43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5018405aa4491ea136a30fba963991, user_id=a00c276735bc4150affc32c780633fe0, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:21.334431 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edc77d-0ca3-4e8d-b6ba-777e8bc64b43 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:21.372880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1227/2455] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:21 2022] PUT /identity/v3/projects/6e5018405aa4491ea136a30fba963991/users/a00c276735bc4150affc32c780633fe0/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:15:21.383072 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb677c3-0e2e-4f8e-8055-14429df3279d None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:21.383365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb677c3-0e2e-4f8e-8055-14429df3279d None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:21.383648 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb677c3-0e2e-4f8e-8055-14429df3279d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:21.419292 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-5cb677c3-0e2e-4f8e-8055-14429df3279d None None] MFA Rules not processed for user `a00c276735bc4150affc32c780633fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:21.420646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5cb677c3-0e2e-4f8e-8055-14429df3279d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:21.536037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1229/2456] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:21.550895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edc77d-0ca3-4e8d-b6ba-777e8bc64b43 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:21.553116 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-49edc77d-0ca3-4e8d-b6ba-777e8bc64b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:21.574403 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb677c3-0e2e-4f8e-8055-14429df3279d None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:21.576471 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5cb677c3-0e2e-4f8e-8055-14429df3279d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:21.624883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edc77d-0ca3-4e8d-b6ba-777e8bc64b43 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:21.630465 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4ca72-055c-4f78-ba93-c3e7a0a0e9ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:21.631096 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4ca72-055c-4f78-ba93-c3e7a0a0e9ff service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:21.631378 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4ca72-055c-4f78-ba93-c3e7a0a0e9ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:21.631889 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4ca72-055c-4f78-ba93-c3e7a0a0e9ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:21.642649 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4ca72-055c-4f78-ba93-c3e7a0a0e9ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:21.644214 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4ca72-055c-4f78-ba93-c3e7a0a0e9ff service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:21.653894 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:21.666769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1228/2457] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:15:21.669256 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4ca72-055c-4f78-ba93-c3e7a0a0e9ff service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:21.672406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-bda4ca72-055c-4f78-ba93-c3e7a0a0e9ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:21.678037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:21.739653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb677c3-0e2e-4f8e-8055-14429df3279d None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:21.748045 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2849c1-1915-42e5-b2ab-60c66ef33880 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6070c6b901f4e2ebe621a3e42dd2d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:21.748852 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2849c1-1915-42e5-b2ab-60c66ef33880 service placement] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:21.749240 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2849c1-1915-42e5-b2ab-60c66ef33880 service placement] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:21.749621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2849c1-1915-42e5-b2ab-60c66ef33880 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:21.751593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-af2849c1-1915-42e5-b2ab-60c66ef33880 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:21.765697 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2849c1-1915-42e5-b2ab-60c66ef33880 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:21.767448 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2849c1-1915-42e5-b2ab-60c66ef33880 service placement] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:21.782251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1230/2458] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:15:21.786683 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2849c1-1915-42e5-b2ab-60c66ef33880 service placement] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:21.791558 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-af2849c1-1915-42e5-b2ab-60c66ef33880 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:21.796800 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4ca72-055c-4f78-ba93-c3e7a0a0e9ff service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:21.803703 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df93d9-227b-4693-9370-5d800a14ab83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:21.804766 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df93d9-227b-4693-9370-5d800a14ab83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:21.805286 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df93d9-227b-4693-9370-5d800a14ab83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:21.805670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df93d9-227b-4693-9370-5d800a14ab83 admin admin] PATH_INFO: `/v3/users/5eb3da4d1e5e4a67830767d040e15a8d` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:21.807106 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df93d9-227b-4693-9370-5d800a14ab83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eb3da4d1e5e4a67830767d040e15a8d)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:21.810572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df93d9-227b-4693-9370-5d800a14ab83 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:21.815426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2849c1-1915-42e5-b2ab-60c66ef33880 service placement] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:21.821628 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f016c-edee-457d-a630-1c981f427626 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:21.822707 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f016c-edee-457d-a630-1c981f427626 service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:21.823222 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f016c-edee-457d-a630-1c981f427626 service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:21.823696 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f016c-edee-457d-a630-1c981f427626 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:21.896221 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b1df93d9-227b-4693-9370-5d800a14ab83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eb3da4d1e5e4a67830767d040e15a8d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:21.908629 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b1df93d9-227b-4693-9370-5d800a14ab83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eb3da4d1e5e4a67830767d040e15a8d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:21.913550 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f016c-edee-457d-a630-1c981f427626 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:21.915724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f016c-edee-457d-a630-1c981f427626 service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:21.922579 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b1df93d9-227b-4693-9370-5d800a14ab83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eb3da4d1e5e4a67830767d040e15a8d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:21.929515 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1231/2459] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:15:21.946038 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b1df93d9-227b-4693-9370-5d800a14ab83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eb3da4d1e5e4a67830767d040e15a8d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:21.947199 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b1df93d9-227b-4693-9370-5d800a14ab83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eb3da4d1e5e4a67830767d040e15a8d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:21.963167 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1229/2460] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:15:21 2022] DELETE /identity/v3/users/5eb3da4d1e5e4a67830767d040e15a8d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:22.168891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f016c-edee-457d-a630-1c981f427626 service cinder] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:22.186921 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f016c-edee-457d-a630-1c981f427626 service cinder] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:22.268993 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f747c9f-f2de-472e-b595-8d33b49f8e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:22.270310 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f747c9f-f2de-472e-b595-8d33b49f8e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:22.270724 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f747c9f-f2de-472e-b595-8d33b49f8e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:22.271096 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f747c9f-f2de-472e-b595-8d33b49f8e5c admin admin] PATH_INFO: `/v3/projects/7727d3d90ad240dc92914918f3d0af3f` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:22.273656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f747c9f-f2de-472e-b595-8d33b49f8e5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7727d3d90ad240dc92914918f3d0af3f)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:22.275835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f747c9f-f2de-472e-b595-8d33b49f8e5c admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:22.338152 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1f747c9f-f2de-472e-b595-8d33b49f8e5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7727d3d90ad240dc92914918f3d0af3f', 'request_id': 'req-1f747c9f-f2de-472e-b595-8d33b49f8e5c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:22.345442 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1f747c9f-f2de-472e-b595-8d33b49f8e5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7727d3d90ad240dc92914918f3d0af3f', 'request_id': 'req-1f747c9f-f2de-472e-b595-8d33b49f8e5c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:22.355066 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1f747c9f-f2de-472e-b595-8d33b49f8e5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7727d3d90ad240dc92914918f3d0af3f', 'request_id': 'req-1f747c9f-f2de-472e-b595-8d33b49f8e5c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:22.357036 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:22.372620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1f747c9f-f2de-472e-b595-8d33b49f8e5c admin admin] The token cache is being invalidate because project 7727d3d90ad240dc92914918f3d0af3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:15:22.381415 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1f747c9f-f2de-472e-b595-8d33b49f8e5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:22.381415 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1f747c9f-f2de-472e-b595-8d33b49f8e5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:22.381415 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1232/2461] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:15:22 2022] DELETE /identity/v3/projects/7727d3d90ad240dc92914918f3d0af3f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:22.382082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c52791-7f54-4fca-8de4-082b5a47985f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:22.382082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c52791-7f54-4fca-8de4-082b5a47985f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:22.382082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c52791-7f54-4fca-8de4-082b5a47985f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:22.400145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-b3c52791-7f54-4fca-8de4-082b5a47985f None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:22.401436 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b3c52791-7f54-4fca-8de4-082b5a47985f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:22.476371 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1230/2462] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:22.484760 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803c5b0-bafd-454f-b296-8385aa6b3d31 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:22.485141 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803c5b0-bafd-454f-b296-8385aa6b3d31 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:22.485546 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803c5b0-bafd-454f-b296-8385aa6b3d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:22.504904 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-2803c5b0-bafd-454f-b296-8385aa6b3d31 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:22.506147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-2803c5b0-bafd-454f-b296-8385aa6b3d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:22.514835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1233/2463] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:22.518985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c52791-7f54-4fca-8de4-082b5a47985f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:22.530409 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c52791-7f54-4fca-8de4-082b5a47985f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:22.535062 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32597846-5316-4b61-a236-8af9f00306c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:22.535748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32597846-5316-4b61-a236-8af9f00306c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:22.536039 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32597846-5316-4b61-a236-8af9f00306c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:22.536318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32597846-5316-4b61-a236-8af9f00306c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:22.537041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32597846-5316-4b61-a236-8af9f00306c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:15:22.537380 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32597846-5316-4b61-a236-8af9f00306c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:22.539252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32597846-5316-4b61-a236-8af9f00306c5 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:22.551665 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1231/2464] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:15:22.556352 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803c5b0-bafd-454f-b296-8385aa6b3d31 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:22.567188 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803c5b0-bafd-454f-b296-8385aa6b3d31 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:22.571898 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54a416-829c-4e42-88b9-3ce573983cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:22.572746 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54a416-829c-4e42-88b9-3ce573983cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:22.573024 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54a416-829c-4e42-88b9-3ce573983cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:22.573302 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54a416-829c-4e42-88b9-3ce573983cd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:22.574008 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54a416-829c-4e42-88b9-3ce573983cd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:22.575952 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54a416-829c-4e42-88b9-3ce573983cd1 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:22.601807 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1234/2465] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:15:22 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:22.606585 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32597846-5316-4b61-a236-8af9f00306c5 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:22.616502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32597846-5316-4b61-a236-8af9f00306c5 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:22.621805 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:22.683716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac6fe9-b34d-4b02-9a54-7a42b5128ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:22.684391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac6fe9-b34d-4b02-9a54-7a42b5128ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:22.684672 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac6fe9-b34d-4b02-9a54-7a42b5128ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:22.685060 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac6fe9-b34d-4b02-9a54-7a42b5128ba2 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:22.685636 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac6fe9-b34d-4b02-9a54-7a42b5128ba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:22.687589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac6fe9-b34d-4b02-9a54-7a42b5128ba2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:22.711168 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1232/2466] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:15:22 2022] POST /identity/v3/users => generated 302 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:22.712551 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54a416-829c-4e42-88b9-3ce573983cd1 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:22.723461 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54a416-829c-4e42-88b9-3ce573983cd1 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:22.728323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49156904-eb23-4dca-96c1-f5d99336cbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:22.729018 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49156904-eb23-4dca-96c1-f5d99336cbef admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:22.729327 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49156904-eb23-4dca-96c1-f5d99336cbef admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:22.730123 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49156904-eb23-4dca-96c1-f5d99336cbef admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:22.730907 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49156904-eb23-4dca-96c1-f5d99336cbef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:22.732534 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49156904-eb23-4dca-96c1-f5d99336cbef admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:22.745017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1235/2467] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:22.748842 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac6fe9-b34d-4b02-9a54-7a42b5128ba2 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:22.758920 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac6fe9-b34d-4b02-9a54-7a42b5128ba2 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:22.763613 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d142d-f6ec-4c84-b98a-6ca6f488f257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:22.764268 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d142d-f6ec-4c84-b98a-6ca6f488f257 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:22.764551 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d142d-f6ec-4c84-b98a-6ca6f488f257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:22.764828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d142d-f6ec-4c84-b98a-6ca6f488f257 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:22.765550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d142d-f6ec-4c84-b98a-6ca6f488f257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:22.767172 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d142d-f6ec-4c84-b98a-6ca6f488f257 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:22.777690 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1233/2468] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:22.782116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49156904-eb23-4dca-96c1-f5d99336cbef admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:22.792944 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49156904-eb23-4dca-96c1-f5d99336cbef admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:22.798270 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc3447-acb0-4c13-9903-2f4ce0bda47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:22.799260 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc3447-acb0-4c13-9903-2f4ce0bda47c admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:22.799542 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc3447-acb0-4c13-9903-2f4ce0bda47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:22.799818 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc3447-acb0-4c13-9903-2f4ce0bda47c admin admin] PATH_INFO: `/v3/projects/2ae40dfba7f5454ab5a2d3a5b9656ee2/users/1848abf6f0284135b795d6da52fbcb21/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:22.814255 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc3447-acb0-4c13-9903-2f4ce0bda47c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae40dfba7f5454ab5a2d3a5b9656ee2, user_id=1848abf6f0284135b795d6da52fbcb21, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:22.816945 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc3447-acb0-4c13-9903-2f4ce0bda47c admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:22.830854 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1236/2469] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:22 2022] PUT /identity/v3/projects/2ae40dfba7f5454ab5a2d3a5b9656ee2/users/1848abf6f0284135b795d6da52fbcb21/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:22.843706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddf5fe-9817-49de-aaf3-86652cf1a8d0 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:22.844003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddf5fe-9817-49de-aaf3-86652cf1a8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:22.844318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddf5fe-9817-49de-aaf3-86652cf1a8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:22.872506 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a9ddf5fe-9817-49de-aaf3-86652cf1a8d0 None None] MFA Rules not processed for user `1848abf6f0284135b795d6da52fbcb21`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:22.873746 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a9ddf5fe-9817-49de-aaf3-86652cf1a8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:22.941105 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1234/2470] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:22.945683 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc3447-acb0-4c13-9903-2f4ce0bda47c admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:23.019671 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc3447-acb0-4c13-9903-2f4ce0bda47c admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:23.024481 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95deff7-646a-4060-ab9f-34f60244477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:23.025141 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95deff7-646a-4060-ab9f-34f60244477e admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:23.025430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95deff7-646a-4060-ab9f-34f60244477e admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:23.025716 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95deff7-646a-4060-ab9f-34f60244477e admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:23.026987 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95deff7-646a-4060-ab9f-34f60244477e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:23.028988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95deff7-646a-4060-ab9f-34f60244477e admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:23.058263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1237/2471] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:15:22 2022] POST /identity/v3/projects => generated 403 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:23.059510 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddf5fe-9817-49de-aaf3-86652cf1a8d0 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:23.070846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddf5fe-9817-49de-aaf3-86652cf1a8d0 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:23.128655 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddef12-06a5-4529-a4cb-9cd6604aee95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:23.129323 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddef12-06a5-4529-a4cb-9cd6604aee95 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:23.129607 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddef12-06a5-4529-a4cb-9cd6604aee95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:23.129883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddef12-06a5-4529-a4cb-9cd6604aee95 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:23.130604 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ddef12-06a5-4529-a4cb-9cd6604aee95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:23.132653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ddef12-06a5-4529-a4cb-9cd6604aee95 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:23.153489 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1235/2472] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:15:23 2022] POST /identity/v3/users => generated 308 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:23.157598 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95deff7-646a-4060-ab9f-34f60244477e admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:23.167992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95deff7-646a-4060-ab9f-34f60244477e admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:23.172781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3a72c-fc35-41b8-83ab-668ce14f082c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:23.173437 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3a72c-fc35-41b8-83ab-668ce14f082c admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:23.173720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3a72c-fc35-41b8-83ab-668ce14f082c admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:23.174005 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3a72c-fc35-41b8-83ab-668ce14f082c admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:23.174744 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3a72c-fc35-41b8-83ab-668ce14f082c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:23.176338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3a72c-fc35-41b8-83ab-668ce14f082c admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:23.186974 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1238/2473] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:23.191352 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddef12-06a5-4529-a4cb-9cd6604aee95 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:23.198830 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:23.203059 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddef12-06a5-4529-a4cb-9cd6604aee95 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:23.209381 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c2047-de7e-48a9-9ed9-cfe7b399d231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:23.210280 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c2047-de7e-48a9-9ed9-cfe7b399d231 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:23.210596 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c2047-de7e-48a9-9ed9-cfe7b399d231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:23.210877 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c2047-de7e-48a9-9ed9-cfe7b399d231 admin admin] PATH_INFO: `/v3/projects/0e8b07f40ee44ca4b56372c3e00c711c/users/fd0d1084b6774725a0a0e328b61800cf/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:23.226651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c2047-de7e-48a9-9ed9-cfe7b399d231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8b07f40ee44ca4b56372c3e00c711c, user_id=fd0d1084b6774725a0a0e328b61800cf, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:23.229320 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c2047-de7e-48a9-9ed9-cfe7b399d231 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:23.243191 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1236/2474] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:23 2022] PUT /identity/v3/projects/0e8b07f40ee44ca4b56372c3e00c711c/users/fd0d1084b6774725a0a0e328b61800cf/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:23.247404 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3a72c-fc35-41b8-83ab-668ce14f082c admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:23.257545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3a72c-fc35-41b8-83ab-668ce14f082c admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:23.328630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b3ee3-1b1a-4959-be38-78f7f91ed4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:23.329313 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b3ee3-1b1a-4959-be38-78f7f91ed4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:23.329655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b3ee3-1b1a-4959-be38-78f7f91ed4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:23.330246 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b3ee3-1b1a-4959-be38-78f7f91ed4a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:23.331187 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b3ee3-1b1a-4959-be38-78f7f91ed4a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:23.332812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b3ee3-1b1a-4959-be38-78f7f91ed4a1 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:23.335253 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:23.346295 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1239/2475] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:15:23.350572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c2047-de7e-48a9-9ed9-cfe7b399d231 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:23.361323 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c2047-de7e-48a9-9ed9-cfe7b399d231 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:23.366322 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9adfe-392b-4507-ab82-34560e5f1e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:23.367258 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9adfe-392b-4507-ab82-34560e5f1e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:23.367537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9adfe-392b-4507-ab82-34560e5f1e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:23.367813 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9adfe-392b-4507-ab82-34560e5f1e18 admin admin] PATH_INFO: `/v3/projects/0e8b07f40ee44ca4b56372c3e00c711c/users/fd0d1084b6774725a0a0e328b61800cf/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:23.369926 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9adfe-392b-4507-ab82-34560e5f1e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8b07f40ee44ca4b56372c3e00c711c, user_id=fd0d1084b6774725a0a0e328b61800cf, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:23.373103 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9adfe-392b-4507-ab82-34560e5f1e18 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:23.397568 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1237/2476] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:23 2022] PUT /identity/v3/projects/0e8b07f40ee44ca4b56372c3e00c711c/users/fd0d1084b6774725a0a0e328b61800cf/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:15:23.408686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bffe2-9d7f-410a-901d-f8b416d96b2d None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:23.409108 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bffe2-9d7f-410a-901d-f8b416d96b2d None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:23.409625 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bffe2-9d7f-410a-901d-f8b416d96b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:23.451939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-c95bffe2-9d7f-410a-901d-f8b416d96b2d None None] MFA Rules not processed for user `fd0d1084b6774725a0a0e328b61800cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:23.453289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-c95bffe2-9d7f-410a-901d-f8b416d96b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:23.543398 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1240/2477] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:23 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:23.554065 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9adfe-392b-4507-ab82-34560e5f1e18 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:23.555952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5dc9adfe-392b-4507-ab82-34560e5f1e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:23.623418 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9adfe-392b-4507-ab82-34560e5f1e18 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:23.627201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599131e-2de8-4751-9807-0114dfbfc17d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:23.627851 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599131e-2de8-4751-9807-0114dfbfc17d service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:23.628138 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599131e-2de8-4751-9807-0114dfbfc17d service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:23.628536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599131e-2de8-4751-9807-0114dfbfc17d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:23.638960 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599131e-2de8-4751-9807-0114dfbfc17d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:23.640552 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599131e-2de8-4751-9807-0114dfbfc17d service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:23.651839 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1238/2478] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:23 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:15:23.801485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bffe2-9d7f-410a-901d-f8b416d96b2d None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:23.874839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bffe2-9d7f-410a-901d-f8b416d96b2d None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:23.879225 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8adccd-b370-44e4-a0a7-06b952e18925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:23.880242 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8adccd-b370-44e4-a0a7-06b952e18925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:23.880523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8adccd-b370-44e4-a0a7-06b952e18925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:23.880801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8adccd-b370-44e4-a0a7-06b952e18925 admin admin] PATH_INFO: `/v3/users/1848abf6f0284135b795d6da52fbcb21` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:23.882000 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8adccd-b370-44e4-a0a7-06b952e18925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1848abf6f0284135b795d6da52fbcb21)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:23.883962 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8adccd-b370-44e4-a0a7-06b952e18925 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:23.930077 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ff8adccd-b370-44e4-a0a7-06b952e18925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1848abf6f0284135b795d6da52fbcb21'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:23.937859 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ff8adccd-b370-44e4-a0a7-06b952e18925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1848abf6f0284135b795d6da52fbcb21'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:23.938601 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ff8adccd-b370-44e4-a0a7-06b952e18925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1848abf6f0284135b795d6da52fbcb21'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:23.951418 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ff8adccd-b370-44e4-a0a7-06b952e18925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1848abf6f0284135b795d6da52fbcb21'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:23.952078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ff8adccd-b370-44e4-a0a7-06b952e18925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1848abf6f0284135b795d6da52fbcb21'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:23.964614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1241/2479] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:15:23 2022] DELETE /identity/v3/users/1848abf6f0284135b795d6da52fbcb21 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:23.969082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f1a60-465b-43a2-850d-f382b24be981 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:23.969367 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f1a60-465b-43a2-850d-f382b24be981 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:23.969642 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f1a60-465b-43a2-850d-f382b24be981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:23.986779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f26f1a60-465b-43a2-850d-f382b24be981 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:23.987967 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f26f1a60-465b-43a2-850d-f382b24be981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:24.048815 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1239/2480] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:24.059418 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8adccd-b370-44e4-a0a7-06b952e18925 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:24.060870 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ff8adccd-b370-44e4-a0a7-06b952e18925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:24.066159 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:24.129771 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8adccd-b370-44e4-a0a7-06b952e18925 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:24.136347 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680c2c9-a825-4eaf-a95b-023733b945dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:24.137091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680c2c9-a825-4eaf-a95b-023733b945dd service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:24.137410 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680c2c9-a825-4eaf-a95b-023733b945dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:24.137726 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680c2c9-a825-4eaf-a95b-023733b945dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:24.149511 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680c2c9-a825-4eaf-a95b-023733b945dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:24.153426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680c2c9-a825-4eaf-a95b-023733b945dd service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:24.162550 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1242/2481] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:15:24.481927 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f1a60-465b-43a2-850d-f382b24be981 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:24.483856 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f26f1a60-465b-43a2-850d-f382b24be981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:24.509613 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f1a60-465b-43a2-850d-f382b24be981 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:24.515819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98d7ca-4347-4401-bbf4-81846c3f2aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:24.516722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98d7ca-4347-4401-bbf4-81846c3f2aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:24.517018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98d7ca-4347-4401-bbf4-81846c3f2aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:24.517317 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98d7ca-4347-4401-bbf4-81846c3f2aad admin admin] PATH_INFO: `/v3/projects/2ae40dfba7f5454ab5a2d3a5b9656ee2` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:24.519056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98d7ca-4347-4401-bbf4-81846c3f2aad admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ae40dfba7f5454ab5a2d3a5b9656ee2)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:24.521578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98d7ca-4347-4401-bbf4-81846c3f2aad admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:24.573194 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0f98d7ca-4347-4401-bbf4-81846c3f2aad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ae40dfba7f5454ab5a2d3a5b9656ee2', 'request_id': 'req-0f98d7ca-4347-4401-bbf4-81846c3f2aad'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:24.579426 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0f98d7ca-4347-4401-bbf4-81846c3f2aad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ae40dfba7f5454ab5a2d3a5b9656ee2', 'request_id': 'req-0f98d7ca-4347-4401-bbf4-81846c3f2aad'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:24.585229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0f98d7ca-4347-4401-bbf4-81846c3f2aad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ae40dfba7f5454ab5a2d3a5b9656ee2', 'request_id': 'req-0f98d7ca-4347-4401-bbf4-81846c3f2aad'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:24.588209 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:24.602908 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0f98d7ca-4347-4401-bbf4-81846c3f2aad admin admin] The token cache is being invalidate because project 2ae40dfba7f5454ab5a2d3a5b9656ee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:15:24.603481 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0f98d7ca-4347-4401-bbf4-81846c3f2aad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:24.604170 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0f98d7ca-4347-4401-bbf4-81846c3f2aad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:24.609120 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1240/2482] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:15:24 2022] DELETE /identity/v3/projects/2ae40dfba7f5454ab5a2d3a5b9656ee2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:15:24.613098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680c2c9-a825-4eaf-a95b-023733b945dd service neutron] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:24.623655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680c2c9-a825-4eaf-a95b-023733b945dd service neutron] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:24.680869 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d37615-1a10-4b8d-a5b5-82f4f75f94e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:24.681801 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d37615-1a10-4b8d-a5b5-82f4f75f94e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:24.682094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d37615-1a10-4b8d-a5b5-82f4f75f94e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:24.682395 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d37615-1a10-4b8d-a5b5-82f4f75f94e6 admin admin] PATH_INFO: `/v3/users/fd0d1084b6774725a0a0e328b61800cf` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:24.684258 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d37615-1a10-4b8d-a5b5-82f4f75f94e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd0d1084b6774725a0a0e328b61800cf)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:24.686277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d37615-1a10-4b8d-a5b5-82f4f75f94e6 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:24.734623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-b6d37615-1a10-4b8d-a5b5-82f4f75f94e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd0d1084b6774725a0a0e328b61800cf'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:24.743856 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-b6d37615-1a10-4b8d-a5b5-82f4f75f94e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd0d1084b6774725a0a0e328b61800cf'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:24.744518 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-b6d37615-1a10-4b8d-a5b5-82f4f75f94e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd0d1084b6774725a0a0e328b61800cf'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:24.757193 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-b6d37615-1a10-4b8d-a5b5-82f4f75f94e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd0d1084b6774725a0a0e328b61800cf'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:24.757815 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-b6d37615-1a10-4b8d-a5b5-82f4f75f94e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd0d1084b6774725a0a0e328b61800cf'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:24.769763 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1243/2483] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:15:24 2022] DELETE /identity/v3/users/fd0d1084b6774725a0a0e328b61800cf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:25.104429 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98d7ca-4347-4401-bbf4-81846c3f2aad admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:25.106576 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0f98d7ca-4347-4401-bbf4-81846c3f2aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:25.119979 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98d7ca-4347-4401-bbf4-81846c3f2aad admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:25.187897 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148817a6-f290-4442-a6cf-a8cec376a113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:25.188486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148817a6-f290-4442-a6cf-a8cec376a113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:25.188775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148817a6-f290-4442-a6cf-a8cec376a113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:25.189207 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148817a6-f290-4442-a6cf-a8cec376a113 admin admin] PATH_INFO: `/v3/users/63ed1f130c1147c0b224f8a0f3506139` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:25.190458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148817a6-f290-4442-a6cf-a8cec376a113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63ed1f130c1147c0b224f8a0f3506139)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:25.192489 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148817a6-f290-4442-a6cf-a8cec376a113 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:25.257679 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-148817a6-f290-4442-a6cf-a8cec376a113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63ed1f130c1147c0b224f8a0f3506139'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:25.269196 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-148817a6-f290-4442-a6cf-a8cec376a113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63ed1f130c1147c0b224f8a0f3506139'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:25.273350 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d37615-1a10-4b8d-a5b5-82f4f75f94e6 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:25.276147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b6d37615-1a10-4b8d-a5b5-82f4f75f94e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:25.280244 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-148817a6-f290-4442-a6cf-a8cec376a113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63ed1f130c1147c0b224f8a0f3506139'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:25.293173 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d37615-1a10-4b8d-a5b5-82f4f75f94e6 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:25.295717 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-148817a6-f290-4442-a6cf-a8cec376a113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63ed1f130c1147c0b224f8a0f3506139'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:25.296545 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-148817a6-f290-4442-a6cf-a8cec376a113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63ed1f130c1147c0b224f8a0f3506139'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:25.303000 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1241/2484] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:15:25 2022] DELETE /identity/v3/users/63ed1f130c1147c0b224f8a0f3506139 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:25.307905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf140c-2721-4a19-bbae-3cb8e47edee0 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:25.308350 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf140c-2721-4a19-bbae-3cb8e47edee0 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:25.308642 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf140c-2721-4a19-bbae-3cb8e47edee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:25.330431 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:25.332231 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a5bf140c-2721-4a19-bbae-3cb8e47edee0 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:25.333997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a5bf140c-2721-4a19-bbae-3cb8e47edee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:25.380169 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb30f6-52fb-47b1-a7b2-a770b84f8484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:25.380169 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb30f6-52fb-47b1-a7b2-a770b84f8484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:25.380169 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb30f6-52fb-47b1-a7b2-a770b84f8484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:25.380169 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb30f6-52fb-47b1-a7b2-a770b84f8484 admin admin] PATH_INFO: `/v3/projects/0e8b07f40ee44ca4b56372c3e00c711c` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:25.380530 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb30f6-52fb-47b1-a7b2-a770b84f8484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e8b07f40ee44ca4b56372c3e00c711c)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:25.382288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb30f6-52fb-47b1-a7b2-a770b84f8484 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:25.417217 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1242/2485] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:15:25.423991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf140c-2721-4a19-bbae-3cb8e47edee0 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:25.425492 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a5bf140c-2721-4a19-bbae-3cb8e47edee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:25.440627 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:25.449612 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-94eb30f6-52fb-47b1-a7b2-a770b84f8484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e8b07f40ee44ca4b56372c3e00c711c', 'request_id': 'req-94eb30f6-52fb-47b1-a7b2-a770b84f8484'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:25.455995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-94eb30f6-52fb-47b1-a7b2-a770b84f8484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e8b07f40ee44ca4b56372c3e00c711c', 'request_id': 'req-94eb30f6-52fb-47b1-a7b2-a770b84f8484'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:25.461809 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-94eb30f6-52fb-47b1-a7b2-a770b84f8484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e8b07f40ee44ca4b56372c3e00c711c', 'request_id': 'req-94eb30f6-52fb-47b1-a7b2-a770b84f8484'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:25.475796 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-94eb30f6-52fb-47b1-a7b2-a770b84f8484 admin admin] The token cache is being invalidate because project 0e8b07f40ee44ca4b56372c3e00c711c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:15:25.476099 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-94eb30f6-52fb-47b1-a7b2-a770b84f8484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:25.476763 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-94eb30f6-52fb-47b1-a7b2-a770b84f8484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:25.478321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1244/2486] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:15:25 2022] DELETE /identity/v3/projects/0e8b07f40ee44ca4b56372c3e00c711c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:15:25.479272 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb30f6-52fb-47b1-a7b2-a770b84f8484 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:25.481092 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-94eb30f6-52fb-47b1-a7b2-a770b84f8484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:25.495783 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf140c-2721-4a19-bbae-3cb8e47edee0 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:25.541945 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb30f6-52fb-47b1-a7b2-a770b84f8484 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:25.546250 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed1b9d-3ed8-49b3-b190-312a007a0364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:25.546976 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed1b9d-3ed8-49b3-b190-312a007a0364 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:25.547271 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed1b9d-3ed8-49b3-b190-312a007a0364 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:25.547572 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed1b9d-3ed8-49b3-b190-312a007a0364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:25.549504 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-11ed1b9d-3ed8-49b3-b190-312a007a0364 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:25.618029 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed1b9d-3ed8-49b3-b190-312a007a0364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:25.619570 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed1b9d-3ed8-49b3-b190-312a007a0364 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:25.630625 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1245/2487] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:15:25.632243 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da7882-60d7-4447-82de-a16a6a14bfa6 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:25.632519 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da7882-60d7-4447-82de-a16a6a14bfa6 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:25.632838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da7882-60d7-4447-82de-a16a6a14bfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:25.641191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:25.653634 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-92da7882-60d7-4447-82de-a16a6a14bfa6 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:25.656546 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-92da7882-60d7-4447-82de-a16a6a14bfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:25.666997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1246/2488] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:25.675320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f2d1e-e500-401f-b127-0f1d884ab8fa None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:25.675601 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50704383-f6d4-45fd-ac32-c7635e43dd8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:25.675838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f2d1e-e500-401f-b127-0f1d884ab8fa None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:25.676004 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f2d1e-e500-401f-b127-0f1d884ab8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:25.676293 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50704383-f6d4-45fd-ac32-c7635e43dd8b service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:25.676607 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50704383-f6d4-45fd-ac32-c7635e43dd8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:25.676948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50704383-f6d4-45fd-ac32-c7635e43dd8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:25.679104 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-50704383-f6d4-45fd-ac32-c7635e43dd8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:25.692316 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50704383-f6d4-45fd-ac32-c7635e43dd8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:25.693872 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50704383-f6d4-45fd-ac32-c7635e43dd8b service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:25.695412 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-327f2d1e-e500-401f-b127-0f1d884ab8fa None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:25.696637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-327f2d1e-e500-401f-b127-0f1d884ab8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:25.704922 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1243/2489] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:15:25.706709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1247/2490] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:15:25.709356 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50704383-f6d4-45fd-ac32-c7635e43dd8b service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:25.720103 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50704383-f6d4-45fd-ac32-c7635e43dd8b service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:25.725352 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ae810-d20c-4769-81bb-bd83935ad56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:25.726018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ae810-d20c-4769-81bb-bd83935ad56c admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:25.726298 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ae810-d20c-4769-81bb-bd83935ad56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:25.726599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ae810-d20c-4769-81bb-bd83935ad56c admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:25.727323 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ae810-d20c-4769-81bb-bd83935ad56c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:15:25.727627 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ae810-d20c-4769-81bb-bd83935ad56c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:25.730104 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ae810-d20c-4769-81bb-bd83935ad56c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:25.747586 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1244/2491] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:15:25.752063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f2d1e-e500-401f-b127-0f1d884ab8fa None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:25.763061 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f2d1e-e500-401f-b127-0f1d884ab8fa None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:25.768070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9c02d-dcc3-4665-b60a-d88d8b1d5665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:25.768999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9c02d-dcc3-4665-b60a-d88d8b1d5665 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:25.769387 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9c02d-dcc3-4665-b60a-d88d8b1d5665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:25.769800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9c02d-dcc3-4665-b60a-d88d8b1d5665 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:25.770710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9c02d-dcc3-4665-b60a-d88d8b1d5665 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:25.772718 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9c02d-dcc3-4665-b60a-d88d8b1d5665 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:25.806510 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1248/2492] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:15:25 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:25.810975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ae810-d20c-4769-81bb-bd83935ad56c admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:25.821634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ae810-d20c-4769-81bb-bd83935ad56c admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:25.898667 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37b7e3-a0fc-4e99-94f7-0afdcbd649c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:25.899737 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37b7e3-a0fc-4e99-94f7-0afdcbd649c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:25.900083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37b7e3-a0fc-4e99-94f7-0afdcbd649c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:25.900499 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37b7e3-a0fc-4e99-94f7-0afdcbd649c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:25.902228 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37b7e3-a0fc-4e99-94f7-0afdcbd649c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:25.904317 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37b7e3-a0fc-4e99-94f7-0afdcbd649c1 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:25.932653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1245/2493] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:15:25 2022] POST /identity/v3/users => generated 283 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:15:25.934728 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9c02d-dcc3-4665-b60a-d88d8b1d5665 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:25.949725 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9c02d-dcc3-4665-b60a-d88d8b1d5665 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:25.956320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbabc2-c548-4360-b8cb-0639481aa567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:25.957654 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbabc2-c548-4360-b8cb-0639481aa567 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:25.958133 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbabc2-c548-4360-b8cb-0639481aa567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:25.958664 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbabc2-c548-4360-b8cb-0639481aa567 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:25.959704 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbabc2-c548-4360-b8cb-0639481aa567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:25.961342 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbabc2-c548-4360-b8cb-0639481aa567 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:25.978280 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1249/2494] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:25.979891 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37b7e3-a0fc-4e99-94f7-0afdcbd649c1 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:25.992338 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37b7e3-a0fc-4e99-94f7-0afdcbd649c1 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:25.999385 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbabc2-c548-4360-b8cb-0639481aa567 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:26.001750 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd35ba-4c81-4cc0-8aa1-b587a3f0e49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:26.002296 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-68dbabc2-c548-4360-b8cb-0639481aa567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:26.002718 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd35ba-4c81-4cc0-8aa1-b587a3f0e49f admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:26.003127 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd35ba-4c81-4cc0-8aa1-b587a3f0e49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:26.003687 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd35ba-4c81-4cc0-8aa1-b587a3f0e49f admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:26.004651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd35ba-4c81-4cc0-8aa1-b587a3f0e49f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:26.007174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd35ba-4c81-4cc0-8aa1-b587a3f0e49f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:26.023123 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1246/2495] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:15:26.027666 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd35ba-4c81-4cc0-8aa1-b587a3f0e49f admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:26.029331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbabc2-c548-4360-b8cb-0639481aa567 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:26.034865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe22084-561c-4b81-99de-7ad0e202208c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:26.035840 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe22084-561c-4b81-99de-7ad0e202208c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:26.036353 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe22084-561c-4b81-99de-7ad0e202208c admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:26.036707 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe22084-561c-4b81-99de-7ad0e202208c admin admin] PATH_INFO: `/v3/projects/b9faac4fc9d446f6b6621dc310cb40ae` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:26.038133 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe22084-561c-4b81-99de-7ad0e202208c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9faac4fc9d446f6b6621dc310cb40ae)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:26.040458 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe22084-561c-4b81-99de-7ad0e202208c admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:26.041330 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd35ba-4c81-4cc0-8aa1-b587a3f0e49f admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:26.056170 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee643180-255a-4e32-8610-b6a214266208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:26.057004 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee643180-255a-4e32-8610-b6a214266208 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:26.057291 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee643180-255a-4e32-8610-b6a214266208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:26.057770 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee643180-255a-4e32-8610-b6a214266208 admin admin] PATH_INFO: `/v3/projects/3d7da03608de4b6dba832c99a00d9b9b/users/b2822a3c3a664fb3a0b33678e1aec785/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:26.080679 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee643180-255a-4e32-8610-b6a214266208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7da03608de4b6dba832c99a00d9b9b, user_id=b2822a3c3a664fb3a0b33678e1aec785, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:26.085806 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee643180-255a-4e32-8610-b6a214266208 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:26.109597 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1247/2496] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:26 2022] PUT /identity/v3/projects/3d7da03608de4b6dba832c99a00d9b9b/users/b2822a3c3a664fb3a0b33678e1aec785/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:26.110943 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-dbe22084-561c-4b81-99de-7ad0e202208c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9faac4fc9d446f6b6621dc310cb40ae', 'request_id': 'req-dbe22084-561c-4b81-99de-7ad0e202208c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:26.118413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-dbe22084-561c-4b81-99de-7ad0e202208c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9faac4fc9d446f6b6621dc310cb40ae', 'request_id': 'req-dbe22084-561c-4b81-99de-7ad0e202208c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:26.120932 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e266b-44dd-4e8b-baef-2b6fd07c448b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:26.121226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e266b-44dd-4e8b-baef-2b6fd07c448b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:26.121533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e266b-44dd-4e8b-baef-2b6fd07c448b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:26.126865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-dbe22084-561c-4b81-99de-7ad0e202208c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9faac4fc9d446f6b6621dc310cb40ae', 'request_id': 'req-dbe22084-561c-4b81-99de-7ad0e202208c'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:26.143624 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-dbe22084-561c-4b81-99de-7ad0e202208c admin admin] The token cache is being invalidate because project b9faac4fc9d446f6b6621dc310cb40ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:15:26.145162 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-dbe22084-561c-4b81-99de-7ad0e202208c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:26.145322 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-dbe22084-561c-4b81-99de-7ad0e202208c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:26.148043 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1250/2497] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:15:25 2022] DELETE /identity/v3/projects/b9faac4fc9d446f6b6621dc310cb40ae => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:26.150708 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:26.153686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe22084-561c-4b81-99de-7ad0e202208c admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:26.155653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-dbe22084-561c-4b81-99de-7ad0e202208c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:26.156705 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-1f3e266b-44dd-4e8b-baef-2b6fd07c448b None None] MFA Rules not processed for user `b2822a3c3a664fb3a0b33678e1aec785`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:26.159317 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1f3e266b-44dd-4e8b-baef-2b6fd07c448b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:26.237044 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe22084-561c-4b81-99de-7ad0e202208c admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:26.247195 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1248/2498] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:15:26.252777 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e266b-44dd-4e8b-baef-2b6fd07c448b None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:26.254641 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1f3e266b-44dd-4e8b-baef-2b6fd07c448b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:26.293986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:26.313418 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2551e1-7723-4885-a41b-f2f09e72af10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:26.314395 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2551e1-7723-4885-a41b-f2f09e72af10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:26.314788 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2551e1-7723-4885-a41b-f2f09e72af10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:26.315250 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2551e1-7723-4885-a41b-f2f09e72af10 admin admin] PATH_INFO: `/v3/users/21d24fce014d48b89794de168b231d4e` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:26.316756 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2551e1-7723-4885-a41b-f2f09e72af10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21d24fce014d48b89794de168b231d4e)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:26.319115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2551e1-7723-4885-a41b-f2f09e72af10 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:26.335765 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e266b-44dd-4e8b-baef-2b6fd07c448b None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:26.342324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524aaf4a-c85c-46b9-a487-bfd83ea4af34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:26.343029 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524aaf4a-c85c-46b9-a487-bfd83ea4af34 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:26.343317 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524aaf4a-c85c-46b9-a487-bfd83ea4af34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:26.343600 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524aaf4a-c85c-46b9-a487-bfd83ea4af34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:26.344302 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524aaf4a-c85c-46b9-a487-bfd83ea4af34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:26.346369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524aaf4a-c85c-46b9-a487-bfd83ea4af34 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:26.381240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1249/2499] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:15:26 2022] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:15:26.385294 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ab2551e1-7723-4885-a41b-f2f09e72af10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21d24fce014d48b89794de168b231d4e'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:26.386475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524aaf4a-c85c-46b9-a487-bfd83ea4af34 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:26.395124 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ab2551e1-7723-4885-a41b-f2f09e72af10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21d24fce014d48b89794de168b231d4e'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:26.396180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ab2551e1-7723-4885-a41b-f2f09e72af10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21d24fce014d48b89794de168b231d4e'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:26.412981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ab2551e1-7723-4885-a41b-f2f09e72af10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21d24fce014d48b89794de168b231d4e'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:26.413720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ab2551e1-7723-4885-a41b-f2f09e72af10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21d24fce014d48b89794de168b231d4e'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:26.433778 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1251/2500] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:15:26 2022] DELETE /identity/v3/users/21d24fce014d48b89794de168b231d4e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:26.460307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524aaf4a-c85c-46b9-a487-bfd83ea4af34 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:26.496736 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:26.526861 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d6e9b-a84b-428b-940e-20ceba062520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:26.527700 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d6e9b-a84b-428b-940e-20ceba062520 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:26.528060 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d6e9b-a84b-428b-940e-20ceba062520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:26.528437 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d6e9b-a84b-428b-940e-20ceba062520 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:26.529204 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d6e9b-a84b-428b-940e-20ceba062520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:26.531394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d6e9b-a84b-428b-940e-20ceba062520 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:26.558544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1250/2501] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:15:26 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:15:26.562283 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2551e1-7723-4885-a41b-f2f09e72af10 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:26.563928 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ab2551e1-7723-4885-a41b-f2f09e72af10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:26.577475 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2551e1-7723-4885-a41b-f2f09e72af10 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:26.582686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e959028-1def-4041-99d2-249cec2745ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:26.583380 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e959028-1def-4041-99d2-249cec2745ec admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:26.583660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e959028-1def-4041-99d2-249cec2745ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:26.583940 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e959028-1def-4041-99d2-249cec2745ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:26.584666 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e959028-1def-4041-99d2-249cec2745ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:26.586290 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e959028-1def-4041-99d2-249cec2745ec admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:26.602694 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1252/2502] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:26.606973 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d6e9b-a84b-428b-940e-20ceba062520 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:26.619501 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d6e9b-a84b-428b-940e-20ceba062520 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:26.624586 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3221b0d-5075-47af-9be2-684e95028805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:26.625560 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3221b0d-5075-47af-9be2-684e95028805 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:26.625844 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3221b0d-5075-47af-9be2-684e95028805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:26.626119 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3221b0d-5075-47af-9be2-684e95028805 admin admin] PATH_INFO: `/v3/projects/ef855ab8496d45c3a3117d4f70244332/users/c46c5f66b1394d4f93c45bd0c2ce5113/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:26.647804 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3221b0d-5075-47af-9be2-684e95028805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef855ab8496d45c3a3117d4f70244332, user_id=c46c5f66b1394d4f93c45bd0c2ce5113, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:26.652549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3221b0d-5075-47af-9be2-684e95028805 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:26.675569 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1251/2503] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:26 2022] PUT /identity/v3/projects/ef855ab8496d45c3a3117d4f70244332/users/c46c5f66b1394d4f93c45bd0c2ce5113/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:26.679888 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e959028-1def-4041-99d2-249cec2745ec admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:26.695498 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e959028-1def-4041-99d2-249cec2745ec admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:26.791319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3221b0d-5075-47af-9be2-684e95028805 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:26.794670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a3221b0d-5075-47af-9be2-684e95028805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:26.797154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec222a-ddd1-44db-b07f-319c4cf8bf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:26.797838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec222a-ddd1-44db-b07f-319c4cf8bf05 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:26.798124 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec222a-ddd1-44db-b07f-319c4cf8bf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:26.798405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec222a-ddd1-44db-b07f-319c4cf8bf05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:26.799166 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec222a-ddd1-44db-b07f-319c4cf8bf05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:26.800786 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec222a-ddd1-44db-b07f-319c4cf8bf05 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:26.817076 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3221b0d-5075-47af-9be2-684e95028805 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:26.817786 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1253/2504] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:26.821890 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec222a-ddd1-44db-b07f-319c4cf8bf05 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:26.826761 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76dde5-397f-498e-be52-c641aa490606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:26.827925 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76dde5-397f-498e-be52-c641aa490606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:26.828311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76dde5-397f-498e-be52-c641aa490606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:26.829379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76dde5-397f-498e-be52-c641aa490606 admin admin] PATH_INFO: `/v3/projects/bb04f96fce744740add41265d74df191` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:26.830324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76dde5-397f-498e-be52-c641aa490606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb04f96fce744740add41265d74df191)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:26.832672 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76dde5-397f-498e-be52-c641aa490606 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:26.847993 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec222a-ddd1-44db-b07f-319c4cf8bf05 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:26.855301 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957b5b9-03b1-49d6-a14f-f5fcbdcb8e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:26.856321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957b5b9-03b1-49d6-a14f-f5fcbdcb8e16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:26.856707 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957b5b9-03b1-49d6-a14f-f5fcbdcb8e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:26.857098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957b5b9-03b1-49d6-a14f-f5fcbdcb8e16 admin admin] PATH_INFO: `/v3/projects/ef855ab8496d45c3a3117d4f70244332/users/c46c5f66b1394d4f93c45bd0c2ce5113/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:26.859566 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957b5b9-03b1-49d6-a14f-f5fcbdcb8e16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef855ab8496d45c3a3117d4f70244332, user_id=c46c5f66b1394d4f93c45bd0c2ce5113, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:26.862601 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957b5b9-03b1-49d6-a14f-f5fcbdcb8e16 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:26.877488 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1254/2505] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:26 2022] PUT /identity/v3/projects/ef855ab8496d45c3a3117d4f70244332/users/c46c5f66b1394d4f93c45bd0c2ce5113/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:15:26.887741 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a892dc-d376-4a9e-9fc3-d4d6d3e2fb72 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:26.888182 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a892dc-d376-4a9e-9fc3-d4d6d3e2fb72 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:26.888308 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a892dc-d376-4a9e-9fc3-d4d6d3e2fb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:26.926952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-fd76dde5-397f-498e-be52-c641aa490606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb04f96fce744740add41265d74df191', 'request_id': 'req-fd76dde5-397f-498e-be52-c641aa490606'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:26.931458 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-11a892dc-d376-4a9e-9fc3-d4d6d3e2fb72 None None] MFA Rules not processed for user `c46c5f66b1394d4f93c45bd0c2ce5113`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:26.933415 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-11a892dc-d376-4a9e-9fc3-d4d6d3e2fb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:26.941148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-fd76dde5-397f-498e-be52-c641aa490606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb04f96fce744740add41265d74df191', 'request_id': 'req-fd76dde5-397f-498e-be52-c641aa490606'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:26.952425 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-fd76dde5-397f-498e-be52-c641aa490606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb04f96fce744740add41265d74df191', 'request_id': 'req-fd76dde5-397f-498e-be52-c641aa490606'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:26.971736 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-fd76dde5-397f-498e-be52-c641aa490606 admin admin] The token cache is being invalidate because project bb04f96fce744740add41265d74df191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:15:26.972015 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-fd76dde5-397f-498e-be52-c641aa490606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:26.972964 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-fd76dde5-397f-498e-be52-c641aa490606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:26.973386 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:26.979862 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1252/2506] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:15:26 2022] DELETE /identity/v3/projects/bb04f96fce744740add41265d74df191 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:15:26.982083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76dde5-397f-498e-be52-c641aa490606 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:26.983798 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-fd76dde5-397f-498e-be52-c641aa490606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:27.022446 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1255/2507] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:26 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:27.034829 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a892dc-d376-4a9e-9fc3-d4d6d3e2fb72 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:27.036472 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-11a892dc-d376-4a9e-9fc3-d4d6d3e2fb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:27.063703 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76dde5-397f-498e-be52-c641aa490606 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:27.069495 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0210dd3-0190-49be-823f-4a79b4c1fa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:27.070313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0210dd3-0190-49be-823f-4a79b4c1fa09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:27.070615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0210dd3-0190-49be-823f-4a79b4c1fa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:27.070902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0210dd3-0190-49be-823f-4a79b4c1fa09 admin admin] PATH_INFO: `/v3/users/a00c276735bc4150affc32c780633fe0` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:27.072189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0210dd3-0190-49be-823f-4a79b4c1fa09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a00c276735bc4150affc32c780633fe0)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:27.075046 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0210dd3-0190-49be-823f-4a79b4c1fa09 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:27.104364 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a892dc-d376-4a9e-9fc3-d4d6d3e2fb72 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:27.107620 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=84,keystone:INSERT=5,keystone:DELETE=11 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:27.109417 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbf9a9-dbe6-4944-8ba7-ec7815470acf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:27.110582 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbf9a9-dbe6-4944-8ba7-ec7815470acf service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:27.111072 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbf9a9-dbe6-4944-8ba7-ec7815470acf service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:27.111514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbf9a9-dbe6-4944-8ba7-ec7815470acf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:27.125243 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbf9a9-dbe6-4944-8ba7-ec7815470acf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:27.127026 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbf9a9-dbe6-4944-8ba7-ec7815470acf service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:27.132101 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d0210dd3-0190-49be-823f-4a79b4c1fa09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a00c276735bc4150affc32c780633fe0'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:27.138599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1256/2508] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:27 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:15:27.141937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d0210dd3-0190-49be-823f-4a79b4c1fa09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a00c276735bc4150affc32c780633fe0'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:27.152521 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d0210dd3-0190-49be-823f-4a79b4c1fa09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a00c276735bc4150affc32c780633fe0'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:27.168925 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d0210dd3-0190-49be-823f-4a79b4c1fa09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a00c276735bc4150affc32c780633fe0'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:27.169823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d0210dd3-0190-49be-823f-4a79b4c1fa09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a00c276735bc4150affc32c780633fe0'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:27.181811 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1253/2509] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:15:26 2022] DELETE /identity/v3/users/a00c276735bc4150affc32c780633fe0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:15:27.227571 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbf9a9-dbe6-4944-8ba7-ec7815470acf service cinder] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:27.238149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbf9a9-dbe6-4944-8ba7-ec7815470acf service cinder] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:27.300426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098d466-6d70-4f11-97ac-26ed2a8e01ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:27.301081 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098d466-6d70-4f11-97ac-26ed2a8e01ec service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:27.301371 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098d466-6d70-4f11-97ac-26ed2a8e01ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:27.301653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098d466-6d70-4f11-97ac-26ed2a8e01ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:27.304172 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b098d466-6d70-4f11-97ac-26ed2a8e01ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:27.378084 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098d466-6d70-4f11-97ac-26ed2a8e01ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:27.379597 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098d466-6d70-4f11-97ac-26ed2a8e01ec service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:27.391293 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1257/2510] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:27 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:15:27.577871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0210dd3-0190-49be-823f-4a79b4c1fa09 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:27.579392 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d0210dd3-0190-49be-823f-4a79b4c1fa09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:27.707077 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0210dd3-0190-49be-823f-4a79b4c1fa09 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:27.712358 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87a977-ba3f-498b-90db-de84ff5472f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:27.713392 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87a977-ba3f-498b-90db-de84ff5472f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:27.713965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87a977-ba3f-498b-90db-de84ff5472f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:27.714319 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87a977-ba3f-498b-90db-de84ff5472f4 admin admin] PATH_INFO: `/v3/projects/6e5018405aa4491ea136a30fba963991` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:27.715829 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87a977-ba3f-498b-90db-de84ff5472f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e5018405aa4491ea136a30fba963991)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:27.717913 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87a977-ba3f-498b-90db-de84ff5472f4 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:27.787558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1f87a977-ba3f-498b-90db-de84ff5472f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e5018405aa4491ea136a30fba963991', 'request_id': 'req-1f87a977-ba3f-498b-90db-de84ff5472f4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:27.796906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1f87a977-ba3f-498b-90db-de84ff5472f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e5018405aa4491ea136a30fba963991', 'request_id': 'req-1f87a977-ba3f-498b-90db-de84ff5472f4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:27.822423 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1f87a977-ba3f-498b-90db-de84ff5472f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e5018405aa4491ea136a30fba963991', 'request_id': 'req-1f87a977-ba3f-498b-90db-de84ff5472f4'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:27.842318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1f87a977-ba3f-498b-90db-de84ff5472f4 admin admin] The token cache is being invalidate because project 6e5018405aa4491ea136a30fba963991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:15:27.842928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1f87a977-ba3f-498b-90db-de84ff5472f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:27.843825 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1f87a977-ba3f-498b-90db-de84ff5472f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:27.850348 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1254/2511] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:15:27 2022] DELETE /identity/v3/projects/6e5018405aa4491ea136a30fba963991 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:27.851655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c076c8-8a57-4f53-85aa-dd2a8fa04e21 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:27.852149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c076c8-8a57-4f53-85aa-dd2a8fa04e21 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:27.852234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c076c8-8a57-4f53-85aa-dd2a8fa04e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:27.882464 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-f0c076c8-8a57-4f53-85aa-dd2a8fa04e21 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:27.885294 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-f0c076c8-8a57-4f53-85aa-dd2a8fa04e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:27.918965 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:27.978478 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1258/2512] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:15:27.987406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c69c25-0471-4858-bda5-d5df455c5d35 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:27.987696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c69c25-0471-4858-bda5-d5df455c5d35 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:27.987975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c69c25-0471-4858-bda5-d5df455c5d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:28.008965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-57c69c25-0471-4858-bda5-d5df455c5d35 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:28.010175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-57c69c25-0471-4858-bda5-d5df455c5d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:28.022728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1255/2513] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:28.026863 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c076c8-8a57-4f53-85aa-dd2a8fa04e21 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:28.043264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c076c8-8a57-4f53-85aa-dd2a8fa04e21 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:28.048438 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7e4ce-c47d-4c54-9e08-5c85f36ef316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:28.049188 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7e4ce-c47d-4c54-9e08-5c85f36ef316 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:28.049476 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7e4ce-c47d-4c54-9e08-5c85f36ef316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:28.049759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7e4ce-c47d-4c54-9e08-5c85f36ef316 admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:28.050518 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7e4ce-c47d-4c54-9e08-5c85f36ef316 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:15:28.050861 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7e4ce-c47d-4c54-9e08-5c85f36ef316 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:28.052507 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7e4ce-c47d-4c54-9e08-5c85f36ef316 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:28.068384 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1259/2514] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:15:28.069827 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c69c25-0471-4858-bda5-d5df455c5d35 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:28.079122 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c69c25-0471-4858-bda5-d5df455c5d35 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:28.084008 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81dacf-575a-426f-892d-aa995e917704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:28.084688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81dacf-575a-426f-892d-aa995e917704 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:28.084957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81dacf-575a-426f-892d-aa995e917704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:28.085235 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81dacf-575a-426f-892d-aa995e917704 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:28.085921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81dacf-575a-426f-892d-aa995e917704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:28.087845 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81dacf-575a-426f-892d-aa995e917704 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:28.114847 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1256/2515] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:15:28 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:28.119192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7e4ce-c47d-4c54-9e08-5c85f36ef316 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:28.129269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7e4ce-c47d-4c54-9e08-5c85f36ef316 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:28.195378 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da075f-74a5-4a5d-94bd-5ec428fcda2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:28.196124 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da075f-74a5-4a5d-94bd-5ec428fcda2f admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:28.196467 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da075f-74a5-4a5d-94bd-5ec428fcda2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:28.196772 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da075f-74a5-4a5d-94bd-5ec428fcda2f admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:28.197542 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da075f-74a5-4a5d-94bd-5ec428fcda2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:28.200197 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da075f-74a5-4a5d-94bd-5ec428fcda2f admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:28.222011 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1260/2516] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:15:28 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:15:28.226033 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81dacf-575a-426f-892d-aa995e917704 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:28.232909 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:28.237228 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81dacf-575a-426f-892d-aa995e917704 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:28.244818 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b9a68-2a12-4830-9356-e94455c824dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:28.246269 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9a68-2a12-4830-9356-e94455c824dc admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:28.246802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9a68-2a12-4830-9356-e94455c824dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:28.247084 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9a68-2a12-4830-9356-e94455c824dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:28.247873 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b9a68-2a12-4830-9356-e94455c824dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:28.249950 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b9a68-2a12-4830-9356-e94455c824dc admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:28.261894 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1257/2517] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:28.265964 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da075f-74a5-4a5d-94bd-5ec428fcda2f admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:28.275978 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da075f-74a5-4a5d-94bd-5ec428fcda2f admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:28.281291 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1eedd-1dd1-4f65-85ad-a4eaade56662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:28.281954 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1eedd-1dd1-4f65-85ad-a4eaade56662 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:28.282239 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1eedd-1dd1-4f65-85ad-a4eaade56662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:28.282552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1eedd-1dd1-4f65-85ad-a4eaade56662 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:28.283292 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1eedd-1dd1-4f65-85ad-a4eaade56662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:28.284895 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1eedd-1dd1-4f65-85ad-a4eaade56662 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:28.295747 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1261/2518] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:28.299780 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b9a68-2a12-4830-9356-e94455c824dc admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:28.310606 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b9a68-2a12-4830-9356-e94455c824dc admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:28.315548 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85ab7a-62f3-40f9-b7a1-291c3b7466fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:28.316466 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85ab7a-62f3-40f9-b7a1-291c3b7466fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:28.316775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85ab7a-62f3-40f9-b7a1-291c3b7466fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:28.317050 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85ab7a-62f3-40f9-b7a1-291c3b7466fc admin admin] PATH_INFO: `/v3/projects/10d5a5bbb49f41f690794f86408c0a1f/users/eea1d44140ca435d9498af55fc980ade/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:28.333964 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85ab7a-62f3-40f9-b7a1-291c3b7466fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d5a5bbb49f41f690794f86408c0a1f, user_id=eea1d44140ca435d9498af55fc980ade, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:28.336672 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85ab7a-62f3-40f9-b7a1-291c3b7466fc admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:28.352392 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1258/2519] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:28 2022] PUT /identity/v3/projects/10d5a5bbb49f41f690794f86408c0a1f/users/eea1d44140ca435d9498af55fc980ade/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:28.365094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdac4c8-af6e-48be-a6ac-334067f283b3 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:28.365390 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdac4c8-af6e-48be-a6ac-334067f283b3 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:28.365677 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdac4c8-af6e-48be-a6ac-334067f283b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:28.410175 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-1bdac4c8-af6e-48be-a6ac-334067f283b3 None None] MFA Rules not processed for user `eea1d44140ca435d9498af55fc980ade`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:28.411799 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-1bdac4c8-af6e-48be-a6ac-334067f283b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:28.497939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1262/2520] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:28.502801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85ab7a-62f3-40f9-b7a1-291c3b7466fc admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:28.574000 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85ab7a-62f3-40f9-b7a1-291c3b7466fc admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:28.579737 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d78c8-9283-420d-a1ec-7c3cc949b521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:28.580410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d78c8-9283-420d-a1ec-7c3cc949b521 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:28.580720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d78c8-9283-420d-a1ec-7c3cc949b521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:28.580994 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d78c8-9283-420d-a1ec-7c3cc949b521 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:28.581688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d78c8-9283-420d-a1ec-7c3cc949b521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:28.583676 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d78c8-9283-420d-a1ec-7c3cc949b521 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:28.609771 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1259/2521] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:15:28 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:15:28.613957 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdac4c8-af6e-48be-a6ac-334067f283b3 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:28.626368 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdac4c8-af6e-48be-a6ac-334067f283b3 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:28.644439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:28.722393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acd122-9151-430a-bd02-dd3b4425b484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:28.723198 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acd122-9151-430a-bd02-dd3b4425b484 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:28.723537 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acd122-9151-430a-bd02-dd3b4425b484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:28.723884 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acd122-9151-430a-bd02-dd3b4425b484 admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:28.724653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83acd122-9151-430a-bd02-dd3b4425b484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:28.726690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83acd122-9151-430a-bd02-dd3b4425b484 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:28.758362 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1263/2522] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:15:28 2022] POST /identity/v3/users => generated 299 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:28.763060 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d78c8-9283-420d-a1ec-7c3cc949b521 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:28.785107 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d78c8-9283-420d-a1ec-7c3cc949b521 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:28.803852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813926e-4c15-42eb-9077-ecc81d3e9085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:28.804567 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813926e-4c15-42eb-9077-ecc81d3e9085 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:28.804852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813926e-4c15-42eb-9077-ecc81d3e9085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:28.805287 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813926e-4c15-42eb-9077-ecc81d3e9085 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:28.810070 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813926e-4c15-42eb-9077-ecc81d3e9085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:28.811815 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813926e-4c15-42eb-9077-ecc81d3e9085 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:28.829927 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1260/2523] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:15:28.830941 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acd122-9151-430a-bd02-dd3b4425b484 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:28.843748 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acd122-9151-430a-bd02-dd3b4425b484 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:28.850579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db9f1b-a635-43ad-8b31-11b34cf5c4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:28.851593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db9f1b-a635-43ad-8b31-11b34cf5c4c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:28.851948 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db9f1b-a635-43ad-8b31-11b34cf5c4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:28.852470 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db9f1b-a635-43ad-8b31-11b34cf5c4c6 admin admin] PATH_INFO: `/v3/projects/b22c99935cb74c378d67841271deeb99/users/3a2f3802db274720861fb46383e916b1/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:28.873680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db9f1b-a635-43ad-8b31-11b34cf5c4c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b22c99935cb74c378d67841271deeb99, user_id=3a2f3802db274720861fb46383e916b1, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:28.879337 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db9f1b-a635-43ad-8b31-11b34cf5c4c6 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:28.894546 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1264/2524] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:28 2022] PUT /identity/v3/projects/b22c99935cb74c378d67841271deeb99/users/3a2f3802db274720861fb46383e916b1/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:28.897539 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813926e-4c15-42eb-9077-ecc81d3e9085 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:28.914227 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813926e-4c15-42eb-9077-ecc81d3e9085 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:29.031377 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19ec4e-b98e-4206-90f5-72e9bc60539e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:29.032299 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19ec4e-b98e-4206-90f5-72e9bc60539e admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:29.032892 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19ec4e-b98e-4206-90f5-72e9bc60539e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:29.033346 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19ec4e-b98e-4206-90f5-72e9bc60539e admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:29.034417 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19ec4e-b98e-4206-90f5-72e9bc60539e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:29.036334 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19ec4e-b98e-4206-90f5-72e9bc60539e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:29.062665 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1261/2525] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:29.065951 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db9f1b-a635-43ad-8b31-11b34cf5c4c6 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:29.096066 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db9f1b-a635-43ad-8b31-11b34cf5c4c6 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:29.117761 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6dbeb4-bd17-4437-8462-055e25a1b7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:29.120726 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6dbeb4-bd17-4437-8462-055e25a1b7a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:29.121093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6dbeb4-bd17-4437-8462-055e25a1b7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:29.121369 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6dbeb4-bd17-4437-8462-055e25a1b7a7 admin admin] PATH_INFO: `/v3/projects/b22c99935cb74c378d67841271deeb99/users/3a2f3802db274720861fb46383e916b1/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:29.124546 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6dbeb4-bd17-4437-8462-055e25a1b7a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b22c99935cb74c378d67841271deeb99, user_id=3a2f3802db274720861fb46383e916b1, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:29.129012 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6dbeb4-bd17-4437-8462-055e25a1b7a7 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:29.166577 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1265/2526] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:29 2022] PUT /identity/v3/projects/b22c99935cb74c378d67841271deeb99/users/3a2f3802db274720861fb46383e916b1/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:29.175229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0c478-0b64-40c8-b7e5-5cbc7559a144 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:29.175558 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0c478-0b64-40c8-b7e5-5cbc7559a144 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:29.175852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0c478-0b64-40c8-b7e5-5cbc7559a144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:29.224685 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e9b0c478-0b64-40c8-b7e5-5cbc7559a144 None None] MFA Rules not processed for user `3a2f3802db274720861fb46383e916b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:29.226121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e9b0c478-0b64-40c8-b7e5-5cbc7559a144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:29.301569 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:29.381343 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6dbeb4-bd17-4437-8462-055e25a1b7a7 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:29.383268 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-2a6dbeb4-bd17-4437-8462-055e25a1b7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:29.393210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1262/2527] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:29.408303 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0c478-0b64-40c8-b7e5-5cbc7559a144 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:29.410243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e9b0c478-0b64-40c8-b7e5-5cbc7559a144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:29.471753 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6dbeb4-bd17-4437-8462-055e25a1b7a7 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:29.481677 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915147b-1159-4b96-8c76-dbcf5480a83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:29.482604 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915147b-1159-4b96-8c76-dbcf5480a83e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:29.482906 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915147b-1159-4b96-8c76-dbcf5480a83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:29.483179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915147b-1159-4b96-8c76-dbcf5480a83e admin admin] PATH_INFO: `/v3/users/651c540ef39e4c3ea316025e55b0208a` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:29.484439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915147b-1159-4b96-8c76-dbcf5480a83e admin admin] RBAC: Authorizing `identity:delete_user(user_id=651c540ef39e4c3ea316025e55b0208a)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:29.484671 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0c478-0b64-40c8-b7e5-5cbc7559a144 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:29.486433 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915147b-1159-4b96-8c76-dbcf5480a83e admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:29.488324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29326ce-46b0-4f4f-af59-9bd9e7ea2f70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:29.488976 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29326ce-46b0-4f4f-af59-9bd9e7ea2f70 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:29.489259 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29326ce-46b0-4f4f-af59-9bd9e7ea2f70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:29.489541 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29326ce-46b0-4f4f-af59-9bd9e7ea2f70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:29.543360 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-3915147b-1159-4b96-8c76-dbcf5480a83e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '651c540ef39e4c3ea316025e55b0208a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:29.552626 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-3915147b-1159-4b96-8c76-dbcf5480a83e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '651c540ef39e4c3ea316025e55b0208a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:29.553490 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-3915147b-1159-4b96-8c76-dbcf5480a83e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '651c540ef39e4c3ea316025e55b0208a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:29.557653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29326ce-46b0-4f4f-af59-9bd9e7ea2f70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:29.560226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29326ce-46b0-4f4f-af59-9bd9e7ea2f70 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:29.569298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-3915147b-1159-4b96-8c76-dbcf5480a83e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '651c540ef39e4c3ea316025e55b0208a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:29.570030 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1263/2528] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:15:29.570201 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-3915147b-1159-4b96-8c76-dbcf5480a83e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '651c540ef39e4c3ea316025e55b0208a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:29.571609 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:29.592698 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1266/2529] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:15:29 2022] DELETE /identity/v3/users/651c540ef39e4c3ea316025e55b0208a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:15:29.770778 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29326ce-46b0-4f4f-af59-9bd9e7ea2f70 service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:29.783546 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29326ce-46b0-4f4f-af59-9bd9e7ea2f70 service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:29.853148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5a243-92eb-4974-b49e-2bfdce900587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:29.854035 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5a243-92eb-4974-b49e-2bfdce900587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:29.854353 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5a243-92eb-4974-b49e-2bfdce900587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:29.855969 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5a243-92eb-4974-b49e-2bfdce900587 admin admin] PATH_INFO: `/v3/projects/3944df204ddb46cda58e3edbbb8237d1` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:29.859254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5a243-92eb-4974-b49e-2bfdce900587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3944df204ddb46cda58e3edbbb8237d1)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:29.861178 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5a243-92eb-4974-b49e-2bfdce900587 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:29.886065 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:29.914837 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-65b5a243-92eb-4974-b49e-2bfdce900587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3944df204ddb46cda58e3edbbb8237d1', 'request_id': 'req-65b5a243-92eb-4974-b49e-2bfdce900587'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:29.921243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-65b5a243-92eb-4974-b49e-2bfdce900587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3944df204ddb46cda58e3edbbb8237d1', 'request_id': 'req-65b5a243-92eb-4974-b49e-2bfdce900587'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:29.927783 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-65b5a243-92eb-4974-b49e-2bfdce900587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3944df204ddb46cda58e3edbbb8237d1', 'request_id': 'req-65b5a243-92eb-4974-b49e-2bfdce900587'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:29.942964 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-65b5a243-92eb-4974-b49e-2bfdce900587 admin admin] The token cache is being invalidate because project 3944df204ddb46cda58e3edbbb8237d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:15:29.943327 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-65b5a243-92eb-4974-b49e-2bfdce900587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:29.944118 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-65b5a243-92eb-4974-b49e-2bfdce900587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:29.946071 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1264/2530] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:15:29 2022] DELETE /identity/v3/projects/3944df204ddb46cda58e3edbbb8237d1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:29.951533 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e05656-490c-4c32-b318-ff110c7f1594 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:29.952033 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e05656-490c-4c32-b318-ff110c7f1594 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:29.952141 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e05656-490c-4c32-b318-ff110c7f1594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:29.972169 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-26e05656-490c-4c32-b318-ff110c7f1594 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:29.973392 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-26e05656-490c-4c32-b318-ff110c7f1594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:30.035830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1267/2531] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:30.045943 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c9c24-5f67-4d64-8840-60abfe34c423 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:30.046282 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c9c24-5f67-4d64-8840-60abfe34c423 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:30.046645 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c9c24-5f67-4d64-8840-60abfe34c423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:30.065726 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3e3c9c24-5f67-4d64-8840-60abfe34c423 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:30.066971 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3e3c9c24-5f67-4d64-8840-60abfe34c423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:30.075412 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1265/2532] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:30.079651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e05656-490c-4c32-b318-ff110c7f1594 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:30.089673 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e05656-490c-4c32-b318-ff110c7f1594 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:30.094461 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2ddc7-d76d-43af-bc6f-cecebe6a3be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:30.095138 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2ddc7-d76d-43af-bc6f-cecebe6a3be7 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:30.095422 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2ddc7-d76d-43af-bc6f-cecebe6a3be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:30.095701 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2ddc7-d76d-43af-bc6f-cecebe6a3be7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:30.096442 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2ddc7-d76d-43af-bc6f-cecebe6a3be7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:15:30.096751 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2ddc7-d76d-43af-bc6f-cecebe6a3be7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:30.098341 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2ddc7-d76d-43af-bc6f-cecebe6a3be7 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:30.109975 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1268/2533] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:15:30.114213 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c9c24-5f67-4d64-8840-60abfe34c423 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:30.123935 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c9c24-5f67-4d64-8840-60abfe34c423 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:30.128591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb366e5-6bd9-4171-a0b3-955f63734aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:30.129174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb366e5-6bd9-4171-a0b3-955f63734aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:30.129464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb366e5-6bd9-4171-a0b3-955f63734aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:30.129736 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb366e5-6bd9-4171-a0b3-955f63734aa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:30.130415 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb366e5-6bd9-4171-a0b3-955f63734aa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:30.132324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb366e5-6bd9-4171-a0b3-955f63734aa7 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:30.159343 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1266/2534] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:15:30 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:30.163380 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2ddc7-d76d-43af-bc6f-cecebe6a3be7 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:30.173502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2ddc7-d76d-43af-bc6f-cecebe6a3be7 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:30.228691 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9c612-2ace-488c-8e89-d6b8f30788e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:30.229405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9c612-2ace-488c-8e89-d6b8f30788e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:30.229691 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9c612-2ace-488c-8e89-d6b8f30788e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:30.229970 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9c612-2ace-488c-8e89-d6b8f30788e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:30.230711 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9c612-2ace-488c-8e89-d6b8f30788e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:30.232657 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9c612-2ace-488c-8e89-d6b8f30788e3 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:30.253502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1269/2535] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:15:30 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:30.257761 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb366e5-6bd9-4171-a0b3-955f63734aa7 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:30.268502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb366e5-6bd9-4171-a0b3-955f63734aa7 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:30.273034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587eedb-fee0-450b-8c47-9acc9046418f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:30.273680 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587eedb-fee0-450b-8c47-9acc9046418f admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:30.273961 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587eedb-fee0-450b-8c47-9acc9046418f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:30.274234 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587eedb-fee0-450b-8c47-9acc9046418f admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:30.274995 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587eedb-fee0-450b-8c47-9acc9046418f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:30.276597 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587eedb-fee0-450b-8c47-9acc9046418f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:30.286807 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1267/2536] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:30.290982 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9c612-2ace-488c-8e89-d6b8f30788e3 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:30.300981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9c612-2ace-488c-8e89-d6b8f30788e3 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:30.305548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e081b-4137-41ca-9e1e-0891b9a6123e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:30.306202 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e081b-4137-41ca-9e1e-0891b9a6123e admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:30.306485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e081b-4137-41ca-9e1e-0891b9a6123e admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:30.306791 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e081b-4137-41ca-9e1e-0891b9a6123e admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:30.308013 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e081b-4137-41ca-9e1e-0891b9a6123e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:30.309604 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e081b-4137-41ca-9e1e-0891b9a6123e admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:30.319396 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1270/2537] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:30.323936 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587eedb-fee0-450b-8c47-9acc9046418f admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:30.333721 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587eedb-fee0-450b-8c47-9acc9046418f admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:30.338550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950ebe0-b144-469a-90be-2c8b878cd618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:30.339640 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950ebe0-b144-469a-90be-2c8b878cd618 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:30.339782 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950ebe0-b144-469a-90be-2c8b878cd618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:30.340055 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950ebe0-b144-469a-90be-2c8b878cd618 admin admin] PATH_INFO: `/v3/projects/d53b63a21e5244ac8598c40a505d88b6/users/148458f8718c417d9de23fb4c107ec15/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:30.354633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950ebe0-b144-469a-90be-2c8b878cd618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d53b63a21e5244ac8598c40a505d88b6, user_id=148458f8718c417d9de23fb4c107ec15, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:30.357248 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950ebe0-b144-469a-90be-2c8b878cd618 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:30.371122 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1268/2538] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:30 2022] PUT /identity/v3/projects/d53b63a21e5244ac8598c40a505d88b6/users/148458f8718c417d9de23fb4c107ec15/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:15:30.381264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09825d-258f-4c53-bfa3-7e5282c16d29 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:30.381495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09825d-258f-4c53-bfa3-7e5282c16d29 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:30.381894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09825d-258f-4c53-bfa3-7e5282c16d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:30.410886 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-ec09825d-258f-4c53-bfa3-7e5282c16d29 None None] MFA Rules not processed for user `148458f8718c417d9de23fb4c107ec15`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:30.412219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ec09825d-258f-4c53-bfa3-7e5282c16d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:30.460425 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:30.486812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1271/2539] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:30.498816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950ebe0-b144-469a-90be-2c8b878cd618 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:30.500735 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5950ebe0-b144-469a-90be-2c8b878cd618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:30.585564 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950ebe0-b144-469a-90be-2c8b878cd618 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:30.591285 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceef5ed-edd3-4450-b9f3-e2746a222557 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:30.591938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceef5ed-edd3-4450-b9f3-e2746a222557 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:30.592225 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceef5ed-edd3-4450-b9f3-e2746a222557 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:30.592507 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceef5ed-edd3-4450-b9f3-e2746a222557 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:30.600515 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceef5ed-edd3-4450-b9f3-e2746a222557 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:30.602115 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceef5ed-edd3-4450-b9f3-e2746a222557 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:30.611553 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1269/2540] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:15:32.589986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09825d-258f-4c53-bfa3-7e5282c16d29 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:32.591336 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ec09825d-258f-4c53-bfa3-7e5282c16d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:32.661160 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09825d-258f-4c53-bfa3-7e5282c16d29 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:32.667994 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f9395-d46c-49ac-a131-ebe8691bb01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:32.668720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f9395-d46c-49ac-a131-ebe8691bb01e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:32.669001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f9395-d46c-49ac-a131-ebe8691bb01e admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:32.669278 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f9395-d46c-49ac-a131-ebe8691bb01e admin admin] PATH_INFO: `/v3/users/b2822a3c3a664fb3a0b33678e1aec785` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:32.670470 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f9395-d46c-49ac-a131-ebe8691bb01e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2822a3c3a664fb3a0b33678e1aec785)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:32.672421 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f9395-d46c-49ac-a131-ebe8691bb01e admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:32.724695 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9f4f9395-d46c-49ac-a131-ebe8691bb01e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2822a3c3a664fb3a0b33678e1aec785'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:32.748121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9f4f9395-d46c-49ac-a131-ebe8691bb01e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2822a3c3a664fb3a0b33678e1aec785'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:32.749522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9f4f9395-d46c-49ac-a131-ebe8691bb01e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2822a3c3a664fb3a0b33678e1aec785'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:32.763550 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9f4f9395-d46c-49ac-a131-ebe8691bb01e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2822a3c3a664fb3a0b33678e1aec785'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:32.764262 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9f4f9395-d46c-49ac-a131-ebe8691bb01e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2822a3c3a664fb3a0b33678e1aec785'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:32.778297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1272/2541] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:15:32 2022] DELETE /identity/v3/users/b2822a3c3a664fb3a0b33678e1aec785 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:32.783204 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b40156-4f71-42ea-ab15-720c5777f232 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:32.783741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b40156-4f71-42ea-ab15-720c5777f232 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:32.783741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b40156-4f71-42ea-ab15-720c5777f232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:32.802187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-82b40156-4f71-42ea-ab15-720c5777f232 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:32.803476 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-82b40156-4f71-42ea-ab15-720c5777f232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:32.831196 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:32.872349 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1270/2542] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:32.882147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f9395-d46c-49ac-a131-ebe8691bb01e admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:32.883833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-9f4f9395-d46c-49ac-a131-ebe8691bb01e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:32.946400 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f9395-d46c-49ac-a131-ebe8691bb01e admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:32.950062 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4071f84-7a1e-4447-a847-76c2adf9b8e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:32.950742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4071f84-7a1e-4447-a847-76c2adf9b8e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:32.951025 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4071f84-7a1e-4447-a847-76c2adf9b8e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:32.951299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4071f84-7a1e-4447-a847-76c2adf9b8e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:32.960556 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4071f84-7a1e-4447-a847-76c2adf9b8e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:32.961989 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4071f84-7a1e-4447-a847-76c2adf9b8e4 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:32.971970 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1273/2543] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:15:33.238905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b40156-4f71-42ea-ab15-720c5777f232 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:33.240557 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-82b40156-4f71-42ea-ab15-720c5777f232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:33.257259 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b40156-4f71-42ea-ab15-720c5777f232 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:33.262609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effadf40-d030-4555-972b-8896c1b823ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:33.263474 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effadf40-d030-4555-972b-8896c1b823ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:33.263767 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effadf40-d030-4555-972b-8896c1b823ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:33.264039 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effadf40-d030-4555-972b-8896c1b823ef admin admin] PATH_INFO: `/v3/projects/3d7da03608de4b6dba832c99a00d9b9b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:33.265275 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effadf40-d030-4555-972b-8896c1b823ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d7da03608de4b6dba832c99a00d9b9b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:33.267139 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effadf40-d030-4555-972b-8896c1b823ef admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:33.317122 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-effadf40-d030-4555-972b-8896c1b823ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d7da03608de4b6dba832c99a00d9b9b', 'request_id': 'req-effadf40-d030-4555-972b-8896c1b823ef'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:33.323399 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-effadf40-d030-4555-972b-8896c1b823ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d7da03608de4b6dba832c99a00d9b9b', 'request_id': 'req-effadf40-d030-4555-972b-8896c1b823ef'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:33.328940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-effadf40-d030-4555-972b-8896c1b823ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d7da03608de4b6dba832c99a00d9b9b', 'request_id': 'req-effadf40-d030-4555-972b-8896c1b823ef'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:33.342171 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-effadf40-d030-4555-972b-8896c1b823ef admin admin] The token cache is being invalidate because project 3d7da03608de4b6dba832c99a00d9b9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:15:33.342481 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-effadf40-d030-4555-972b-8896c1b823ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:33.343144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-effadf40-d030-4555-972b-8896c1b823ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:33.344688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1271/2544] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:15:33 2022] DELETE /identity/v3/projects/3d7da03608de4b6dba832c99a00d9b9b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:33.349250 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4071f84-7a1e-4447-a847-76c2adf9b8e4 service neutron] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:33.360083 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4071f84-7a1e-4447-a847-76c2adf9b8e4 service neutron] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:33.363979 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:33.419717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7917f-b780-4fc9-85df-c01a9daee8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:33.420582 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7917f-b780-4fc9-85df-c01a9daee8e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:33.420861 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7917f-b780-4fc9-85df-c01a9daee8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:33.421135 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7917f-b780-4fc9-85df-c01a9daee8e9 admin admin] PATH_INFO: `/v3/users/c46c5f66b1394d4f93c45bd0c2ce5113` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:33.422333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7917f-b780-4fc9-85df-c01a9daee8e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c46c5f66b1394d4f93c45bd0c2ce5113)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:33.424293 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7917f-b780-4fc9-85df-c01a9daee8e9 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:33.473643 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e6b7917f-b780-4fc9-85df-c01a9daee8e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c46c5f66b1394d4f93c45bd0c2ce5113'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:33.481483 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e6b7917f-b780-4fc9-85df-c01a9daee8e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c46c5f66b1394d4f93c45bd0c2ce5113'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:33.482228 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e6b7917f-b780-4fc9-85df-c01a9daee8e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c46c5f66b1394d4f93c45bd0c2ce5113'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:33.495985 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e6b7917f-b780-4fc9-85df-c01a9daee8e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c46c5f66b1394d4f93c45bd0c2ce5113'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:33.496693 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e6b7917f-b780-4fc9-85df-c01a9daee8e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c46c5f66b1394d4f93c45bd0c2ce5113'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:33.509539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1274/2545] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:15:33 2022] DELETE /identity/v3/users/c46c5f66b1394d4f93c45bd0c2ce5113 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:33.795938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effadf40-d030-4555-972b-8896c1b823ef admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:33.797409 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-effadf40-d030-4555-972b-8896c1b823ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:33.812953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effadf40-d030-4555-972b-8896c1b823ef admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:33.870277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7917f-b780-4fc9-85df-c01a9daee8e9 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:33.871699 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e6b7917f-b780-4fc9-85df-c01a9daee8e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:33.874619 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be5176-1129-4586-bfe6-d2a71ba732fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:33.875513 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be5176-1129-4586-bfe6-d2a71ba732fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:33.875799 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be5176-1129-4586-bfe6-d2a71ba732fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:33.876077 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be5176-1129-4586-bfe6-d2a71ba732fc admin admin] PATH_INFO: `/v3/projects/ef855ab8496d45c3a3117d4f70244332` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:33.877258 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be5176-1129-4586-bfe6-d2a71ba732fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef855ab8496d45c3a3117d4f70244332)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:33.879236 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be5176-1129-4586-bfe6-d2a71ba732fc admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:33.926102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-96be5176-1129-4586-bfe6-d2a71ba732fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef855ab8496d45c3a3117d4f70244332', 'request_id': 'req-96be5176-1129-4586-bfe6-d2a71ba732fc'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:33.931833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7917f-b780-4fc9-85df-c01a9daee8e9 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:33.932880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-96be5176-1129-4586-bfe6-d2a71ba732fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef855ab8496d45c3a3117d4f70244332', 'request_id': 'req-96be5176-1129-4586-bfe6-d2a71ba732fc'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:33.935107 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:33.939627 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-96be5176-1129-4586-bfe6-d2a71ba732fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef855ab8496d45c3a3117d4f70244332', 'request_id': 'req-96be5176-1129-4586-bfe6-d2a71ba732fc'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:33.955648 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-96be5176-1129-4586-bfe6-d2a71ba732fc admin admin] The token cache is being invalidate because project ef855ab8496d45c3a3117d4f70244332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:15:33.955939 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-96be5176-1129-4586-bfe6-d2a71ba732fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:33.956550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-96be5176-1129-4586-bfe6-d2a71ba732fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:33.958097 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1272/2546] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:15:33 2022] DELETE /identity/v3/projects/ef855ab8496d45c3a3117d4f70244332 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:33.962894 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd88011-6950-49b1-bd88-caa5174b8520 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:33.963171 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd88011-6950-49b1-bd88-caa5174b8520 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:33.963477 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd88011-6950-49b1-bd88-caa5174b8520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:33.974320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:33.982281 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-0fd88011-6950-49b1-bd88-caa5174b8520 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:33.983523 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0fd88011-6950-49b1-bd88-caa5174b8520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:33.985018 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660a1bd-b150-47f6-8980-97266b5b0e24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:33.985823 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660a1bd-b150-47f6-8980-97266b5b0e24 service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:33.986107 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660a1bd-b150-47f6-8980-97266b5b0e24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:33.986385 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660a1bd-b150-47f6-8980-97266b5b0e24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:33.988291 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-4660a1bd-b150-47f6-8980-97266b5b0e24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:34.042351 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1273/2547] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:15:34.051706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a286052-7042-41bd-81c9-d49a26cff57d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:34.052013 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a286052-7042-41bd-81c9-d49a26cff57d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:34.052322 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a286052-7042-41bd-81c9-d49a26cff57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:34.052671 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660a1bd-b150-47f6-8980-97266b5b0e24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:34.054134 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660a1bd-b150-47f6-8980-97266b5b0e24 service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:34.064887 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1275/2548] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:15:34.071469 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-5a286052-7042-41bd-81c9-d49a26cff57d None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:34.072316 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5a286052-7042-41bd-81c9-d49a26cff57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:34.086508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1274/2549] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:15:34.087832 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660a1bd-b150-47f6-8980-97266b5b0e24 service cinder] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:34.100249 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660a1bd-b150-47f6-8980-97266b5b0e24 service cinder] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:34.105546 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c13473-4e82-4303-a6cf-5b6109f9421e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:34.106315 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c13473-4e82-4303-a6cf-5b6109f9421e admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:34.106766 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c13473-4e82-4303-a6cf-5b6109f9421e admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:34.107227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c13473-4e82-4303-a6cf-5b6109f9421e admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:34.108849 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c13473-4e82-4303-a6cf-5b6109f9421e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:15:34.109059 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c13473-4e82-4303-a6cf-5b6109f9421e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:34.111086 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c13473-4e82-4303-a6cf-5b6109f9421e admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:34.124363 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1276/2550] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:15:34.129345 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a286052-7042-41bd-81c9-d49a26cff57d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:34.140321 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a286052-7042-41bd-81c9-d49a26cff57d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:34.145038 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6c21b-ada5-4bf9-858d-9c8c85cdb940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:34.145882 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6c21b-ada5-4bf9-858d-9c8c85cdb940 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:34.145882 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6c21b-ada5-4bf9-858d-9c8c85cdb940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:34.146201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6c21b-ada5-4bf9-858d-9c8c85cdb940 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:34.146859 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6c21b-ada5-4bf9-858d-9c8c85cdb940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:34.149019 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6c21b-ada5-4bf9-858d-9c8c85cdb940 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:34.175921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1275/2551] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:15:34 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:15:34.180308 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c13473-4e82-4303-a6cf-5b6109f9421e admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:34.190890 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c13473-4e82-4303-a6cf-5b6109f9421e admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:34.253192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639ae16-8857-494e-be1c-61a974304c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:34.253896 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639ae16-8857-494e-be1c-61a974304c0f admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:34.254154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639ae16-8857-494e-be1c-61a974304c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:34.254477 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639ae16-8857-494e-be1c-61a974304c0f admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:34.255205 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639ae16-8857-494e-be1c-61a974304c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:34.257247 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639ae16-8857-494e-be1c-61a974304c0f admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:34.282212 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1277/2552] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:15:34 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:34.283531 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6c21b-ada5-4bf9-858d-9c8c85cdb940 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:34.296390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6c21b-ada5-4bf9-858d-9c8c85cdb940 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:34.301792 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dce40-e1ac-4d79-b5c0-65c04f363e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:34.302569 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dce40-e1ac-4d79-b5c0-65c04f363e81 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:34.302864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dce40-e1ac-4d79-b5c0-65c04f363e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:34.303133 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dce40-e1ac-4d79-b5c0-65c04f363e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:34.303855 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9dce40-e1ac-4d79-b5c0-65c04f363e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:34.305437 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9dce40-e1ac-4d79-b5c0-65c04f363e81 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:34.322246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1276/2553] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:34.323886 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639ae16-8857-494e-be1c-61a974304c0f admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:34.337314 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639ae16-8857-494e-be1c-61a974304c0f admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:34.342353 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31ae6d-88e9-47de-b716-9a785af5ac95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:34.343259 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31ae6d-88e9-47de-b716-9a785af5ac95 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:34.343612 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31ae6d-88e9-47de-b716-9a785af5ac95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:34.343981 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31ae6d-88e9-47de-b716-9a785af5ac95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:34.344773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31ae6d-88e9-47de-b716-9a785af5ac95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:34.346773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31ae6d-88e9-47de-b716-9a785af5ac95 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:34.358786 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1278/2554] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:15:34.362811 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dce40-e1ac-4d79-b5c0-65c04f363e81 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:34.376801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dce40-e1ac-4d79-b5c0-65c04f363e81 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:34.378357 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691a0c9-87e8-4115-9f93-92a7bb6c0315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:34.379339 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691a0c9-87e8-4115-9f93-92a7bb6c0315 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:34.379671 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691a0c9-87e8-4115-9f93-92a7bb6c0315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:34.380013 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691a0c9-87e8-4115-9f93-92a7bb6c0315 admin admin] PATH_INFO: `/v3/projects/f3f7aafd8fe141868e265cb9c3b2c4e3/users/35a803dcb96646629f3cd99fb626684a/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:34.395300 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691a0c9-87e8-4115-9f93-92a7bb6c0315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3f7aafd8fe141868e265cb9c3b2c4e3, user_id=35a803dcb96646629f3cd99fb626684a, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:34.398050 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691a0c9-87e8-4115-9f93-92a7bb6c0315 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:34.411185 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1277/2555] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:34 2022] PUT /identity/v3/projects/f3f7aafd8fe141868e265cb9c3b2c4e3/users/35a803dcb96646629f3cd99fb626684a/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:15:34.422303 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e99a41-94a2-4b77-858d-ebb167261949 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:34.422703 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e99a41-94a2-4b77-858d-ebb167261949 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:34.423055 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e99a41-94a2-4b77-858d-ebb167261949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:34.451047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-c2e99a41-94a2-4b77-858d-ebb167261949 None None] MFA Rules not processed for user `35a803dcb96646629f3cd99fb626684a`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:34.452304 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-c2e99a41-94a2-4b77-858d-ebb167261949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:34.498305 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:34.523372 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1279/2556] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:34.535616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691a0c9-87e8-4115-9f93-92a7bb6c0315 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:34.537315 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5691a0c9-87e8-4115-9f93-92a7bb6c0315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:34.594299 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691a0c9-87e8-4115-9f93-92a7bb6c0315 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:34.598718 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566949a2-9d15-4c12-9b65-23587a0cc712 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:34.599600 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566949a2-9d15-4c12-9b65-23587a0cc712 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:34.599882 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566949a2-9d15-4c12-9b65-23587a0cc712 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:34.600157 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566949a2-9d15-4c12-9b65-23587a0cc712 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:34.609451 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566949a2-9d15-4c12-9b65-23587a0cc712 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:34.610922 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566949a2-9d15-4c12-9b65-23587a0cc712 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:34.626578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1278/2557] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:15:34.644018 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e99a41-94a2-4b77-858d-ebb167261949 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:34.717031 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e99a41-94a2-4b77-858d-ebb167261949 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:34.721863 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ac128-0f50-4c20-bcc6-909a9ed446f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:34.722865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ac128-0f50-4c20-bcc6-909a9ed446f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:34.723149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ac128-0f50-4c20-bcc6-909a9ed446f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:34.723428 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ac128-0f50-4c20-bcc6-909a9ed446f7 admin admin] PATH_INFO: `/v3/users/35a803dcb96646629f3cd99fb626684a` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:34.724646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ac128-0f50-4c20-bcc6-909a9ed446f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35a803dcb96646629f3cd99fb626684a)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:34.726614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ac128-0f50-4c20-bcc6-909a9ed446f7 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:34.897934 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-4e8ac128-0f50-4c20-bcc6-909a9ed446f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35a803dcb96646629f3cd99fb626684a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:34.906424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-4e8ac128-0f50-4c20-bcc6-909a9ed446f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35a803dcb96646629f3cd99fb626684a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:34.907060 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-4e8ac128-0f50-4c20-bcc6-909a9ed446f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35a803dcb96646629f3cd99fb626684a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:34.919662 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-4e8ac128-0f50-4c20-bcc6-909a9ed446f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35a803dcb96646629f3cd99fb626684a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:34.920326 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-4e8ac128-0f50-4c20-bcc6-909a9ed446f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35a803dcb96646629f3cd99fb626684a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:34.932820 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1280/2558] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:15:34 2022] DELETE /identity/v3/users/35a803dcb96646629f3cd99fb626684a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:34.937541 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddac14d-a600-45f2-9e64-c46d39ec8414 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:34.938262 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddac14d-a600-45f2-9e64-c46d39ec8414 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:34.938262 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddac14d-a600-45f2-9e64-c46d39ec8414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:34.956971 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-bddac14d-a600-45f2-9e64-c46d39ec8414 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:34.958181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-bddac14d-a600-45f2-9e64-c46d39ec8414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:34.977294 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:35.022778 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1279/2559] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:15:35.033433 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ac128-0f50-4c20-bcc6-909a9ed446f7 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:35.035098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-4e8ac128-0f50-4c20-bcc6-909a9ed446f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:35.093819 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ac128-0f50-4c20-bcc6-909a9ed446f7 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:35.098479 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb32628-e4d8-4191-a8e8-25134e9f6e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:35.099312 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb32628-e4d8-4191-a8e8-25134e9f6e35 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:35.099601 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb32628-e4d8-4191-a8e8-25134e9f6e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:35.099874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb32628-e4d8-4191-a8e8-25134e9f6e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:35.109457 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb32628-e4d8-4191-a8e8-25134e9f6e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:35.111076 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb32628-e4d8-4191-a8e8-25134e9f6e35 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:35.126132 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1281/2560] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:15:35.431720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddac14d-a600-45f2-9e64-c46d39ec8414 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:35.433652 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-bddac14d-a600-45f2-9e64-c46d39ec8414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:35.470523 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddac14d-a600-45f2-9e64-c46d39ec8414 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:35.475342 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93db34-33d3-4108-9f4b-529f617c9c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:35.476179 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93db34-33d3-4108-9f4b-529f617c9c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:35.476483 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93db34-33d3-4108-9f4b-529f617c9c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:35.476795 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93db34-33d3-4108-9f4b-529f617c9c4c admin admin] PATH_INFO: `/v3/projects/f3f7aafd8fe141868e265cb9c3b2c4e3` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:35.477986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93db34-33d3-4108-9f4b-529f617c9c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3f7aafd8fe141868e265cb9c3b2c4e3)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:35.480502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93db34-33d3-4108-9f4b-529f617c9c4c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:35.543770 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8d93db34-33d3-4108-9f4b-529f617c9c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3f7aafd8fe141868e265cb9c3b2c4e3', 'request_id': 'req-8d93db34-33d3-4108-9f4b-529f617c9c4c'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:35.551104 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8d93db34-33d3-4108-9f4b-529f617c9c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3f7aafd8fe141868e265cb9c3b2c4e3', 'request_id': 'req-8d93db34-33d3-4108-9f4b-529f617c9c4c'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:35.558427 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8d93db34-33d3-4108-9f4b-529f617c9c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3f7aafd8fe141868e265cb9c3b2c4e3', 'request_id': 'req-8d93db34-33d3-4108-9f4b-529f617c9c4c'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:35.573537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8d93db34-33d3-4108-9f4b-529f617c9c4c admin admin] The token cache is being invalidate because project f3f7aafd8fe141868e265cb9c3b2c4e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:15:35.573829 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8d93db34-33d3-4108-9f4b-529f617c9c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:35.574523 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8d93db34-33d3-4108-9f4b-529f617c9c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:35.576074 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1280/2561] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:15:35 2022] DELETE /identity/v3/projects/f3f7aafd8fe141868e265cb9c3b2c4e3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:35.581533 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444bea9-8e78-4751-865c-cbd7feec02ce None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:35.581870 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444bea9-8e78-4751-865c-cbd7feec02ce None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:35.582135 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444bea9-8e78-4751-865c-cbd7feec02ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:35.602682 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-6444bea9-8e78-4751-865c-cbd7feec02ce None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:35.603964 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-6444bea9-8e78-4751-865c-cbd7feec02ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:35.609205 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:35.677353 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1282/2562] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:15:35.685824 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76abab-2bc3-47ae-a2dd-2f6b37c5b52f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:35.686110 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76abab-2bc3-47ae-a2dd-2f6b37c5b52f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:35.686422 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76abab-2bc3-47ae-a2dd-2f6b37c5b52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:35.710898 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ec76abab-2bc3-47ae-a2dd-2f6b37c5b52f None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:35.712111 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ec76abab-2bc3-47ae-a2dd-2f6b37c5b52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:35.721531 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1281/2563] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:35.725889 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444bea9-8e78-4751-865c-cbd7feec02ce None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:35.736267 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444bea9-8e78-4751-865c-cbd7feec02ce None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:35.741109 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e28cb-0789-49bb-96ff-46f1d8afaf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:35.741771 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e28cb-0789-49bb-96ff-46f1d8afaf5e admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:35.742052 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e28cb-0789-49bb-96ff-46f1d8afaf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:35.742323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e28cb-0789-49bb-96ff-46f1d8afaf5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:35.743207 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e28cb-0789-49bb-96ff-46f1d8afaf5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:15:35.743378 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e28cb-0789-49bb-96ff-46f1d8afaf5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:35.745032 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e28cb-0789-49bb-96ff-46f1d8afaf5e admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:35.756904 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1283/2564] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:15:35.762174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76abab-2bc3-47ae-a2dd-2f6b37c5b52f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:35.772549 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76abab-2bc3-47ae-a2dd-2f6b37c5b52f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:35.777330 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36caffdb-cca0-4249-b399-ebca6d9b34a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:35.778033 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36caffdb-cca0-4249-b399-ebca6d9b34a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:35.778324 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36caffdb-cca0-4249-b399-ebca6d9b34a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:35.778780 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36caffdb-cca0-4249-b399-ebca6d9b34a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:35.779808 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36caffdb-cca0-4249-b399-ebca6d9b34a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:35.782256 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36caffdb-cca0-4249-b399-ebca6d9b34a0 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:35.818960 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1282/2565] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:15:35 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:35.823766 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e28cb-0789-49bb-96ff-46f1d8afaf5e admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:35.833924 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e28cb-0789-49bb-96ff-46f1d8afaf5e admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:35.902276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84161635-fd1d-4607-9613-e7afbbc72a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:35.906187 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84161635-fd1d-4607-9613-e7afbbc72a41 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:35.906187 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84161635-fd1d-4607-9613-e7afbbc72a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:35.906187 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84161635-fd1d-4607-9613-e7afbbc72a41 admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:35.906187 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84161635-fd1d-4607-9613-e7afbbc72a41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:35.908022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84161635-fd1d-4607-9613-e7afbbc72a41 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:35.912510 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36caffdb-cca0-4249-b399-ebca6d9b34a0 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:35.913744 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-36caffdb-cca0-4249-b399-ebca6d9b34a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:35.926677 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1284/2566] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:15:35 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:35.928777 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36caffdb-cca0-4249-b399-ebca6d9b34a0 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:35.930895 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84161635-fd1d-4607-9613-e7afbbc72a41 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:35.934634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5e359-e70d-42a7-9b01-fd2242b5169a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:35.935544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5e359-e70d-42a7-9b01-fd2242b5169a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:35.935841 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5e359-e70d-42a7-9b01-fd2242b5169a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:35.936123 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5e359-e70d-42a7-9b01-fd2242b5169a admin admin] PATH_INFO: `/v3/users/148458f8718c417d9de23fb4c107ec15` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:35.937373 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5e359-e70d-42a7-9b01-fd2242b5169a admin admin] RBAC: Authorizing `identity:delete_user(user_id=148458f8718c417d9de23fb4c107ec15)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:35.939453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5e359-e70d-42a7-9b01-fd2242b5169a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:35.941111 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84161635-fd1d-4607-9613-e7afbbc72a41 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:35.945966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed94cf-d82d-4141-a48f-f7cf96e0b946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:35.946653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed94cf-d82d-4141-a48f-f7cf96e0b946 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:35.946938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed94cf-d82d-4141-a48f-f7cf96e0b946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:35.947225 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed94cf-d82d-4141-a48f-f7cf96e0b946 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:35.948475 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed94cf-d82d-4141-a48f-f7cf96e0b946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:35.950090 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed94cf-d82d-4141-a48f-f7cf96e0b946 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:35.965563 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1285/2567] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:35.970384 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed94cf-d82d-4141-a48f-f7cf96e0b946 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:35.983774 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed94cf-d82d-4141-a48f-f7cf96e0b946 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:35.988746 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7674b-78db-4f0b-9001-111a489e8814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:35.989647 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7674b-78db-4f0b-9001-111a489e8814 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:35.989777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7674b-78db-4f0b-9001-111a489e8814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:35.989990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7674b-78db-4f0b-9001-111a489e8814 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:35.990751 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7674b-78db-4f0b-9001-111a489e8814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:35.992383 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7674b-78db-4f0b-9001-111a489e8814 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:35.996397 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-30b5e359-e70d-42a7-9b01-fd2242b5169a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '148458f8718c417d9de23fb4c107ec15'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:36.004164 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-30b5e359-e70d-42a7-9b01-fd2242b5169a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '148458f8718c417d9de23fb4c107ec15'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:36.009601 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1286/2568] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:36.011474 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7674b-78db-4f0b-9001-111a489e8814 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:36.014695 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-30b5e359-e70d-42a7-9b01-fd2242b5169a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '148458f8718c417d9de23fb4c107ec15'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:36.022106 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7674b-78db-4f0b-9001-111a489e8814 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:36.025181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:36.027830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c7abe-2e9d-40c2-9f20-68b624957ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:36.028729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c7abe-2e9d-40c2-9f20-68b624957ba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:36.029014 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c7abe-2e9d-40c2-9f20-68b624957ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:36.029291 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c7abe-2e9d-40c2-9f20-68b624957ba7 admin admin] PATH_INFO: `/v3/projects/24d770d26af64529b8ada0639c7e1bdd/users/3d3b33014eac48f8911119e8b8966558/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:36.031406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-30b5e359-e70d-42a7-9b01-fd2242b5169a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '148458f8718c417d9de23fb4c107ec15'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:36.032390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-30b5e359-e70d-42a7-9b01-fd2242b5169a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '148458f8718c417d9de23fb4c107ec15'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:36.040181 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1283/2569] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:15:35 2022] DELETE /identity/v3/users/148458f8718c417d9de23fb4c107ec15 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:36.044522 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d581ed-1bd3-485b-b3e0-7008fb134394 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:36.044844 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d581ed-1bd3-485b-b3e0-7008fb134394 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:36.045271 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d581ed-1bd3-485b-b3e0-7008fb134394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:36.046315 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c7abe-2e9d-40c2-9f20-68b624957ba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d770d26af64529b8ada0639c7e1bdd, user_id=3d3b33014eac48f8911119e8b8966558, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:36.049155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c7abe-2e9d-40c2-9f20-68b624957ba7 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:36.063015 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1287/2570] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:36 2022] PUT /identity/v3/projects/24d770d26af64529b8ada0639c7e1bdd/users/3d3b33014eac48f8911119e8b8966558/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:36.068729 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-b5d581ed-1bd3-485b-b3e0-7008fb134394 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:36.069955 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b5d581ed-1bd3-485b-b3e0-7008fb134394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:36.075978 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38764a-1200-48aa-85ed-e2ff05d0e6ae None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:36.076495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38764a-1200-48aa-85ed-e2ff05d0e6ae None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:36.076782 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38764a-1200-48aa-85ed-e2ff05d0e6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:36.104769 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-4e38764a-1200-48aa-85ed-e2ff05d0e6ae None None] MFA Rules not processed for user `3d3b33014eac48f8911119e8b8966558`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:36.106064 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-4e38764a-1200-48aa-85ed-e2ff05d0e6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:36.131815 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1284/2571] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:15:36.138361 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:36.143251 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d581ed-1bd3-485b-b3e0-7008fb134394 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:36.144750 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b5d581ed-1bd3-485b-b3e0-7008fb134394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:36.176445 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1288/2572] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:15:36.188265 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38764a-1200-48aa-85ed-e2ff05d0e6ae None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:36.189653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-4e38764a-1200-48aa-85ed-e2ff05d0e6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:36.209093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d581ed-1bd3-485b-b3e0-7008fb134394 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:36.213022 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe989a-203d-4c3d-970c-1bfe13bc0799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:36.213803 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe989a-203d-4c3d-970c-1bfe13bc0799 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:36.214058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe989a-203d-4c3d-970c-1bfe13bc0799 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:36.214359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe989a-203d-4c3d-970c-1bfe13bc0799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:36.226563 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe989a-203d-4c3d-970c-1bfe13bc0799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:36.228014 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe989a-203d-4c3d-970c-1bfe13bc0799 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:36.238313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1285/2573] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:15:36.256260 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38764a-1200-48aa-85ed-e2ff05d0e6ae None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:36.260069 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec9686-fa9f-493e-9ca3-310f46343f8e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6921990ec98492f8f4420f911208b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:36.261359 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec9686-fa9f-493e-9ca3-310f46343f8e service glance] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:36.261669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec9686-fa9f-493e-9ca3-310f46343f8e service glance] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:36.261945 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec9686-fa9f-493e-9ca3-310f46343f8e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:36.271282 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec9686-fa9f-493e-9ca3-310f46343f8e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:36.272736 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec9686-fa9f-493e-9ca3-310f46343f8e service glance] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:36.282244 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1289/2574] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:15:36.520193 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe989a-203d-4c3d-970c-1bfe13bc0799 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:36.522374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-13fe989a-203d-4c3d-970c-1bfe13bc0799 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:36.539609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe989a-203d-4c3d-970c-1bfe13bc0799 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:36.545787 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e43edc-8e3c-427d-ad87-9c76e3914c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:36.546772 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e43edc-8e3c-427d-ad87-9c76e3914c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:36.546946 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e43edc-8e3c-427d-ad87-9c76e3914c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:36.547227 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e43edc-8e3c-427d-ad87-9c76e3914c12 admin admin] PATH_INFO: `/v3/projects/d53b63a21e5244ac8598c40a505d88b6` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:36.548456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e43edc-8e3c-427d-ad87-9c76e3914c12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d53b63a21e5244ac8598c40a505d88b6)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:36.551034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e43edc-8e3c-427d-ad87-9c76e3914c12 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:36.605785 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-55e43edc-8e3c-427d-ad87-9c76e3914c12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd53b63a21e5244ac8598c40a505d88b6', 'request_id': 'req-55e43edc-8e3c-427d-ad87-9c76e3914c12'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:36.612234 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-55e43edc-8e3c-427d-ad87-9c76e3914c12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd53b63a21e5244ac8598c40a505d88b6', 'request_id': 'req-55e43edc-8e3c-427d-ad87-9c76e3914c12'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:36.618023 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-55e43edc-8e3c-427d-ad87-9c76e3914c12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd53b63a21e5244ac8598c40a505d88b6', 'request_id': 'req-55e43edc-8e3c-427d-ad87-9c76e3914c12'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:36.632552 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-55e43edc-8e3c-427d-ad87-9c76e3914c12 admin admin] The token cache is being invalidate because project d53b63a21e5244ac8598c40a505d88b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:15:36.632825 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-55e43edc-8e3c-427d-ad87-9c76e3914c12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:36.633512 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-55e43edc-8e3c-427d-ad87-9c76e3914c12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:36.635366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1286/2575] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:15:36 2022] DELETE /identity/v3/projects/d53b63a21e5244ac8598c40a505d88b6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:36.640314 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ddf69-97bd-4272-829c-e115fc279a7b None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:36.640673 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ddf69-97bd-4272-829c-e115fc279a7b None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:36.640917 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ddf69-97bd-4272-829c-e115fc279a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:36.660411 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-ca1ddf69-97bd-4272-829c-e115fc279a7b None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:36.661660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ca1ddf69-97bd-4272-829c-e115fc279a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:36.751824 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1290/2576] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:36.759997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56252e8-7236-4759-98db-944a32121bf1 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:36.760214 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56252e8-7236-4759-98db-944a32121bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:36.766893 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56252e8-7236-4759-98db-944a32121bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:36.790632 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a56252e8-7236-4759-98db-944a32121bf1 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:36.792437 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a56252e8-7236-4759-98db-944a32121bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:36.805165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1287/2577] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:36.808457 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ddf69-97bd-4272-829c-e115fc279a7b None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:36.820705 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ddf69-97bd-4272-829c-e115fc279a7b None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:36.825393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8025099-ef13-464c-b689-32dd75ddb193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:36.826053 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8025099-ef13-464c-b689-32dd75ddb193 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:36.826334 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8025099-ef13-464c-b689-32dd75ddb193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:36.826646 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8025099-ef13-464c-b689-32dd75ddb193 admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:36.827365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8025099-ef13-464c-b689-32dd75ddb193 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:15:36.827671 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8025099-ef13-464c-b689-32dd75ddb193 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:36.829249 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8025099-ef13-464c-b689-32dd75ddb193 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:36.841462 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1291/2578] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:15:36.846976 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56252e8-7236-4759-98db-944a32121bf1 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:36.857979 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56252e8-7236-4759-98db-944a32121bf1 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:36.862522 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2ba5d-cf50-4a5a-96ed-35cd3a211dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:36.863170 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2ba5d-cf50-4a5a-96ed-35cd3a211dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:36.863456 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2ba5d-cf50-4a5a-96ed-35cd3a211dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:36.863730 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2ba5d-cf50-4a5a-96ed-35cd3a211dc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:36.864408 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2ba5d-cf50-4a5a-96ed-35cd3a211dc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:36.866275 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2ba5d-cf50-4a5a-96ed-35cd3a211dc7 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:36.875096 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:36.893809 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1288/2579] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:15:36 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:36.898047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8025099-ef13-464c-b689-32dd75ddb193 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:36.908535 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8025099-ef13-464c-b689-32dd75ddb193 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:36.965569 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b2881-48af-4a7c-88e4-8d3a3467f43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:36.966234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b2881-48af-4a7c-88e4-8d3a3467f43b admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:36.966548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b2881-48af-4a7c-88e4-8d3a3467f43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:36.966828 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b2881-48af-4a7c-88e4-8d3a3467f43b admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:36.967552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b2881-48af-4a7c-88e4-8d3a3467f43b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:36.969458 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b2881-48af-4a7c-88e4-8d3a3467f43b admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:36.976144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:36.990721 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1292/2580] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:15:36 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:36.995239 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2ba5d-cf50-4a5a-96ed-35cd3a211dc7 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:37.006032 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2ba5d-cf50-4a5a-96ed-35cd3a211dc7 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:37.010793 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852153c8-2ff3-49df-9e43-9c94ec5705fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:37.011392 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852153c8-2ff3-49df-9e43-9c94ec5705fd admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:37.011785 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852153c8-2ff3-49df-9e43-9c94ec5705fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:37.012097 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852153c8-2ff3-49df-9e43-9c94ec5705fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:37.012848 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852153c8-2ff3-49df-9e43-9c94ec5705fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:37.014623 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852153c8-2ff3-49df-9e43-9c94ec5705fd admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:37.025202 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1289/2581] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:37.029626 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b2881-48af-4a7c-88e4-8d3a3467f43b admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:37.040030 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b2881-48af-4a7c-88e4-8d3a3467f43b admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:37.045800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b11e82-92c0-4559-b3a5-ba1159bf2dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:37.046453 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b11e82-92c0-4559-b3a5-ba1159bf2dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:37.046792 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b11e82-92c0-4559-b3a5-ba1159bf2dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:37.047067 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b11e82-92c0-4559-b3a5-ba1159bf2dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:37.047796 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b11e82-92c0-4559-b3a5-ba1159bf2dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:37.049384 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b11e82-92c0-4559-b3a5-ba1159bf2dc0 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:37.060737 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1293/2582] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:37.065072 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852153c8-2ff3-49df-9e43-9c94ec5705fd admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:37.075676 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852153c8-2ff3-49df-9e43-9c94ec5705fd admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:37.080392 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad366f0-4a7e-4526-8caa-22fa63557e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:37.081294 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad366f0-4a7e-4526-8caa-22fa63557e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:37.081572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad366f0-4a7e-4526-8caa-22fa63557e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:37.081843 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad366f0-4a7e-4526-8caa-22fa63557e54 admin admin] PATH_INFO: `/v3/projects/d1b0839d7b3242a5a1e368f635843a46/users/c70446c1de9746a3884dd0fe8a95d486/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:37.097356 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad366f0-4a7e-4526-8caa-22fa63557e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b0839d7b3242a5a1e368f635843a46, user_id=c70446c1de9746a3884dd0fe8a95d486, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:37.100056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad366f0-4a7e-4526-8caa-22fa63557e54 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:37.113052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1290/2583] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:37 2022] PUT /identity/v3/projects/d1b0839d7b3242a5a1e368f635843a46/users/c70446c1de9746a3884dd0fe8a95d486/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:37.124441 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a8446-7a4b-4ea9-b5ec-3da2a0d3efa8 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:37.124727 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a8446-7a4b-4ea9-b5ec-3da2a0d3efa8 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:37.125001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a8446-7a4b-4ea9-b5ec-3da2a0d3efa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:37.152808 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-e59a8446-7a4b-4ea9-b5ec-3da2a0d3efa8 None None] MFA Rules not processed for user `c70446c1de9746a3884dd0fe8a95d486`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:37.154016 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e59a8446-7a4b-4ea9-b5ec-3da2a0d3efa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:37.232343 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1294/2584] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:37.236959 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad366f0-4a7e-4526-8caa-22fa63557e54 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:37.300591 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad366f0-4a7e-4526-8caa-22fa63557e54 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:37.305157 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554aecb-4332-4187-97fe-c2f3f5bb93c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:37.305813 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554aecb-4332-4187-97fe-c2f3f5bb93c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:37.306100 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554aecb-4332-4187-97fe-c2f3f5bb93c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:37.306409 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554aecb-4332-4187-97fe-c2f3f5bb93c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:37.307151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554aecb-4332-4187-97fe-c2f3f5bb93c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:37.309078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554aecb-4332-4187-97fe-c2f3f5bb93c3 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:37.340338 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1291/2585] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:15:37 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:37.344411 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a8446-7a4b-4ea9-b5ec-3da2a0d3efa8 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:37.356179 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a8446-7a4b-4ea9-b5ec-3da2a0d3efa8 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:37.420392 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de406d9-7d23-42bb-8368-dd0f2b993a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:37.421072 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de406d9-7d23-42bb-8368-dd0f2b993a05 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:37.421350 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de406d9-7d23-42bb-8368-dd0f2b993a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:37.421621 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de406d9-7d23-42bb-8368-dd0f2b993a05 admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:37.422320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de406d9-7d23-42bb-8368-dd0f2b993a05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:37.424259 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de406d9-7d23-42bb-8368-dd0f2b993a05 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:37.443926 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1295/2586] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:15:37 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:15:37.451629 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554aecb-4332-4187-97fe-c2f3f5bb93c3 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:37.462871 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554aecb-4332-4187-97fe-c2f3f5bb93c3 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:37.468121 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99da84-3808-4d59-babf-db78c6b5b61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:37.468791 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99da84-3808-4d59-babf-db78c6b5b61d admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:37.469074 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99da84-3808-4d59-babf-db78c6b5b61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:37.469349 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99da84-3808-4d59-babf-db78c6b5b61d admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:37.470165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99da84-3808-4d59-babf-db78c6b5b61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:37.471936 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99da84-3808-4d59-babf-db78c6b5b61d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:37.483045 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1292/2587] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:15:37.487300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de406d9-7d23-42bb-8368-dd0f2b993a05 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:37.497481 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de406d9-7d23-42bb-8368-dd0f2b993a05 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:37.502061 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17609f-3337-4880-8a55-a23c4887c9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:37.502976 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17609f-3337-4880-8a55-a23c4887c9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:37.503259 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17609f-3337-4880-8a55-a23c4887c9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:37.503531 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17609f-3337-4880-8a55-a23c4887c9c4 admin admin] PATH_INFO: `/v3/projects/7b86fe4517134c77a553a1a7ef2bc913/users/61353d94ed5b47bd8a220e9e6ece5e82/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:37.520585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17609f-3337-4880-8a55-a23c4887c9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b86fe4517134c77a553a1a7ef2bc913, user_id=61353d94ed5b47bd8a220e9e6ece5e82, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:37.524044 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17609f-3337-4880-8a55-a23c4887c9c4 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:37.540974 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1296/2588] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:37 2022] PUT /identity/v3/projects/7b86fe4517134c77a553a1a7ef2bc913/users/61353d94ed5b47bd8a220e9e6ece5e82/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:37.545478 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99da84-3808-4d59-babf-db78c6b5b61d admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:37.556527 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99da84-3808-4d59-babf-db78c6b5b61d admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:37.611679 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15452dbb-916f-47e7-ad31-1d2c7974bf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:37.612342 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15452dbb-916f-47e7-ad31-1d2c7974bf71 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:37.612627 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15452dbb-916f-47e7-ad31-1d2c7974bf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:37.612902 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15452dbb-916f-47e7-ad31-1d2c7974bf71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:37.613616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15452dbb-916f-47e7-ad31-1d2c7974bf71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:37.615226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15452dbb-916f-47e7-ad31-1d2c7974bf71 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:37.626876 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1293/2589] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:15:37.631129 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17609f-3337-4880-8a55-a23c4887c9c4 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:37.642661 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17609f-3337-4880-8a55-a23c4887c9c4 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:37.648499 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42caf72-9afd-45ae-9061-5d1ad5b706a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:37.649405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42caf72-9afd-45ae-9061-5d1ad5b706a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:37.649688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42caf72-9afd-45ae-9061-5d1ad5b706a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:37.649964 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42caf72-9afd-45ae-9061-5d1ad5b706a2 admin admin] PATH_INFO: `/v3/projects/7b86fe4517134c77a553a1a7ef2bc913/users/61353d94ed5b47bd8a220e9e6ece5e82/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:37.651955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42caf72-9afd-45ae-9061-5d1ad5b706a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b86fe4517134c77a553a1a7ef2bc913, user_id=61353d94ed5b47bd8a220e9e6ece5e82, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:37.654675 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42caf72-9afd-45ae-9061-5d1ad5b706a2 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:37.665206 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1297/2590] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:37 2022] PUT /identity/v3/projects/7b86fe4517134c77a553a1a7ef2bc913/users/61353d94ed5b47bd8a220e9e6ece5e82/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:37.675632 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3bc46-a00f-494d-9ff9-1012c41c7661 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:37.675922 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3bc46-a00f-494d-9ff9-1012c41c7661 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:37.676205 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3bc46-a00f-494d-9ff9-1012c41c7661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:37.710665 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-1cf3bc46-a00f-494d-9ff9-1012c41c7661 None None] MFA Rules not processed for user `61353d94ed5b47bd8a220e9e6ece5e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:37.712081 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1cf3bc46-a00f-494d-9ff9-1012c41c7661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:37.724887 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:37.786638 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1294/2591] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:15:37.796992 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42caf72-9afd-45ae-9061-5d1ad5b706a2 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:37.798744 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-d42caf72-9afd-45ae-9061-5d1ad5b706a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:37.826056 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:37.862581 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42caf72-9afd-45ae-9061-5d1ad5b706a2 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:37.866514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9911fb7-dbdb-47e8-b5c7-57820657a721 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:37.867176 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9911fb7-dbdb-47e8-b5c7-57820657a721 service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:37.867462 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9911fb7-dbdb-47e8-b5c7-57820657a721 service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:37.867769 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9911fb7-dbdb-47e8-b5c7-57820657a721 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:37.935069 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9911fb7-dbdb-47e8-b5c7-57820657a721 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:37.936939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9911fb7-dbdb-47e8-b5c7-57820657a721 service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:37.946748 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1298/2592] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:15:39.023062 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3bc46-a00f-494d-9ff9-1012c41c7661 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:39.024544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1cf3bc46-a00f-494d-9ff9-1012c41c7661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:39.089624 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3bc46-a00f-494d-9ff9-1012c41c7661 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:39.094128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06898b34-01e5-47ea-b3be-c2a7f3e7353e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:39.095021 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06898b34-01e5-47ea-b3be-c2a7f3e7353e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:39.095308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06898b34-01e5-47ea-b3be-c2a7f3e7353e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:39.095579 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06898b34-01e5-47ea-b3be-c2a7f3e7353e admin admin] PATH_INFO: `/v3/users/eea1d44140ca435d9498af55fc980ade` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:39.096747 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06898b34-01e5-47ea-b3be-c2a7f3e7353e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eea1d44140ca435d9498af55fc980ade)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:39.098668 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06898b34-01e5-47ea-b3be-c2a7f3e7353e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:39.144018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-06898b34-01e5-47ea-b3be-c2a7f3e7353e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eea1d44140ca435d9498af55fc980ade'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:39.151658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-06898b34-01e5-47ea-b3be-c2a7f3e7353e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eea1d44140ca435d9498af55fc980ade'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:39.160318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-06898b34-01e5-47ea-b3be-c2a7f3e7353e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eea1d44140ca435d9498af55fc980ade'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:39.173673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-06898b34-01e5-47ea-b3be-c2a7f3e7353e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eea1d44140ca435d9498af55fc980ade'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:39.174384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-06898b34-01e5-47ea-b3be-c2a7f3e7353e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eea1d44140ca435d9498af55fc980ade'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:39.180730 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1295/2593] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:15:39 2022] DELETE /identity/v3/users/eea1d44140ca435d9498af55fc980ade => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:39.185226 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b6480-a5b5-4fa6-9b37-a01e4a3e753e None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:39.185708 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b6480-a5b5-4fa6-9b37-a01e4a3e753e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:39.185838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b6480-a5b5-4fa6-9b37-a01e4a3e753e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:39.202729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-ba3b6480-a5b5-4fa6-9b37-a01e4a3e753e None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:39.203923 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ba3b6480-a5b5-4fa6-9b37-a01e4a3e753e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:39.264084 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1299/2594] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:39.279650 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06898b34-01e5-47ea-b3be-c2a7f3e7353e admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:39.281072 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-06898b34-01e5-47ea-b3be-c2a7f3e7353e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:39.318665 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:39.348354 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06898b34-01e5-47ea-b3be-c2a7f3e7353e admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:39.351999 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399786e-ebf7-44ef-8208-f2295a2b7c66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:39.352643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399786e-ebf7-44ef-8208-f2295a2b7c66 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:39.353026 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399786e-ebf7-44ef-8208-f2295a2b7c66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:39.353204 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399786e-ebf7-44ef-8208-f2295a2b7c66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:39.362799 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399786e-ebf7-44ef-8208-f2295a2b7c66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:39.364223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399786e-ebf7-44ef-8208-f2295a2b7c66 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:39.374389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1296/2595] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:15:39.676176 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b6480-a5b5-4fa6-9b37-a01e4a3e753e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:39.678316 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ba3b6480-a5b5-4fa6-9b37-a01e4a3e753e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:39.699021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b6480-a5b5-4fa6-9b37-a01e4a3e753e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:39.707958 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d633a4-2b49-4957-bb88-cfa2261b0aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:39.709424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d633a4-2b49-4957-bb88-cfa2261b0aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:39.709941 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d633a4-2b49-4957-bb88-cfa2261b0aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:39.710440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d633a4-2b49-4957-bb88-cfa2261b0aab admin admin] PATH_INFO: `/v3/projects/10d5a5bbb49f41f690794f86408c0a1f` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:39.712045 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d633a4-2b49-4957-bb88-cfa2261b0aab admin admin] RBAC: Authorizing `identity:delete_project(project_id=10d5a5bbb49f41f690794f86408c0a1f)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:39.715090 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d633a4-2b49-4957-bb88-cfa2261b0aab admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:39.763440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-37d633a4-2b49-4957-bb88-cfa2261b0aab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10d5a5bbb49f41f690794f86408c0a1f', 'request_id': 'req-37d633a4-2b49-4957-bb88-cfa2261b0aab'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:39.769894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-37d633a4-2b49-4957-bb88-cfa2261b0aab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10d5a5bbb49f41f690794f86408c0a1f', 'request_id': 'req-37d633a4-2b49-4957-bb88-cfa2261b0aab'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:39.776910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-37d633a4-2b49-4957-bb88-cfa2261b0aab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10d5a5bbb49f41f690794f86408c0a1f', 'request_id': 'req-37d633a4-2b49-4957-bb88-cfa2261b0aab'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:39.786632 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:39.793661 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-37d633a4-2b49-4957-bb88-cfa2261b0aab admin admin] The token cache is being invalidate because project 10d5a5bbb49f41f690794f86408c0a1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:15:39.794183 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-37d633a4-2b49-4957-bb88-cfa2261b0aab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:39.795918 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-37d633a4-2b49-4957-bb88-cfa2261b0aab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:39.797936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1300/2596] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:15:39 2022] DELETE /identity/v3/projects/10d5a5bbb49f41f690794f86408c0a1f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:39.803340 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399786e-ebf7-44ef-8208-f2295a2b7c66 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:39.816706 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399786e-ebf7-44ef-8208-f2295a2b7c66 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:39.880026 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768b223-c987-4b2a-8b48-2aa98d1587a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:39.880912 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768b223-c987-4b2a-8b48-2aa98d1587a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:39.881215 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768b223-c987-4b2a-8b48-2aa98d1587a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:39.881495 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768b223-c987-4b2a-8b48-2aa98d1587a7 admin admin] PATH_INFO: `/v3/users/3a2f3802db274720861fb46383e916b1` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:39.882725 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768b223-c987-4b2a-8b48-2aa98d1587a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a2f3802db274720861fb46383e916b1)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:39.884683 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768b223-c987-4b2a-8b48-2aa98d1587a7 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:39.933410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d768b223-c987-4b2a-8b48-2aa98d1587a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a2f3802db274720861fb46383e916b1'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:39.941041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d768b223-c987-4b2a-8b48-2aa98d1587a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a2f3802db274720861fb46383e916b1'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:39.948530 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d768b223-c987-4b2a-8b48-2aa98d1587a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a2f3802db274720861fb46383e916b1'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:39.960097 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d768b223-c987-4b2a-8b48-2aa98d1587a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a2f3802db274720861fb46383e916b1'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:39.960739 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d768b223-c987-4b2a-8b48-2aa98d1587a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a2f3802db274720861fb46383e916b1'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:39.967072 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1297/2597] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:15:39 2022] DELETE /identity/v3/users/3a2f3802db274720861fb46383e916b1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:40.248430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d633a4-2b49-4957-bb88-cfa2261b0aab admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:40.249902 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-37d633a4-2b49-4957-bb88-cfa2261b0aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:40.263108 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d633a4-2b49-4957-bb88-cfa2261b0aab admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:40.320689 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8f60f-2971-40cf-a130-9bcbc392db63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:40.321444 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8f60f-2971-40cf-a130-9bcbc392db63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:40.321725 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8f60f-2971-40cf-a130-9bcbc392db63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:40.321998 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8f60f-2971-40cf-a130-9bcbc392db63 admin admin] PATH_INFO: `/v3/projects/b22c99935cb74c378d67841271deeb99` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:40.323250 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8f60f-2971-40cf-a130-9bcbc392db63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b22c99935cb74c378d67841271deeb99)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:40.325145 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8f60f-2971-40cf-a130-9bcbc392db63 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:40.371073 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0ff8f60f-2971-40cf-a130-9bcbc392db63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b22c99935cb74c378d67841271deeb99', 'request_id': 'req-0ff8f60f-2971-40cf-a130-9bcbc392db63'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:40.377117 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0ff8f60f-2971-40cf-a130-9bcbc392db63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b22c99935cb74c378d67841271deeb99', 'request_id': 'req-0ff8f60f-2971-40cf-a130-9bcbc392db63'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:40.382516 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0ff8f60f-2971-40cf-a130-9bcbc392db63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b22c99935cb74c378d67841271deeb99', 'request_id': 'req-0ff8f60f-2971-40cf-a130-9bcbc392db63'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:40.394210 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0ff8f60f-2971-40cf-a130-9bcbc392db63 admin admin] The token cache is being invalidate because project b22c99935cb74c378d67841271deeb99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:15:40.394515 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0ff8f60f-2971-40cf-a130-9bcbc392db63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:40.395126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0ff8f60f-2971-40cf-a130-9bcbc392db63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:40.396640 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1301/2598] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:15:40 2022] DELETE /identity/v3/projects/b22c99935cb74c378d67841271deeb99 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:15:40.403676 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b8e7e-ac4f-47ff-ac69-a671d0a44933 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:40.404149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b8e7e-ac4f-47ff-ac69-a671d0a44933 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:40.404267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b8e7e-ac4f-47ff-ac69-a671d0a44933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:40.423135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-537b8e7e-ac4f-47ff-ac69-a671d0a44933 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:40.424340 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-537b8e7e-ac4f-47ff-ac69-a671d0a44933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:40.473956 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:40.490756 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1298/2599] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:40.500930 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc63bb-9d8a-4cda-bf42-49e0d4e3b881 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:40.501223 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc63bb-9d8a-4cda-bf42-49e0d4e3b881 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:40.501548 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc63bb-9d8a-4cda-bf42-49e0d4e3b881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:40.524582 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-2afc63bb-9d8a-4cda-bf42-49e0d4e3b881 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:40.526627 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-2afc63bb-9d8a-4cda-bf42-49e0d4e3b881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:40.529450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b8e7e-ac4f-47ff-ac69-a671d0a44933 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:40.530846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-537b8e7e-ac4f-47ff-ac69-a671d0a44933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:40.535006 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1302/2600] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:40.539337 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc63bb-9d8a-4cda-bf42-49e0d4e3b881 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:40.548976 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc63bb-9d8a-4cda-bf42-49e0d4e3b881 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:40.554327 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b6f96-81d6-47c3-89a2-d9842949ff4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:40.555010 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b6f96-81d6-47c3-89a2-d9842949ff4a admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:40.555299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b6f96-81d6-47c3-89a2-d9842949ff4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:40.555578 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b6f96-81d6-47c3-89a2-d9842949ff4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:40.556297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b6f96-81d6-47c3-89a2-d9842949ff4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:15:40.556612 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b6f96-81d6-47c3-89a2-d9842949ff4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:40.558670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b6f96-81d6-47c3-89a2-d9842949ff4a admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:40.570475 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1303/2601] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:15:40.574811 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b6f96-81d6-47c3-89a2-d9842949ff4a admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:40.584252 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b6f96-81d6-47c3-89a2-d9842949ff4a admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:40.589328 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b8e7e-ac4f-47ff-ac69-a671d0a44933 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:40.589690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e72010-b4f6-427f-b4c1-5debf7a91cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:40.590448 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e72010-b4f6-427f-b4c1-5debf7a91cdc admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:40.590775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e72010-b4f6-427f-b4c1-5debf7a91cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:40.591039 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e72010-b4f6-427f-b4c1-5debf7a91cdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:40.591726 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e72010-b4f6-427f-b4c1-5debf7a91cdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:40.593002 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f420fc7-4013-4bc2-9ca3-e1ed83850b9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:40.593642 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e72010-b4f6-427f-b4c1-5debf7a91cdc admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:40.593754 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f420fc7-4013-4bc2-9ca3-e1ed83850b9d service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:40.593924 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f420fc7-4013-4bc2-9ca3-e1ed83850b9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:40.594201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f420fc7-4013-4bc2-9ca3-e1ed83850b9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:40.596341 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4f420fc7-4013-4bc2-9ca3-e1ed83850b9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:40.623823 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1304/2602] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:15:40 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:15:40.624782 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e72010-b4f6-427f-b4c1-5debf7a91cdc admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:40.663643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f420fc7-4013-4bc2-9ca3-e1ed83850b9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:40.665341 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f420fc7-4013-4bc2-9ca3-e1ed83850b9d service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:40.673465 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:40.675947 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1299/2603] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:40 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:15:40.690427 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e72010-b4f6-427f-b4c1-5debf7a91cdc admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:40.695444 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0287e2-6007-4322-b7da-f3ed9d798927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:40.696129 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0287e2-6007-4322-b7da-f3ed9d798927 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:40.696400 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0287e2-6007-4322-b7da-f3ed9d798927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:40.696703 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0287e2-6007-4322-b7da-f3ed9d798927 admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:40.697387 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0287e2-6007-4322-b7da-f3ed9d798927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:40.699436 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0287e2-6007-4322-b7da-f3ed9d798927 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:40.719998 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1305/2604] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:15:40 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:15:40.724437 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f420fc7-4013-4bc2-9ca3-e1ed83850b9d service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:40.736008 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f420fc7-4013-4bc2-9ca3-e1ed83850b9d service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:40.748236 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7450b-e80b-4d8b-9359-8a598f7c74f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:40.749312 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7450b-e80b-4d8b-9359-8a598f7c74f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:40.749414 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7450b-e80b-4d8b-9359-8a598f7c74f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:40.749760 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7450b-e80b-4d8b-9359-8a598f7c74f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:40.750622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7450b-e80b-4d8b-9359-8a598f7c74f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:40.752364 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7450b-e80b-4d8b-9359-8a598f7c74f0 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:40.773004 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1300/2605] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:40.776930 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0287e2-6007-4322-b7da-f3ed9d798927 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:40.789866 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0287e2-6007-4322-b7da-f3ed9d798927 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:40.794531 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d049d-fc03-48f1-8c69-cddbbf37b12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:40.795196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d049d-fc03-48f1-8c69-cddbbf37b12f admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:40.795479 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d049d-fc03-48f1-8c69-cddbbf37b12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:40.795766 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d049d-fc03-48f1-8c69-cddbbf37b12f admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:40.796472 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d049d-fc03-48f1-8c69-cddbbf37b12f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:40.798050 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d049d-fc03-48f1-8c69-cddbbf37b12f admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:40.811661 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1306/2606] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:40.815457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7450b-e80b-4d8b-9359-8a598f7c74f0 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:40.828080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7450b-e80b-4d8b-9359-8a598f7c74f0 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:40.831355 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f40849-9b30-4903-85c9-69ad31cdde2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:40.832314 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f40849-9b30-4903-85c9-69ad31cdde2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:40.832669 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f40849-9b30-4903-85c9-69ad31cdde2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:40.832952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f40849-9b30-4903-85c9-69ad31cdde2b admin admin] PATH_INFO: `/v3/projects/8e4d4610e10545f9b27ea454771b412b/users/c609589709e7472380df9d89d1b401dd/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:40.848267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f40849-9b30-4903-85c9-69ad31cdde2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e4d4610e10545f9b27ea454771b412b, user_id=c609589709e7472380df9d89d1b401dd, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:40.850927 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f40849-9b30-4903-85c9-69ad31cdde2b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:40.866296 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1301/2607] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:40 2022] PUT /identity/v3/projects/8e4d4610e10545f9b27ea454771b412b/users/c609589709e7472380df9d89d1b401dd/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:40.937036 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bdf0c-0ac1-47d5-afdf-cb2a078ee013 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:40.937325 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bdf0c-0ac1-47d5-afdf-cb2a078ee013 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:40.937751 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bdf0c-0ac1-47d5-afdf-cb2a078ee013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:40.977736 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-da0bdf0c-0ac1-47d5-afdf-cb2a078ee013 None None] MFA Rules not processed for user `c609589709e7472380df9d89d1b401dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:40.979933 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-da0bdf0c-0ac1-47d5-afdf-cb2a078ee013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:41.058994 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1307/2608] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:41.071318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f40849-9b30-4903-85c9-69ad31cdde2b admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:41.073203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f4f40849-9b30-4903-85c9-69ad31cdde2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:41.142192 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f40849-9b30-4903-85c9-69ad31cdde2b admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:41.145873 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03c7ec-5df4-45a2-bd00-2d88d5a45315 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:41.146621 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03c7ec-5df4-45a2-bd00-2d88d5a45315 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:41.146953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03c7ec-5df4-45a2-bd00-2d88d5a45315 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:41.147148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03c7ec-5df4-45a2-bd00-2d88d5a45315 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:41.162311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03c7ec-5df4-45a2-bd00-2d88d5a45315 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:41.164308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03c7ec-5df4-45a2-bd00-2d88d5a45315 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:41.177143 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1302/2609] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:41 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:15:51.054811 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:51.171019 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:53.564304 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bdf0c-0ac1-47d5-afdf-cb2a078ee013 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:53.565850 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-da0bdf0c-0ac1-47d5-afdf-cb2a078ee013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:53.651495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bdf0c-0ac1-47d5-afdf-cb2a078ee013 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:53.656008 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b986f1a-c31c-4f4d-b2e8-3346171f28f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:53.656963 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b986f1a-c31c-4f4d-b2e8-3346171f28f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:53.657151 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b986f1a-c31c-4f4d-b2e8-3346171f28f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:53.657422 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b986f1a-c31c-4f4d-b2e8-3346171f28f1 admin admin] PATH_INFO: `/v3/users/c70446c1de9746a3884dd0fe8a95d486` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:53.658655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b986f1a-c31c-4f4d-b2e8-3346171f28f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c70446c1de9746a3884dd0fe8a95d486)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:53.660591 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b986f1a-c31c-4f4d-b2e8-3346171f28f1 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:53.709596 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-4b986f1a-c31c-4f4d-b2e8-3346171f28f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c70446c1de9746a3884dd0fe8a95d486'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:53.717668 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-4b986f1a-c31c-4f4d-b2e8-3346171f28f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c70446c1de9746a3884dd0fe8a95d486'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:53.718438 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-4b986f1a-c31c-4f4d-b2e8-3346171f28f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c70446c1de9746a3884dd0fe8a95d486'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:53.733090 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-4b986f1a-c31c-4f4d-b2e8-3346171f28f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c70446c1de9746a3884dd0fe8a95d486'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:53.733753 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-4b986f1a-c31c-4f4d-b2e8-3346171f28f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c70446c1de9746a3884dd0fe8a95d486'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:53.751581 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1308/2610] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:15:53 2022] DELETE /identity/v3/users/c70446c1de9746a3884dd0fe8a95d486 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:53.756408 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aee99-e4ae-40e4-8177-1dec8f9bb398 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:53.756865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aee99-e4ae-40e4-8177-1dec8f9bb398 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:53.757087 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aee99-e4ae-40e4-8177-1dec8f9bb398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:53.775962 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-d52aee99-e4ae-40e4-8177-1dec8f9bb398 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:53.777165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d52aee99-e4ae-40e4-8177-1dec8f9bb398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:53.840547 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1303/2611] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:53.851067 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b986f1a-c31c-4f4d-b2e8-3346171f28f1 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:53.852402 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-4b986f1a-c31c-4f4d-b2e8-3346171f28f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:53.909471 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b986f1a-c31c-4f4d-b2e8-3346171f28f1 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:53.913108 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea2a7e-698f-4ead-bafa-5a798cd20e4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:53.914002 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea2a7e-698f-4ead-bafa-5a798cd20e4f service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:53.914284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea2a7e-698f-4ead-bafa-5a798cd20e4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:53.914691 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea2a7e-698f-4ead-bafa-5a798cd20e4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:53.925999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea2a7e-698f-4ead-bafa-5a798cd20e4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:53.927488 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea2a7e-698f-4ead-bafa-5a798cd20e4f service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:53.938082 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1309/2612] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:15:54.237559 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52aee99-e4ae-40e4-8177-1dec8f9bb398 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:54.237559 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d52aee99-e4ae-40e4-8177-1dec8f9bb398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:54.252232 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52aee99-e4ae-40e4-8177-1dec8f9bb398 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:54.257669 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e888cdf-e1b3-493a-b4f8-a92d1fe984ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:54.258684 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e888cdf-e1b3-493a-b4f8-a92d1fe984ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:54.259034 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e888cdf-e1b3-493a-b4f8-a92d1fe984ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:54.259465 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e888cdf-e1b3-493a-b4f8-a92d1fe984ee admin admin] PATH_INFO: `/v3/projects/d1b0839d7b3242a5a1e368f635843a46` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:54.261236 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e888cdf-e1b3-493a-b4f8-a92d1fe984ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1b0839d7b3242a5a1e368f635843a46)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:54.263589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e888cdf-e1b3-493a-b4f8-a92d1fe984ee admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:54.321063 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0e888cdf-e1b3-493a-b4f8-a92d1fe984ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1b0839d7b3242a5a1e368f635843a46', 'request_id': 'req-0e888cdf-e1b3-493a-b4f8-a92d1fe984ee'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:54.327357 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0e888cdf-e1b3-493a-b4f8-a92d1fe984ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1b0839d7b3242a5a1e368f635843a46', 'request_id': 'req-0e888cdf-e1b3-493a-b4f8-a92d1fe984ee'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:54.333609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0e888cdf-e1b3-493a-b4f8-a92d1fe984ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1b0839d7b3242a5a1e368f635843a46', 'request_id': 'req-0e888cdf-e1b3-493a-b4f8-a92d1fe984ee'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:54.350662 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0e888cdf-e1b3-493a-b4f8-a92d1fe984ee admin admin] The token cache is being invalidate because project d1b0839d7b3242a5a1e368f635843a46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:15:54.350662 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0e888cdf-e1b3-493a-b4f8-a92d1fe984ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:54.350662 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-0e888cdf-e1b3-493a-b4f8-a92d1fe984ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:54.350662 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1304/2613] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:15:54 2022] DELETE /identity/v3/projects/d1b0839d7b3242a5a1e368f635843a46 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:54.353502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea2a7e-698f-4ead-bafa-5a798cd20e4f service neutron] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:54.363709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea2a7e-698f-4ead-bafa-5a798cd20e4f service neutron] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:54.383841 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:54.428518 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981c067-7999-494f-8030-b7876dac3867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:54.429400 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981c067-7999-494f-8030-b7876dac3867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:54.429692 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981c067-7999-494f-8030-b7876dac3867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:54.429971 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981c067-7999-494f-8030-b7876dac3867 admin admin] PATH_INFO: `/v3/users/61353d94ed5b47bd8a220e9e6ece5e82` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:54.431200 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981c067-7999-494f-8030-b7876dac3867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61353d94ed5b47bd8a220e9e6ece5e82)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:54.433210 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981c067-7999-494f-8030-b7876dac3867 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:54.482747 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-d981c067-7999-494f-8030-b7876dac3867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61353d94ed5b47bd8a220e9e6ece5e82'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:54.491390 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-d981c067-7999-494f-8030-b7876dac3867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61353d94ed5b47bd8a220e9e6ece5e82'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:54.491952 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-d981c067-7999-494f-8030-b7876dac3867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61353d94ed5b47bd8a220e9e6ece5e82'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:54.505064 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-d981c067-7999-494f-8030-b7876dac3867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61353d94ed5b47bd8a220e9e6ece5e82'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:54.505935 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-d981c067-7999-494f-8030-b7876dac3867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61353d94ed5b47bd8a220e9e6ece5e82'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:54.519749 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1310/2614] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:15:54 2022] DELETE /identity/v3/users/61353d94ed5b47bd8a220e9e6ece5e82 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:54.809345 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e888cdf-e1b3-493a-b4f8-a92d1fe984ee admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:54.811690 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0e888cdf-e1b3-493a-b4f8-a92d1fe984ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:54.833933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e888cdf-e1b3-493a-b4f8-a92d1fe984ee admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:54.895744 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3532706-4b02-498e-83db-97bd55bf904e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:54.896561 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3532706-4b02-498e-83db-97bd55bf904e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:54.896875 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3532706-4b02-498e-83db-97bd55bf904e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:54.897156 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3532706-4b02-498e-83db-97bd55bf904e admin admin] PATH_INFO: `/v3/projects/7b86fe4517134c77a553a1a7ef2bc913` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:54.898368 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3532706-4b02-498e-83db-97bd55bf904e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b86fe4517134c77a553a1a7ef2bc913)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:54.900370 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3532706-4b02-498e-83db-97bd55bf904e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:54.933784 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:54.953070 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a3532706-4b02-498e-83db-97bd55bf904e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b86fe4517134c77a553a1a7ef2bc913', 'request_id': 'req-a3532706-4b02-498e-83db-97bd55bf904e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:54.959368 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a3532706-4b02-498e-83db-97bd55bf904e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b86fe4517134c77a553a1a7ef2bc913', 'request_id': 'req-a3532706-4b02-498e-83db-97bd55bf904e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:54.964880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a3532706-4b02-498e-83db-97bd55bf904e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b86fe4517134c77a553a1a7ef2bc913', 'request_id': 'req-a3532706-4b02-498e-83db-97bd55bf904e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:54.977537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a3532706-4b02-498e-83db-97bd55bf904e admin admin] The token cache is being invalidate because project 7b86fe4517134c77a553a1a7ef2bc913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:15:54.978004 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a3532706-4b02-498e-83db-97bd55bf904e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:54.978571 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a3532706-4b02-498e-83db-97bd55bf904e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:54.980179 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1305/2615] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:15:54 2022] DELETE /identity/v3/projects/7b86fe4517134c77a553a1a7ef2bc913 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:54.985299 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344a474-4a25-49ee-a7ca-0b4bd37230cf None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:54.985796 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344a474-4a25-49ee-a7ca-0b4bd37230cf None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:54.985935 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344a474-4a25-49ee-a7ca-0b4bd37230cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:55.005907 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-d344a474-4a25-49ee-a7ca-0b4bd37230cf None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:55.007135 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-d344a474-4a25-49ee-a7ca-0b4bd37230cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:55.074528 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1311/2616] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:55.083375 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb23591-66ab-437d-9852-d4c96e76b94d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:55.083667 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb23591-66ab-437d-9852-d4c96e76b94d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:55.083949 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb23591-66ab-437d-9852-d4c96e76b94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:55.102581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-9eb23591-66ab-437d-9852-d4c96e76b94d None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:55.103927 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9eb23591-66ab-437d-9852-d4c96e76b94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:55.112213 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1306/2617] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:55.116473 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344a474-4a25-49ee-a7ca-0b4bd37230cf None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:55.126697 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344a474-4a25-49ee-a7ca-0b4bd37230cf None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:55.131277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60371ce7-b6c3-4381-bfb8-28400c447f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:55.131946 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60371ce7-b6c3-4381-bfb8-28400c447f15 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:55.132237 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60371ce7-b6c3-4381-bfb8-28400c447f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:55.132514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60371ce7-b6c3-4381-bfb8-28400c447f15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:55.133235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60371ce7-b6c3-4381-bfb8-28400c447f15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:15:55.133549 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60371ce7-b6c3-4381-bfb8-28400c447f15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:55.135265 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60371ce7-b6c3-4381-bfb8-28400c447f15 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:55.147496 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1312/2618] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:15:55.151832 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb23591-66ab-437d-9852-d4c96e76b94d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:55.161667 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb23591-66ab-437d-9852-d4c96e76b94d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:55.167246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a7449-996b-485d-a1a2-1930fb4f65f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:55.167948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a7449-996b-485d-a1a2-1930fb4f65f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:55.168240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a7449-996b-485d-a1a2-1930fb4f65f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:55.168522 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a7449-996b-485d-a1a2-1930fb4f65f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:55.169257 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a7449-996b-485d-a1a2-1930fb4f65f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:55.171230 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a7449-996b-485d-a1a2-1930fb4f65f6 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:55.197612 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1307/2619] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:15:55 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:15:55.201812 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60371ce7-b6c3-4381-bfb8-28400c447f15 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:55.211653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60371ce7-b6c3-4381-bfb8-28400c447f15 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:55.237411 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:55.271515 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499336e2-a2f6-4d25-a93d-e9fc3e04a3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:55.272184 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499336e2-a2f6-4d25-a93d-e9fc3e04a3df admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:55.272465 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499336e2-a2f6-4d25-a93d-e9fc3e04a3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:55.272739 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499336e2-a2f6-4d25-a93d-e9fc3e04a3df admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:55.273439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499336e2-a2f6-4d25-a93d-e9fc3e04a3df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:55.275383 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499336e2-a2f6-4d25-a93d-e9fc3e04a3df admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:55.295687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1313/2620] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:15:55 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:15:55.299615 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a7449-996b-485d-a1a2-1930fb4f65f6 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:55.310536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a7449-996b-485d-a1a2-1930fb4f65f6 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:55.315109 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c6a22-8bbd-4f3d-8221-67083d63828c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:55.315816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c6a22-8bbd-4f3d-8221-67083d63828c admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:55.316032 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c6a22-8bbd-4f3d-8221-67083d63828c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:55.316307 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c6a22-8bbd-4f3d-8221-67083d63828c admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:55.319938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c6a22-8bbd-4f3d-8221-67083d63828c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:55.319938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c6a22-8bbd-4f3d-8221-67083d63828c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:55.329637 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1308/2621] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:55.333779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499336e2-a2f6-4d25-a93d-e9fc3e04a3df admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:55.343851 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499336e2-a2f6-4d25-a93d-e9fc3e04a3df admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:55.348405 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc764f-70ac-4539-9805-951e191ab58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:55.349065 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc764f-70ac-4539-9805-951e191ab58c admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:55.349353 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc764f-70ac-4539-9805-951e191ab58c admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:55.349622 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc764f-70ac-4539-9805-951e191ab58c admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:55.352534 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc764f-70ac-4539-9805-951e191ab58c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:55.352534 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc764f-70ac-4539-9805-951e191ab58c admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:55.367805 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1314/2622] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:55.373315 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c6a22-8bbd-4f3d-8221-67083d63828c admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:55.393583 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c6a22-8bbd-4f3d-8221-67083d63828c admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:55.400767 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc37a03-cced-43c9-88ff-75f776106c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:55.401742 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc37a03-cced-43c9-88ff-75f776106c68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:55.402021 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc37a03-cced-43c9-88ff-75f776106c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:55.402310 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc37a03-cced-43c9-88ff-75f776106c68 admin admin] PATH_INFO: `/v3/projects/70d9984b8add4e7aa4e57904e4381b2a/users/ea6c35b5014943a1893471f98cfe32fb/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:55.403262 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc764f-70ac-4539-9805-951e191ab58c admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:55.405347 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-75cc764f-70ac-4539-9805-951e191ab58c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:55.423688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc37a03-cced-43c9-88ff-75f776106c68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70d9984b8add4e7aa4e57904e4381b2a, user_id=ea6c35b5014943a1893471f98cfe32fb, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:55.426404 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc37a03-cced-43c9-88ff-75f776106c68 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:55.440250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1309/2623] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:55 2022] PUT /identity/v3/projects/70d9984b8add4e7aa4e57904e4381b2a/users/ea6c35b5014943a1893471f98cfe32fb/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:55.450424 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61844990-5553-4c29-8155-92cb24c01105 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:55.450749 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61844990-5553-4c29-8155-92cb24c01105 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:55.451032 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61844990-5553-4c29-8155-92cb24c01105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:55.468858 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc764f-70ac-4539-9805-951e191ab58c admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:55.478094 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-61844990-5553-4c29-8155-92cb24c01105 None None] MFA Rules not processed for user `ea6c35b5014943a1893471f98cfe32fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:55.479883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-61844990-5553-4c29-8155-92cb24c01105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:55.527866 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c7e52-9ff2-458c-aa7b-ca437526f8ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:55.528492 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c7e52-9ff2-458c-aa7b-ca437526f8ee service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:55.528769 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c7e52-9ff2-458c-aa7b-ca437526f8ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:55.529145 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c7e52-9ff2-458c-aa7b-ca437526f8ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:55.531756 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-be9c7e52-9ff2-458c-aa7b-ca437526f8ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:55.554232 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1310/2624] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:15:55.560260 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61844990-5553-4c29-8155-92cb24c01105 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:55.597777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c7e52-9ff2-458c-aa7b-ca437526f8ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:55.599253 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c7e52-9ff2-458c-aa7b-ca437526f8ee service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:55.603661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:55.610461 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1315/2625] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:15:55.626202 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61844990-5553-4c29-8155-92cb24c01105 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:55.631043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c7916-d4a5-45f4-99a2-4b7ad35ec3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:55.631712 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c7916-d4a5-45f4-99a2-4b7ad35ec3a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:55.632002 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c7916-d4a5-45f4-99a2-4b7ad35ec3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:55.632283 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c7916-d4a5-45f4-99a2-4b7ad35ec3a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:55.633131 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c7916-d4a5-45f4-99a2-4b7ad35ec3a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:55.635148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c7916-d4a5-45f4-99a2-4b7ad35ec3a7 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:55.667432 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1311/2626] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:15:55 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:55.669289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c7e52-9ff2-458c-aa7b-ca437526f8ee service neutron] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:55.680310 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c7e52-9ff2-458c-aa7b-ca437526f8ee service neutron] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:55.707383 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:55.779766 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a3661-e5e9-4bf6-ac3e-f7dc240c6d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:55.780448 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a3661-e5e9-4bf6-ac3e-f7dc240c6d2f admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:55.780737 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a3661-e5e9-4bf6-ac3e-f7dc240c6d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:55.781021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a3661-e5e9-4bf6-ac3e-f7dc240c6d2f admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:55.781720 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a3661-e5e9-4bf6-ac3e-f7dc240c6d2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:55.783695 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a3661-e5e9-4bf6-ac3e-f7dc240c6d2f admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:55.804644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1316/2627] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:15:55 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:55.808664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c7916-d4a5-45f4-99a2-4b7ad35ec3a7 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:55.818899 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c7916-d4a5-45f4-99a2-4b7ad35ec3a7 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:55.824295 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca6421-7595-4cfb-8eb3-5af34a0c92bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:55.824974 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca6421-7595-4cfb-8eb3-5af34a0c92bb admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:55.825264 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca6421-7595-4cfb-8eb3-5af34a0c92bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:55.825542 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca6421-7595-4cfb-8eb3-5af34a0c92bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:55.826285 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca6421-7595-4cfb-8eb3-5af34a0c92bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:55.827933 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca6421-7595-4cfb-8eb3-5af34a0c92bb admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:55.840616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1312/2628] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:55.844880 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a3661-e5e9-4bf6-ac3e-f7dc240c6d2f admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:55.855664 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a3661-e5e9-4bf6-ac3e-f7dc240c6d2f admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:55.860347 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c3023-8714-44d3-a22e-d426f277ca4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:55.861238 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c3023-8714-44d3-a22e-d426f277ca4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:55.861523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c3023-8714-44d3-a22e-d426f277ca4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:55.861832 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c3023-8714-44d3-a22e-d426f277ca4c admin admin] PATH_INFO: `/v3/projects/e452a48266424950b29f0aa341a651e0/users/729f1e573bb14da7810a46cb014fee7c/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:55.877468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c3023-8714-44d3-a22e-d426f277ca4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e452a48266424950b29f0aa341a651e0, user_id=729f1e573bb14da7810a46cb014fee7c, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:55.880265 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c3023-8714-44d3-a22e-d426f277ca4c admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:55.896081 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1317/2629] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:55 2022] PUT /identity/v3/projects/e452a48266424950b29f0aa341a651e0/users/729f1e573bb14da7810a46cb014fee7c/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:55.900028 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca6421-7595-4cfb-8eb3-5af34a0c92bb admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:55.910899 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca6421-7595-4cfb-8eb3-5af34a0c92bb admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:55.967462 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4a624-a3aa-40b2-b7e3-51f923f6a9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:55.968131 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4a624-a3aa-40b2-b7e3-51f923f6a9bc admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:55.968416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4a624-a3aa-40b2-b7e3-51f923f6a9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:55.968690 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4a624-a3aa-40b2-b7e3-51f923f6a9bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:55.969410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4a624-a3aa-40b2-b7e3-51f923f6a9bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:55.971024 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4a624-a3aa-40b2-b7e3-51f923f6a9bc admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:55.984267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1313/2630] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:55.986009 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c3023-8714-44d3-a22e-d426f277ca4c admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:55.997381 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c3023-8714-44d3-a22e-d426f277ca4c admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:56.002872 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52ba65-0cae-43bb-944e-6667d53cf98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:56.003739 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52ba65-0cae-43bb-944e-6667d53cf98e admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:56.004021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52ba65-0cae-43bb-944e-6667d53cf98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:56.004378 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52ba65-0cae-43bb-944e-6667d53cf98e admin admin] PATH_INFO: `/v3/projects/e452a48266424950b29f0aa341a651e0/users/729f1e573bb14da7810a46cb014fee7c/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:56.006791 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52ba65-0cae-43bb-944e-6667d53cf98e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e452a48266424950b29f0aa341a651e0, user_id=729f1e573bb14da7810a46cb014fee7c, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:56.009427 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52ba65-0cae-43bb-944e-6667d53cf98e admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:56.020691 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1318/2631] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:55 2022] PUT /identity/v3/projects/e452a48266424950b29f0aa341a651e0/users/729f1e573bb14da7810a46cb014fee7c/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:56.035610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46a4ef-620b-4a05-b89e-ade83869fa9d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:56.035963 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46a4ef-620b-4a05-b89e-ade83869fa9d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:56.036177 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46a4ef-620b-4a05-b89e-ade83869fa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:56.069312 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-2a46a4ef-620b-4a05-b89e-ade83869fa9d None None] MFA Rules not processed for user `729f1e573bb14da7810a46cb014fee7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:56.070572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2a46a4ef-620b-4a05-b89e-ade83869fa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:56.143349 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1314/2632] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:56 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:56.155377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52ba65-0cae-43bb-944e-6667d53cf98e admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:56.157188 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-9a52ba65-0cae-43bb-944e-6667d53cf98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:56.217889 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52ba65-0cae-43bb-944e-6667d53cf98e admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:56.224382 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f4b14-34a6-4de9-be5d-7a1132a4fecc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:56.225063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f4b14-34a6-4de9-be5d-7a1132a4fecc service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:56.225359 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f4b14-34a6-4de9-be5d-7a1132a4fecc service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:56.225638 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f4b14-34a6-4de9-be5d-7a1132a4fecc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:56.235987 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f4b14-34a6-4de9-be5d-7a1132a4fecc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:56.237440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f4b14-34a6-4de9-be5d-7a1132a4fecc service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:56.247669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1319/2633] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:56 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:15:56.292054 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46a4ef-620b-4a05-b89e-ade83869fa9d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:56.293644 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2a46a4ef-620b-4a05-b89e-ade83869fa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:56.306479 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46a4ef-620b-4a05-b89e-ade83869fa9d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:56.310713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306732b-67a2-4dea-ba5e-fb869b4cbb08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:56.311459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306732b-67a2-4dea-ba5e-fb869b4cbb08 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:56.311808 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306732b-67a2-4dea-ba5e-fb869b4cbb08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:56.312158 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306732b-67a2-4dea-ba5e-fb869b4cbb08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:56.345076 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:56.374378 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306732b-67a2-4dea-ba5e-fb869b4cbb08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:56.375853 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306732b-67a2-4dea-ba5e-fb869b4cbb08 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:56.386240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1315/2634] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:15:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:15:58.967887 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f4b14-34a6-4de9-be5d-7a1132a4fecc service cinder] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:58.969828 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-1f2f4b14-34a6-4de9-be5d-7a1132a4fecc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:59.057464 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f4b14-34a6-4de9-be5d-7a1132a4fecc service cinder] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:59.062062 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70c005-7f35-4b14-89ab-560b09104baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:59.062966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70c005-7f35-4b14-89ab-560b09104baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:59.063246 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70c005-7f35-4b14-89ab-560b09104baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:59.063516 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70c005-7f35-4b14-89ab-560b09104baa admin admin] PATH_INFO: `/v3/users/5f89347016394f69bde41b3632e94c2d` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:59.064698 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70c005-7f35-4b14-89ab-560b09104baa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f89347016394f69bde41b3632e94c2d)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:59.069349 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70c005-7f35-4b14-89ab-560b09104baa admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:59.081579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:59.125969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ed70c005-7f35-4b14-89ab-560b09104baa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f89347016394f69bde41b3632e94c2d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:59.136019 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ed70c005-7f35-4b14-89ab-560b09104baa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f89347016394f69bde41b3632e94c2d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:59.136649 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ed70c005-7f35-4b14-89ab-560b09104baa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f89347016394f69bde41b3632e94c2d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:59.149927 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ed70c005-7f35-4b14-89ab-560b09104baa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f89347016394f69bde41b3632e94c2d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:59.151973 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-ed70c005-7f35-4b14-89ab-560b09104baa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f89347016394f69bde41b3632e94c2d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:59.165034 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1320/2635] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:15:58 2022] DELETE /identity/v3/users/5f89347016394f69bde41b3632e94c2d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:59.372819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306732b-67a2-4dea-ba5e-fb869b4cbb08 service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:59.396835 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306732b-67a2-4dea-ba5e-fb869b4cbb08 service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:59.468061 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a547e-f153-45bc-b3a6-641d3a165751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:59.468980 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a547e-f153-45bc-b3a6-641d3a165751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:59.469284 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a547e-f153-45bc-b3a6-641d3a165751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:59.469577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a547e-f153-45bc-b3a6-641d3a165751 admin admin] PATH_INFO: `/v3/projects/6e4f0562e3df456eb8709580315c84b1` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:59.470973 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a547e-f153-45bc-b3a6-641d3a165751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e4f0562e3df456eb8709580315c84b1)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:59.473148 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a547e-f153-45bc-b3a6-641d3a165751 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:59.526434 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6f3a547e-f153-45bc-b3a6-641d3a165751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e4f0562e3df456eb8709580315c84b1', 'request_id': 'req-6f3a547e-f153-45bc-b3a6-641d3a165751'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:59.535390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6f3a547e-f153-45bc-b3a6-641d3a165751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e4f0562e3df456eb8709580315c84b1', 'request_id': 'req-6f3a547e-f153-45bc-b3a6-641d3a165751'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:59.543199 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6f3a547e-f153-45bc-b3a6-641d3a165751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e4f0562e3df456eb8709580315c84b1', 'request_id': 'req-6f3a547e-f153-45bc-b3a6-641d3a165751'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:59.560296 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6f3a547e-f153-45bc-b3a6-641d3a165751 admin admin] The token cache is being invalidate because project 6e4f0562e3df456eb8709580315c84b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:15:59.560684 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6f3a547e-f153-45bc-b3a6-641d3a165751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:59.561490 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6f3a547e-f153-45bc-b3a6-641d3a165751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:15:59.563860 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1316/2636] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:15:59 2022] DELETE /identity/v3/projects/6e4f0562e3df456eb8709580315c84b1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:15:59.570656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d743a14-36d7-4571-8882-fadfc2bad97e None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:59.570656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d743a14-36d7-4571-8882-fadfc2bad97e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:59.570656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d743a14-36d7-4571-8882-fadfc2bad97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:59.589391 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-5d743a14-36d7-4571-8882-fadfc2bad97e None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:59.591097 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5d743a14-36d7-4571-8882-fadfc2bad97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:59.666962 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1321/2637] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:59.675313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc40fd-2cdf-460c-a90b-2d551e84f249 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:59.675764 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc40fd-2cdf-460c-a90b-2d551e84f249 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:59.676313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc40fd-2cdf-460c-a90b-2d551e84f249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:59.696061 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-75fc40fd-2cdf-460c-a90b-2d551e84f249 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:15:59.697310 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-75fc40fd-2cdf-460c-a90b-2d551e84f249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:59.705340 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1317/2638] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:15:59.709990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d743a14-36d7-4571-8882-fadfc2bad97e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:59.720124 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d743a14-36d7-4571-8882-fadfc2bad97e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:59.724701 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20f7a8-d4d9-45ce-851b-b3d8a462096b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:59.725365 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20f7a8-d4d9-45ce-851b-b3d8a462096b admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:59.725652 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20f7a8-d4d9-45ce-851b-b3d8a462096b admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:59.725945 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20f7a8-d4d9-45ce-851b-b3d8a462096b admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:59.726706 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20f7a8-d4d9-45ce-851b-b3d8a462096b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:15:59.727019 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20f7a8-d4d9-45ce-851b-b3d8a462096b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:59.734733 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20f7a8-d4d9-45ce-851b-b3d8a462096b admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:59.751196 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1322/2639] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:15:59.755485 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc40fd-2cdf-460c-a90b-2d551e84f249 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:59.765386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc40fd-2cdf-460c-a90b-2d551e84f249 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:59.770516 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c5cea-1d6a-489c-9eb6-17f8322cc4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:59.771192 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c5cea-1d6a-489c-9eb6-17f8322cc4a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:59.771483 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c5cea-1d6a-489c-9eb6-17f8322cc4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:59.771760 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c5cea-1d6a-489c-9eb6-17f8322cc4a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:59.772466 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c5cea-1d6a-489c-9eb6-17f8322cc4a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:59.774358 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c5cea-1d6a-489c-9eb6-17f8322cc4a8 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:59.805559 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1318/2640] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:15:59 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:59.807330 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20f7a8-d4d9-45ce-851b-b3d8a462096b admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:59.817698 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20f7a8-d4d9-45ce-851b-b3d8a462096b admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:59.887754 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383096d-8358-4877-8668-8d28e68f7fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:59.888592 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383096d-8358-4877-8668-8d28e68f7fce admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:59.888997 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383096d-8358-4877-8668-8d28e68f7fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:59.889290 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383096d-8358-4877-8668-8d28e68f7fce admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:59.890203 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383096d-8358-4877-8668-8d28e68f7fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:59.892806 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383096d-8358-4877-8668-8d28e68f7fce admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:59.917567 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1323/2641] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:15:59 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:15:59.921499 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c5cea-1d6a-489c-9eb6-17f8322cc4a8 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:59.933590 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c5cea-1d6a-489c-9eb6-17f8322cc4a8 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:59.935519 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383096d-8358-4877-8668-8d28e68f7fce admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:59.937377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a383096d-8358-4877-8668-8d28e68f7fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:15:59.938922 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a32d58-c888-45b6-b7bd-c70ed8911e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:59.939604 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a32d58-c888-45b6-b7bd-c70ed8911e01 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:59.939890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a32d58-c888-45b6-b7bd-c70ed8911e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:59.940168 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a32d58-c888-45b6-b7bd-c70ed8911e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:59.940900 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a32d58-c888-45b6-b7bd-c70ed8911e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:59.942539 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a32d58-c888-45b6-b7bd-c70ed8911e01 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:59.950136 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:15:59.958682 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1319/2642] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:59.958880 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383096d-8358-4877-8668-8d28e68f7fce admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:59.959848 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a32d58-c888-45b6-b7bd-c70ed8911e01 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:15:59.967553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96279770-cb3a-4a51-8810-800d073f7297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:59.968428 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96279770-cb3a-4a51-8810-800d073f7297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:59.968986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96279770-cb3a-4a51-8810-800d073f7297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:59.968986 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96279770-cb3a-4a51-8810-800d073f7297 admin admin] PATH_INFO: `/v3/users/ea6c35b5014943a1893471f98cfe32fb` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:59.970217 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96279770-cb3a-4a51-8810-800d073f7297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea6c35b5014943a1893471f98cfe32fb)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:59.971188 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a32d58-c888-45b6-b7bd-c70ed8911e01 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:15:59.972731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96279770-cb3a-4a51-8810-800d073f7297 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:59.977228 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca10fcf-df69-4dae-9bac-2808ce4eec53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:15:59.977888 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca10fcf-df69-4dae-9bac-2808ce4eec53 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:15:59.978169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca10fcf-df69-4dae-9bac-2808ce4eec53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:15:59.978985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca10fcf-df69-4dae-9bac-2808ce4eec53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:15:59.979713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca10fcf-df69-4dae-9bac-2808ce4eec53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:15:59.981291 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca10fcf-df69-4dae-9bac-2808ce4eec53 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:15:59.996241 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1320/2643] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:15:59.997363 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca10fcf-df69-4dae-9bac-2808ce4eec53 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:00.013328 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca10fcf-df69-4dae-9bac-2808ce4eec53 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:00.018180 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdfc60-dbad-407f-9048-4482048c45be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:00.019105 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdfc60-dbad-407f-9048-4482048c45be admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:00.019390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdfc60-dbad-407f-9048-4482048c45be admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:00.019670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdfc60-dbad-407f-9048-4482048c45be admin admin] PATH_INFO: `/v3/projects/37a7983351d145f693a7b56e4dbb926b/users/a8f5c3cfd52d4dd990fe6ea3b7aa5de9/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:00.029729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-96279770-cb3a-4a51-8810-800d073f7297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea6c35b5014943a1893471f98cfe32fb'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:00.034858 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:00.037391 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-96279770-cb3a-4a51-8810-800d073f7297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea6c35b5014943a1893471f98cfe32fb'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:00.038169 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-96279770-cb3a-4a51-8810-800d073f7297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea6c35b5014943a1893471f98cfe32fb'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:00.040744 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdfc60-dbad-407f-9048-4482048c45be admin admin] RBAC: Authorizing `identity:create_grant(project_id=37a7983351d145f693a7b56e4dbb926b, user_id=a8f5c3cfd52d4dd990fe6ea3b7aa5de9, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:00.044623 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdfc60-dbad-407f-9048-4482048c45be admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:00.052088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-96279770-cb3a-4a51-8810-800d073f7297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea6c35b5014943a1893471f98cfe32fb'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:00.053169 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-96279770-cb3a-4a51-8810-800d073f7297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea6c35b5014943a1893471f98cfe32fb'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:00.060315 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1321/2644] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:15:59 2022] PUT /identity/v3/projects/37a7983351d145f693a7b56e4dbb926b/users/a8f5c3cfd52d4dd990fe6ea3b7aa5de9/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:16:00.065492 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1324/2645] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:15:59 2022] DELETE /identity/v3/users/ea6c35b5014943a1893471f98cfe32fb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:00.069973 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb777c9-63ff-4edb-a69a-a36126c1b5d3 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:00.070269 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb777c9-63ff-4edb-a69a-a36126c1b5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:00.070577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb777c9-63ff-4edb-a69a-a36126c1b5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:00.070764 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9479b-260a-47e5-96c6-6611ad4a442b None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:00.071066 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9479b-260a-47e5-96c6-6611ad4a442b None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:00.072707 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9479b-260a-47e5-96c6-6611ad4a442b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:00.089262 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-dbb777c9-63ff-4edb-a69a-a36126c1b5d3 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:00.090468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-dbb777c9-63ff-4edb-a69a-a36126c1b5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:00.099884 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-78d9479b-260a-47e5-96c6-6611ad4a442b None None] MFA Rules not processed for user `a8f5c3cfd52d4dd990fe6ea3b7aa5de9`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:00.101256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-78d9479b-260a-47e5-96c6-6611ad4a442b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:00.158261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1322/2646] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:00.168947 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb777c9-63ff-4edb-a69a-a36126c1b5d3 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:00.170332 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-dbb777c9-63ff-4edb-a69a-a36126c1b5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:00.172385 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1325/2647] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:00.183054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9479b-260a-47e5-96c6-6611ad4a442b None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:00.184546 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-78d9479b-260a-47e5-96c6-6611ad4a442b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:00.229579 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb777c9-63ff-4edb-a69a-a36126c1b5d3 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:00.233649 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff94e88-ad34-46a4-b832-3e0f6244eb3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:00.234458 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff94e88-ad34-46a4-b832-3e0f6244eb3d service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:00.234844 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff94e88-ad34-46a4-b832-3e0f6244eb3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:00.235194 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff94e88-ad34-46a4-b832-3e0f6244eb3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:00.249643 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff94e88-ad34-46a4-b832-3e0f6244eb3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:00.251339 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff94e88-ad34-46a4-b832-3e0f6244eb3d service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:00.261548 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1323/2648] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:16:00.263210 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:00.268018 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9479b-260a-47e5-96c6-6611ad4a442b None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:00.275909 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78d14f-e8f5-4f69-9b97-f97446b55541 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:00.276795 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78d14f-e8f5-4f69-9b97-f97446b55541 service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:00.277259 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78d14f-e8f5-4f69-9b97-f97446b55541 service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:00.277824 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78d14f-e8f5-4f69-9b97-f97446b55541 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:00.287222 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78d14f-e8f5-4f69-9b97-f97446b55541 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:00.289087 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78d14f-e8f5-4f69-9b97-f97446b55541 service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:00.298967 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1326/2649] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:16:00.377421 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff94e88-ad34-46a4-b832-3e0f6244eb3d service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:00.380694 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2ff94e88-ad34-46a4-b832-3e0f6244eb3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:00.394237 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff94e88-ad34-46a4-b832-3e0f6244eb3d service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:00.399587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23958056-88d7-475f-b481-8e66d66c2e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:00.401134 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23958056-88d7-475f-b481-8e66d66c2e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:00.401325 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23958056-88d7-475f-b481-8e66d66c2e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:00.401584 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23958056-88d7-475f-b481-8e66d66c2e69 admin admin] PATH_INFO: `/v3/users/3d3b33014eac48f8911119e8b8966558` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:00.403207 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23958056-88d7-475f-b481-8e66d66c2e69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d3b33014eac48f8911119e8b8966558)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:00.405149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23958056-88d7-475f-b481-8e66d66c2e69 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:00.488610 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-23958056-88d7-475f-b481-8e66d66c2e69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d3b33014eac48f8911119e8b8966558'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:00.497180 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-23958056-88d7-475f-b481-8e66d66c2e69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d3b33014eac48f8911119e8b8966558'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:00.514390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-23958056-88d7-475f-b481-8e66d66c2e69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d3b33014eac48f8911119e8b8966558'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:00.538996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-23958056-88d7-475f-b481-8e66d66c2e69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d3b33014eac48f8911119e8b8966558'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:00.539921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-23958056-88d7-475f-b481-8e66d66c2e69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d3b33014eac48f8911119e8b8966558'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:00.549884 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1324/2650] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:16:00 2022] DELETE /identity/v3/users/3d3b33014eac48f8911119e8b8966558 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:00.554290 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17384761-b259-4836-a6a7-8ba626932b25 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:00.554728 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17384761-b259-4836-a6a7-8ba626932b25 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:00.554936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17384761-b259-4836-a6a7-8ba626932b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:00.571548 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23958056-88d7-475f-b481-8e66d66c2e69 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:00.573865 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-23958056-88d7-475f-b481-8e66d66c2e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:00.579017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-17384761-b259-4836-a6a7-8ba626932b25 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:00.583093 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:00.585851 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-17384761-b259-4836-a6a7-8ba626932b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:00.680920 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1327/2651] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:16:00.686078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23958056-88d7-475f-b481-8e66d66c2e69 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:00.691954 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17384761-b259-4836-a6a7-8ba626932b25 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:00.693044 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bb52d-a549-4613-9061-57868419fee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:00.693781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-17384761-b259-4836-a6a7-8ba626932b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:00.694613 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bb52d-a549-4613-9061-57868419fee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:00.695124 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bb52d-a549-4613-9061-57868419fee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:00.695557 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bb52d-a549-4613-9061-57868419fee3 admin admin] PATH_INFO: `/v3/projects/70d9984b8add4e7aa4e57904e4381b2a` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:00.698714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bb52d-a549-4613-9061-57868419fee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70d9984b8add4e7aa4e57904e4381b2a)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:00.702574 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bb52d-a549-4613-9061-57868419fee3 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:00.787116 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17384761-b259-4836-a6a7-8ba626932b25 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:00.794742 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-769bb52d-a549-4613-9061-57868419fee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70d9984b8add4e7aa4e57904e4381b2a', 'request_id': 'req-769bb52d-a549-4613-9061-57868419fee3'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:00.808041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-769bb52d-a549-4613-9061-57868419fee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70d9984b8add4e7aa4e57904e4381b2a', 'request_id': 'req-769bb52d-a549-4613-9061-57868419fee3'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:00.815508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-769bb52d-a549-4613-9061-57868419fee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70d9984b8add4e7aa4e57904e4381b2a', 'request_id': 'req-769bb52d-a549-4613-9061-57868419fee3'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:00.828852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-769bb52d-a549-4613-9061-57868419fee3 admin admin] The token cache is being invalidate because project 70d9984b8add4e7aa4e57904e4381b2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:16:00.829146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-769bb52d-a549-4613-9061-57868419fee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:00.830922 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-769bb52d-a549-4613-9061-57868419fee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:00.832649 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1325/2652] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:16:00 2022] DELETE /identity/v3/projects/70d9984b8add4e7aa4e57904e4381b2a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:00.836598 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bb52d-a549-4613-9061-57868419fee3 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:00.838164 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-769bb52d-a549-4613-9061-57868419fee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:00.840230 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b039ed-2d6a-4254-ba4d-043d3d8b6096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:00.840884 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b039ed-2d6a-4254-ba4d-043d3d8b6096 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:00.841171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b039ed-2d6a-4254-ba4d-043d3d8b6096 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:00.841481 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b039ed-2d6a-4254-ba4d-043d3d8b6096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:00.843276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-45b039ed-2d6a-4254-ba4d-043d3d8b6096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:00.904583 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bb52d-a549-4613-9061-57868419fee3 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:00.907310 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b039ed-2d6a-4254-ba4d-043d3d8b6096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:00.908791 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b039ed-2d6a-4254-ba4d-043d3d8b6096 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:00.909805 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339318fb-b866-4de3-9a54-e03935596569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:00.910563 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339318fb-b866-4de3-9a54-e03935596569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:00.910854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339318fb-b866-4de3-9a54-e03935596569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:00.911131 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339318fb-b866-4de3-9a54-e03935596569 admin admin] PATH_INFO: `/v3/users/729f1e573bb14da7810a46cb014fee7c` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:00.912379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339318fb-b866-4de3-9a54-e03935596569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=729f1e573bb14da7810a46cb014fee7c)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:00.912761 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:00.915262 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339318fb-b866-4de3-9a54-e03935596569 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:00.920437 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1328/2653] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:16:00.955174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:00.966252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-339318fb-b866-4de3-9a54-e03935596569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '729f1e573bb14da7810a46cb014fee7c'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:00.974698 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-339318fb-b866-4de3-9a54-e03935596569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '729f1e573bb14da7810a46cb014fee7c'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:00.983226 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-339318fb-b866-4de3-9a54-e03935596569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '729f1e573bb14da7810a46cb014fee7c'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:00.995747 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-339318fb-b866-4de3-9a54-e03935596569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '729f1e573bb14da7810a46cb014fee7c'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:00.996525 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-339318fb-b866-4de3-9a54-e03935596569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '729f1e573bb14da7810a46cb014fee7c'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:01.003506 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1326/2654] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:16:00 2022] DELETE /identity/v3/users/729f1e573bb14da7810a46cb014fee7c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:01.284612 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b039ed-2d6a-4254-ba4d-043d3d8b6096 service neutron] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:01.286323 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-45b039ed-2d6a-4254-ba4d-043d3d8b6096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:01.300595 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b039ed-2d6a-4254-ba4d-043d3d8b6096 service neutron] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:01.364156 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d9ffc-3970-4278-8f1a-8fbb84c0d955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:01.365301 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d9ffc-3970-4278-8f1a-8fbb84c0d955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:01.365660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d9ffc-3970-4278-8f1a-8fbb84c0d955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:01.365987 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d9ffc-3970-4278-8f1a-8fbb84c0d955 admin admin] PATH_INFO: `/v3/projects/24d770d26af64529b8ada0639c7e1bdd` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:01.367319 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d9ffc-3970-4278-8f1a-8fbb84c0d955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d770d26af64529b8ada0639c7e1bdd)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:01.370138 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d9ffc-3970-4278-8f1a-8fbb84c0d955 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:01.378782 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339318fb-b866-4de3-9a54-e03935596569 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:01.380325 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-339318fb-b866-4de3-9a54-e03935596569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:01.396171 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339318fb-b866-4de3-9a54-e03935596569 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:01.401451 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72940e2-a9d2-4fb0-aadc-2a37b8b4324d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:01.402358 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72940e2-a9d2-4fb0-aadc-2a37b8b4324d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:01.402679 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72940e2-a9d2-4fb0-aadc-2a37b8b4324d admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:01.402991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72940e2-a9d2-4fb0-aadc-2a37b8b4324d admin admin] PATH_INFO: `/v3/projects/e452a48266424950b29f0aa341a651e0` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:01.404342 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72940e2-a9d2-4fb0-aadc-2a37b8b4324d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e452a48266424950b29f0aa341a651e0)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:01.406351 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72940e2-a9d2-4fb0-aadc-2a37b8b4324d admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:01.426326 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-6b7d9ffc-3970-4278-8f1a-8fbb84c0d955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d770d26af64529b8ada0639c7e1bdd', 'request_id': 'req-6b7d9ffc-3970-4278-8f1a-8fbb84c0d955'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:01.433261 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-6b7d9ffc-3970-4278-8f1a-8fbb84c0d955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d770d26af64529b8ada0639c7e1bdd', 'request_id': 'req-6b7d9ffc-3970-4278-8f1a-8fbb84c0d955'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:01.440382 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-6b7d9ffc-3970-4278-8f1a-8fbb84c0d955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d770d26af64529b8ada0639c7e1bdd', 'request_id': 'req-6b7d9ffc-3970-4278-8f1a-8fbb84c0d955'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:01.454125 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-6b7d9ffc-3970-4278-8f1a-8fbb84c0d955 admin admin] The token cache is being invalidate because project 24d770d26af64529b8ada0639c7e1bdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:16:01.454414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-6b7d9ffc-3970-4278-8f1a-8fbb84c0d955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:01.455069 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-6b7d9ffc-3970-4278-8f1a-8fbb84c0d955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:01.456898 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1329/2655] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:16:01 2022] DELETE /identity/v3/projects/24d770d26af64529b8ada0639c7e1bdd => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:01.461381 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c999c-3dab-4472-9b81-13a15944334b None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:01.461664 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c999c-3dab-4472-9b81-13a15944334b None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:01.461942 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c999c-3dab-4472-9b81-13a15944334b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:01.464575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a72940e2-a9d2-4fb0-aadc-2a37b8b4324d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e452a48266424950b29f0aa341a651e0', 'request_id': 'req-a72940e2-a9d2-4fb0-aadc-2a37b8b4324d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:01.472432 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a72940e2-a9d2-4fb0-aadc-2a37b8b4324d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e452a48266424950b29f0aa341a651e0', 'request_id': 'req-a72940e2-a9d2-4fb0-aadc-2a37b8b4324d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:01.479567 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a72940e2-a9d2-4fb0-aadc-2a37b8b4324d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e452a48266424950b29f0aa341a651e0', 'request_id': 'req-a72940e2-a9d2-4fb0-aadc-2a37b8b4324d'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:01.485652 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-eb4c999c-3dab-4472-9b81-13a15944334b None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:01.487185 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-eb4c999c-3dab-4472-9b81-13a15944334b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:01.494733 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a72940e2-a9d2-4fb0-aadc-2a37b8b4324d admin admin] The token cache is being invalidate because project e452a48266424950b29f0aa341a651e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:16:01.495033 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a72940e2-a9d2-4fb0-aadc-2a37b8b4324d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:01.495692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-a72940e2-a9d2-4fb0-aadc-2a37b8b4324d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:01.497245 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1327/2656] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:16:01 2022] DELETE /identity/v3/projects/e452a48266424950b29f0aa341a651e0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:01.502750 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b5e27-d9e6-4e2a-a446-841a23954f48 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:01.503053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b5e27-d9e6-4e2a-a446-841a23954f48 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:01.503428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b5e27-d9e6-4e2a-a446-841a23954f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:01.523400 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3f8b5e27-d9e6-4e2a-a446-841a23954f48 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:01.525201 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3f8b5e27-d9e6-4e2a-a446-841a23954f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:01.555244 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1330/2657] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:16:01.564039 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf678c1-e980-4337-933f-ee315ee44cab None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:01.564515 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf678c1-e980-4337-933f-ee315ee44cab None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:01.564870 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf678c1-e980-4337-933f-ee315ee44cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:01.584229 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-4cf678c1-e980-4337-933f-ee315ee44cab None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:01.585445 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-4cf678c1-e980-4337-933f-ee315ee44cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:01.596442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1328/2658] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:16:01.597011 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1331/2659] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:16:01.602952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b5e27-d9e6-4e2a-a446-841a23954f48 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:01.608848 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99466c0d-e9ea-4e7b-92f4-c27f96ad589b None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:01.609393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99466c0d-e9ea-4e7b-92f4-c27f96ad589b None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:01.609702 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99466c0d-e9ea-4e7b-92f4-c27f96ad589b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:01.614071 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b5e27-d9e6-4e2a-a446-841a23954f48 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:01.618863 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d655b6-8f9f-4af8-93a5-d8b19aa53546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:01.620032 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d655b6-8f9f-4af8-93a5-d8b19aa53546 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:01.620317 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d655b6-8f9f-4af8-93a5-d8b19aa53546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:01.620589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d655b6-8f9f-4af8-93a5-d8b19aa53546 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:01.621320 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d655b6-8f9f-4af8-93a5-d8b19aa53546 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:16:01.621752 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d655b6-8f9f-4af8-93a5-d8b19aa53546 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:01.623383 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d655b6-8f9f-4af8-93a5-d8b19aa53546 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:01.629878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-99466c0d-e9ea-4e7b-92f4-c27f96ad589b None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:01.631112 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-99466c0d-e9ea-4e7b-92f4-c27f96ad589b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:01.641518 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1329/2660] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:16:01.641748 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1332/2661] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:01.642589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d655b6-8f9f-4af8-93a5-d8b19aa53546 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:01.644960 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99466c0d-e9ea-4e7b-92f4-c27f96ad589b None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:01.653302 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d655b6-8f9f-4af8-93a5-d8b19aa53546 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:01.653931 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99466c0d-e9ea-4e7b-92f4-c27f96ad589b None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:01.658416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d90bb-9456-4a74-938f-68bcbc07c07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:01.658607 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96515cc6-431d-4941-b3e9-3adb59f98688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:01.659106 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d90bb-9456-4a74-938f-68bcbc07c07c admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:01.659211 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96515cc6-431d-4941-b3e9-3adb59f98688 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:01.659396 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d90bb-9456-4a74-938f-68bcbc07c07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:01.659508 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96515cc6-431d-4941-b3e9-3adb59f98688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:01.659673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d90bb-9456-4a74-938f-68bcbc07c07c admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:01.659774 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96515cc6-431d-4941-b3e9-3adb59f98688 admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:01.660374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d90bb-9456-4a74-938f-68bcbc07c07c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:01.660497 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96515cc6-431d-4941-b3e9-3adb59f98688 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:16:01.660754 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96515cc6-431d-4941-b3e9-3adb59f98688 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:01.662269 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d90bb-9456-4a74-938f-68bcbc07c07c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:01.662374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96515cc6-431d-4941-b3e9-3adb59f98688 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:01.674928 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1333/2662] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:16:01.679208 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96515cc6-431d-4941-b3e9-3adb59f98688 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:01.685054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:01.691282 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96515cc6-431d-4941-b3e9-3adb59f98688 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:01.695366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1330/2663] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:16:01 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:16:01.700654 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d90bb-9456-4a74-938f-68bcbc07c07c admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:01.705374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:01.768352 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322d9d1-3ffb-41ae-900b-2d07922c01d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:01.769020 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322d9d1-3ffb-41ae-900b-2d07922c01d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:01.769301 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322d9d1-3ffb-41ae-900b-2d07922c01d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:01.769573 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322d9d1-3ffb-41ae-900b-2d07922c01d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:01.770338 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322d9d1-3ffb-41ae-900b-2d07922c01d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:01.772264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322d9d1-3ffb-41ae-900b-2d07922c01d4 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:01.780421 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d90bb-9456-4a74-938f-68bcbc07c07c admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:01.790541 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0987fc-6199-433c-a046-486b4739f8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:01.790541 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0987fc-6199-433c-a046-486b4739f8ff admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:01.790541 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0987fc-6199-433c-a046-486b4739f8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:01.790541 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0987fc-6199-433c-a046-486b4739f8ff admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:01.790978 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0987fc-6199-433c-a046-486b4739f8ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:01.791260 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0987fc-6199-433c-a046-486b4739f8ff admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:01.800613 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1334/2664] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:16:01 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:16:01.805173 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322d9d1-3ffb-41ae-900b-2d07922c01d4 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:01.818748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1331/2665] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:16:01 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:16:01.819754 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0987fc-6199-433c-a046-486b4739f8ff admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:01.831155 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0987fc-6199-433c-a046-486b4739f8ff admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:01.888492 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322d9d1-3ffb-41ae-900b-2d07922c01d4 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:01.891743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd382f-4164-4a5b-89d5-12c9936f8bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:01.892451 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd382f-4164-4a5b-89d5-12c9936f8bec admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:01.892713 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd382f-4164-4a5b-89d5-12c9936f8bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:01.892991 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd382f-4164-4a5b-89d5-12c9936f8bec admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:01.893964 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd382f-4164-4a5b-89d5-12c9936f8bec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:01.895658 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd382f-4164-4a5b-89d5-12c9936f8bec admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:01.903634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21e2ca-bd9d-4bf2-9c39-ef957615ef09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:01.904325 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21e2ca-bd9d-4bf2-9c39-ef957615ef09 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:01.904601 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21e2ca-bd9d-4bf2-9c39-ef957615ef09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:01.905116 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21e2ca-bd9d-4bf2-9c39-ef957615ef09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:01.905703 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21e2ca-bd9d-4bf2-9c39-ef957615ef09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:01.907522 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21e2ca-bd9d-4bf2-9c39-ef957615ef09 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:01.921829 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1332/2666] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:16:01.922027 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1335/2667] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:16:01 2022] POST /identity/v3/users => generated 286 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:16:01.923191 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21e2ca-bd9d-4bf2-9c39-ef957615ef09 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:01.923696 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd382f-4164-4a5b-89d5-12c9936f8bec admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:01.934880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21e2ca-bd9d-4bf2-9c39-ef957615ef09 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:01.936902 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd382f-4164-4a5b-89d5-12c9936f8bec admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:01.939550 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f5260-9608-4b73-8558-b01340534971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:01.940224 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f5260-9608-4b73-8558-b01340534971 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:01.940510 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f5260-9608-4b73-8558-b01340534971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:01.940789 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f5260-9608-4b73-8558-b01340534971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:01.941517 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f5260-9608-4b73-8558-b01340534971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:01.943119 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f5260-9608-4b73-8558-b01340534971 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:01.944284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4ecb0-61be-42a6-bbc9-394d1a3b2ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:01.945119 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4ecb0-61be-42a6-bbc9-394d1a3b2ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:01.945404 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4ecb0-61be-42a6-bbc9-394d1a3b2ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:01.945688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4ecb0-61be-42a6-bbc9-394d1a3b2ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:01.946651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4ecb0-61be-42a6-bbc9-394d1a3b2ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:01.948331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4ecb0-61be-42a6-bbc9-394d1a3b2ab6 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:01.963238 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1333/2668] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:16:01.963424 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1336/2669] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:16:01.967602 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f5260-9608-4b73-8558-b01340534971 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:01.969088 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4ecb0-61be-42a6-bbc9-394d1a3b2ab6 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:01.980819 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4ecb0-61be-42a6-bbc9-394d1a3b2ab6 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:01.981681 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f5260-9608-4b73-8558-b01340534971 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:01.985813 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa54f6-6bca-4132-8b27-7f920eb6f4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:01.986804 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa54f6-6bca-4132-8b27-7f920eb6f4ff admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:01.987182 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92cc2a-3fb7-4882-9ee7-bd1bc3991129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:01.987535 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa54f6-6bca-4132-8b27-7f920eb6f4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:01.988016 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa54f6-6bca-4132-8b27-7f920eb6f4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:01.988130 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92cc2a-3fb7-4882-9ee7-bd1bc3991129 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:01.988352 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92cc2a-3fb7-4882-9ee7-bd1bc3991129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:01.988634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92cc2a-3fb7-4882-9ee7-bd1bc3991129 admin admin] PATH_INFO: `/v3/projects/7787878875b74437b2f061d0e0b1cdab/users/3507fe4fda41401dbe6019e5ac86e241/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:01.989431 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa54f6-6bca-4132-8b27-7f920eb6f4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:01.991560 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa54f6-6bca-4132-8b27-7f920eb6f4ff admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:02.005628 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92cc2a-3fb7-4882-9ee7-bd1bc3991129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7787878875b74437b2f061d0e0b1cdab, user_id=3507fe4fda41401dbe6019e5ac86e241, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:02.008444 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92cc2a-3fb7-4882-9ee7-bd1bc3991129 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:02.010897 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1337/2670] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:16:02.018980 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa54f6-6bca-4132-8b27-7f920eb6f4ff admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:02.031444 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1334/2671] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:16:01 2022] PUT /identity/v3/projects/7787878875b74437b2f061d0e0b1cdab/users/3507fe4fda41401dbe6019e5ac86e241/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:16:02.036773 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4efb1-53ff-4ee0-9130-3584a476b029 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:02.037064 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4efb1-53ff-4ee0-9130-3584a476b029 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:02.037500 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4efb1-53ff-4ee0-9130-3584a476b029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:02.039092 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa54f6-6bca-4132-8b27-7f920eb6f4ff admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:02.063389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-2aa4efb1-53ff-4ee0-9130-3584a476b029 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:02.064599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2aa4efb1-53ff-4ee0-9130-3584a476b029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:02.096682 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:02.108100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb96933-58be-42a9-a501-0dd01b25b1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:02.109295 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb96933-58be-42a9-a501-0dd01b25b1f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:02.109630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb96933-58be-42a9-a501-0dd01b25b1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:02.110043 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb96933-58be-42a9-a501-0dd01b25b1f2 admin admin] PATH_INFO: `/v3/projects/5723277a78a24bbca9afb2c99ac2a675/users/bb525b2f61814d56aa16841501ea4d68/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:02.127361 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:02.131623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb96933-58be-42a9-a501-0dd01b25b1f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5723277a78a24bbca9afb2c99ac2a675, user_id=bb525b2f61814d56aa16841501ea4d68, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:02.134288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb96933-58be-42a9-a501-0dd01b25b1f2 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:02.141384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1335/2672] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:16:02.151013 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4efb1-53ff-4ee0-9130-3584a476b029 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:02.151292 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1338/2673] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:16:02 2022] PUT /identity/v3/projects/5723277a78a24bbca9afb2c99ac2a675/users/bb525b2f61814d56aa16841501ea4d68/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:02.152468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2aa4efb1-53ff-4ee0-9130-3584a476b029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:02.162864 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed359b0c-e1e8-47b3-ac2b-39344c63fdd1 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:02.163155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed359b0c-e1e8-47b3-ac2b-39344c63fdd1 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:02.163524 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed359b0c-e1e8-47b3-ac2b-39344c63fdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:02.191312 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-ed359b0c-e1e8-47b3-ac2b-39344c63fdd1 None None] MFA Rules not processed for user `bb525b2f61814d56aa16841501ea4d68`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:02.192546 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ed359b0c-e1e8-47b3-ac2b-39344c63fdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:02.212299 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4efb1-53ff-4ee0-9130-3584a476b029 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:02.264250 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1339/2674] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:02.269906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9120501-e0a6-4e29-afeb-c0b5c102a9dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:02.270649 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9120501-e0a6-4e29-afeb-c0b5c102a9dc service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:02.270808 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9120501-e0a6-4e29-afeb-c0b5c102a9dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:02.271083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9120501-e0a6-4e29-afeb-c0b5c102a9dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:02.277093 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed359b0c-e1e8-47b3-ac2b-39344c63fdd1 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:02.278722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ed359b0c-e1e8-47b3-ac2b-39344c63fdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:02.339429 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed359b0c-e1e8-47b3-ac2b-39344c63fdd1 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:02.341238 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9120501-e0a6-4e29-afeb-c0b5c102a9dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:02.342716 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9120501-e0a6-4e29-afeb-c0b5c102a9dc service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:02.343011 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee0536-d893-46ea-94ae-b3cdd25834e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:02.343653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee0536-d893-46ea-94ae-b3cdd25834e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:02.343936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee0536-d893-46ea-94ae-b3cdd25834e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:02.344210 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee0536-d893-46ea-94ae-b3cdd25834e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:02.352516 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1336/2675] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:16:02.354543 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee0536-d893-46ea-94ae-b3cdd25834e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:02.356787 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee0536-d893-46ea-94ae-b3cdd25834e2 service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:02.367415 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1340/2676] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:16:02.386928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9120501-e0a6-4e29-afeb-c0b5c102a9dc service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:02.396850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9120501-e0a6-4e29-afeb-c0b5c102a9dc service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:02.402895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110ca9d-4c27-43a7-ab87-e538335b6d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:02.403824 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110ca9d-4c27-43a7-ab87-e538335b6d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:02.404108 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110ca9d-4c27-43a7-ab87-e538335b6d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:02.404390 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110ca9d-4c27-43a7-ab87-e538335b6d2a admin admin] PATH_INFO: `/v3/users/bb525b2f61814d56aa16841501ea4d68` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:02.405613 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110ca9d-4c27-43a7-ab87-e538335b6d2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb525b2f61814d56aa16841501ea4d68)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:02.407616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110ca9d-4c27-43a7-ab87-e538335b6d2a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:02.463528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6110ca9d-4c27-43a7-ab87-e538335b6d2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb525b2f61814d56aa16841501ea4d68'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:02.471809 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6110ca9d-4c27-43a7-ab87-e538335b6d2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb525b2f61814d56aa16841501ea4d68'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:02.474038 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:02.482862 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6110ca9d-4c27-43a7-ab87-e538335b6d2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb525b2f61814d56aa16841501ea4d68'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:02.496551 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6110ca9d-4c27-43a7-ab87-e538335b6d2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb525b2f61814d56aa16841501ea4d68'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:02.497352 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-6110ca9d-4c27-43a7-ab87-e538335b6d2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb525b2f61814d56aa16841501ea4d68'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:02.507952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1337/2677] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:16:02 2022] DELETE /identity/v3/users/bb525b2f61814d56aa16841501ea4d68 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:02.512324 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d689f9-9a2e-43ba-b60b-141ea0aaee25 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:02.512614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d689f9-9a2e-43ba-b60b-141ea0aaee25 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:02.512879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d689f9-9a2e-43ba-b60b-141ea0aaee25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:02.533662 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-f2d689f9-9a2e-43ba-b60b-141ea0aaee25 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:02.534916 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-f2d689f9-9a2e-43ba-b60b-141ea0aaee25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:02.600198 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1341/2678] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:02.612266 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110ca9d-4c27-43a7-ab87-e538335b6d2a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:02.615554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6110ca9d-4c27-43a7-ab87-e538335b6d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:02.688479 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110ca9d-4c27-43a7-ab87-e538335b6d2a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:02.692670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab1bc2-ad8b-43cd-9f84-c504e1964798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:02.693416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab1bc2-ad8b-43cd-9f84-c504e1964798 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:02.693780 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab1bc2-ad8b-43cd-9f84-c504e1964798 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:02.694152 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab1bc2-ad8b-43cd-9f84-c504e1964798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:02.705420 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab1bc2-ad8b-43cd-9f84-c504e1964798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:02.707071 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab1bc2-ad8b-43cd-9f84-c504e1964798 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:02.722208 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1338/2679] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:16:03.144065 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fc6b0-72d6-46c2-ba83-e8b15a9b4ad4 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:03.144709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fc6b0-72d6-46c2-ba83-e8b15a9b4ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:03.144709 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fc6b0-72d6-46c2-ba83-e8b15a9b4ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:03.183754 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab1bc2-ad8b-43cd-9f84-c504e1964798 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:03.183754 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1bab1bc2-ad8b-43cd-9f84-c504e1964798 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:03.184071 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:03.194961 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-ca0fc6b0-72d6-46c2-ba83-e8b15a9b4ad4 None None] MFA Rules not processed for user `3507fe4fda41401dbe6019e5ac86e241`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:03.196901 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ca0fc6b0-72d6-46c2-ba83-e8b15a9b4ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:03.206058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab1bc2-ad8b-43cd-9f84-c504e1964798 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:03.219447 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507ca7e-0308-44ea-8819-3203788b770a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:03.220468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507ca7e-0308-44ea-8819-3203788b770a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:03.220790 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507ca7e-0308-44ea-8819-3203788b770a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:03.221071 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507ca7e-0308-44ea-8819-3203788b770a admin admin] PATH_INFO: `/v3/users/a8f5c3cfd52d4dd990fe6ea3b7aa5de9` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:03.222391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507ca7e-0308-44ea-8819-3203788b770a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8f5c3cfd52d4dd990fe6ea3b7aa5de9)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:03.224399 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507ca7e-0308-44ea-8819-3203788b770a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:03.292362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2507ca7e-0308-44ea-8819-3203788b770a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8f5c3cfd52d4dd990fe6ea3b7aa5de9'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:03.303104 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2507ca7e-0308-44ea-8819-3203788b770a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8f5c3cfd52d4dd990fe6ea3b7aa5de9'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:03.305491 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1342/2680] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:03.306366 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fc6b0-72d6-46c2-ba83-e8b15a9b4ad4 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:03.308195 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ca0fc6b0-72d6-46c2-ba83-e8b15a9b4ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:03.316150 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2507ca7e-0308-44ea-8819-3203788b770a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8f5c3cfd52d4dd990fe6ea3b7aa5de9'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:03.329659 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2507ca7e-0308-44ea-8819-3203788b770a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8f5c3cfd52d4dd990fe6ea3b7aa5de9'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:03.330384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-2507ca7e-0308-44ea-8819-3203788b770a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8f5c3cfd52d4dd990fe6ea3b7aa5de9'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:03.332083 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fc6b0-72d6-46c2-ba83-e8b15a9b4ad4 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:03.337641 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1339/2681] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:16:03 2022] DELETE /identity/v3/users/a8f5c3cfd52d4dd990fe6ea3b7aa5de9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:03.338810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507ca7e-0308-44ea-8819-3203788b770a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:03.340163 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2507ca7e-0308-44ea-8819-3203788b770a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:03.342297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257e187-35b2-43f2-8e9b-37993714c5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:03.345221 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257e187-35b2-43f2-8e9b-37993714c5e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:03.345527 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257e187-35b2-43f2-8e9b-37993714c5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:03.345778 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257e187-35b2-43f2-8e9b-37993714c5e6 admin admin] PATH_INFO: `/v3/projects/5723277a78a24bbca9afb2c99ac2a675` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:03.347147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257e187-35b2-43f2-8e9b-37993714c5e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5723277a78a24bbca9afb2c99ac2a675)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:03.349072 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257e187-35b2-43f2-8e9b-37993714c5e6 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:03.400128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:03.407264 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507ca7e-0308-44ea-8819-3203788b770a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:03.408586 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1257e187-35b2-43f2-8e9b-37993714c5e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5723277a78a24bbca9afb2c99ac2a675', 'request_id': 'req-1257e187-35b2-43f2-8e9b-37993714c5e6'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:03.416033 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1257e187-35b2-43f2-8e9b-37993714c5e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5723277a78a24bbca9afb2c99ac2a675', 'request_id': 'req-1257e187-35b2-43f2-8e9b-37993714c5e6'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:03.421748 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1257e187-35b2-43f2-8e9b-37993714c5e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5723277a78a24bbca9afb2c99ac2a675', 'request_id': 'req-1257e187-35b2-43f2-8e9b-37993714c5e6'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:03.434767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1257e187-35b2-43f2-8e9b-37993714c5e6 admin admin] The token cache is being invalidate because project 5723277a78a24bbca9afb2c99ac2a675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:16:03.435058 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1257e187-35b2-43f2-8e9b-37993714c5e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:03.435712 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1257e187-35b2-43f2-8e9b-37993714c5e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:03.437238 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1343/2682] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:16:03 2022] DELETE /identity/v3/projects/5723277a78a24bbca9afb2c99ac2a675 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:03.438952 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27963166-e877-482a-b2c8-68ad8a02c042 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:03.439259 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27963166-e877-482a-b2c8-68ad8a02c042 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:03.439722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27963166-e877-482a-b2c8-68ad8a02c042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:03.458219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-27963166-e877-482a-b2c8-68ad8a02c042 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:03.459462 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-27963166-e877-482a-b2c8-68ad8a02c042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:03.466877 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407eb8a-0e12-4d70-b299-5b45fd2aa752 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:03.467537 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407eb8a-0e12-4d70-b299-5b45fd2aa752 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:03.467826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407eb8a-0e12-4d70-b299-5b45fd2aa752 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:03.468104 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407eb8a-0e12-4d70-b299-5b45fd2aa752 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:03.470617 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6407eb8a-0e12-4d70-b299-5b45fd2aa752 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:03.531332 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1344/2683] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:03.532760 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d17b04-e3fd-43dc-b0b9-7a4097224424 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:03.533054 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d17b04-e3fd-43dc-b0b9-7a4097224424 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:03.533343 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d17b04-e3fd-43dc-b0b9-7a4097224424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:03.540635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407eb8a-0e12-4d70-b299-5b45fd2aa752 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:03.542158 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407eb8a-0e12-4d70-b299-5b45fd2aa752 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:03.551971 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1340/2684] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:16:03.552812 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407eb8a-0e12-4d70-b299-5b45fd2aa752 service cinder] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:03.554270 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6407eb8a-0e12-4d70-b299-5b45fd2aa752 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:03.554625 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-29d17b04-e3fd-43dc-b0b9-7a4097224424 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:03.555813 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-29d17b04-e3fd-43dc-b0b9-7a4097224424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:03.563912 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1345/2685] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:03.573218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122115e-ada0-47fc-8818-223668869492 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:03.573591 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122115e-ada0-47fc-8818-223668869492 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:03.573951 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122115e-ada0-47fc-8818-223668869492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:03.594457 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-a122115e-ada0-47fc-8818-223668869492 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:03.595740 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a122115e-ada0-47fc-8818-223668869492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:03.608439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1346/2686] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:16:03.609422 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122115e-ada0-47fc-8818-223668869492 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:03.619331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122115e-ada0-47fc-8818-223668869492 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:03.624171 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccc333-b17e-4d0b-880c-3bc3816c44f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:03.624840 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccc333-b17e-4d0b-880c-3bc3816c44f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:03.625125 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccc333-b17e-4d0b-880c-3bc3816c44f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:03.625404 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccc333-b17e-4d0b-880c-3bc3816c44f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:03.625623 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407eb8a-0e12-4d70-b299-5b45fd2aa752 service cinder] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:03.626155 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccc333-b17e-4d0b-880c-3bc3816c44f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:16:03.626469 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccc333-b17e-4d0b-880c-3bc3816c44f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:03.628111 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccc333-b17e-4d0b-880c-3bc3816c44f4 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:03.629542 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e938934-2866-4f60-87a4-85b163e99e00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:03.630261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e938934-2866-4f60-87a4-85b163e99e00 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:03.630646 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e938934-2866-4f60-87a4-85b163e99e00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:03.630991 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e938934-2866-4f60-87a4-85b163e99e00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:03.636590 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:03.645704 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e938934-2866-4f60-87a4-85b163e99e00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:03.647213 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e938934-2866-4f60-87a4-85b163e99e00 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:03.647947 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1347/2687] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:16:03.648870 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccc333-b17e-4d0b-880c-3bc3816c44f4 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:03.659499 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccc333-b17e-4d0b-880c-3bc3816c44f4 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:03.662741 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1341/2688] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:16:03.664427 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd8ebe-4c7c-4b0d-ae3a-718c5e698548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:03.665121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd8ebe-4c7c-4b0d-ae3a-718c5e698548 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:03.665431 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd8ebe-4c7c-4b0d-ae3a-718c5e698548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:03.665686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd8ebe-4c7c-4b0d-ae3a-718c5e698548 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:03.666413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd8ebe-4c7c-4b0d-ae3a-718c5e698548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:03.668359 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd8ebe-4c7c-4b0d-ae3a-718c5e698548 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:03.699971 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1348/2689] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:16:03 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:16:03.704399 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e938934-2866-4f60-87a4-85b163e99e00 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:03.718204 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e938934-2866-4f60-87a4-85b163e99e00 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:03.807337 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ab809-2b26-46ba-b3c4-e6e3ee50717f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:03.808415 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ab809-2b26-46ba-b3c4-e6e3ee50717f admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:03.808763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ab809-2b26-46ba-b3c4-e6e3ee50717f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:03.809099 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ab809-2b26-46ba-b3c4-e6e3ee50717f admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:03.809836 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ab809-2b26-46ba-b3c4-e6e3ee50717f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:03.812365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ab809-2b26-46ba-b3c4-e6e3ee50717f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:03.820003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:03.846128 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1342/2690] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:16:03 2022] POST /identity/v3/users => generated 286 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:16:03.851966 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd8ebe-4c7c-4b0d-ae3a-718c5e698548 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:03.878206 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd8ebe-4c7c-4b0d-ae3a-718c5e698548 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:03.889339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07800a6e-4949-4d51-9175-75b499630522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:03.890901 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07800a6e-4949-4d51-9175-75b499630522 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:03.891188 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07800a6e-4949-4d51-9175-75b499630522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:03.891607 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07800a6e-4949-4d51-9175-75b499630522 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:03.892400 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07800a6e-4949-4d51-9175-75b499630522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:03.894597 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07800a6e-4949-4d51-9175-75b499630522 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:03.910177 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1349/2691] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:16:03.911700 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ab809-2b26-46ba-b3c4-e6e3ee50717f admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:03.927109 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ab809-2b26-46ba-b3c4-e6e3ee50717f admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:03.936442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c4327-8bfb-4eaf-bfea-4247fd81ea28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:03.939636 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c4327-8bfb-4eaf-bfea-4247fd81ea28 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:03.939636 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c4327-8bfb-4eaf-bfea-4247fd81ea28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:03.939636 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c4327-8bfb-4eaf-bfea-4247fd81ea28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:03.939636 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c4327-8bfb-4eaf-bfea-4247fd81ea28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:03.941305 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c4327-8bfb-4eaf-bfea-4247fd81ea28 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:03.954997 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1343/2692] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:16:03.961065 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07800a6e-4949-4d51-9175-75b499630522 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:03.971756 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07800a6e-4949-4d51-9175-75b499630522 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:03.977555 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131326e-cf6e-426a-9b5d-6f96b2d9a06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:03.978924 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131326e-cf6e-426a-9b5d-6f96b2d9a06f admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:03.979305 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131326e-cf6e-426a-9b5d-6f96b2d9a06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:03.979743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131326e-cf6e-426a-9b5d-6f96b2d9a06f admin admin] PATH_INFO: `/v3/projects/83ded1a8474c4cc6bc306f9f60ea338e/users/68f8f69172db440da576472037c7cab0/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:04.000669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131326e-cf6e-426a-9b5d-6f96b2d9a06f admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ded1a8474c4cc6bc306f9f60ea338e, user_id=68f8f69172db440da576472037c7cab0, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:04.004440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131326e-cf6e-426a-9b5d-6f96b2d9a06f admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:04.015103 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c4327-8bfb-4eaf-bfea-4247fd81ea28 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:04.016776 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-728c4327-8bfb-4eaf-bfea-4247fd81ea28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:04.021974 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1350/2693] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:16:03 2022] PUT /identity/v3/projects/83ded1a8474c4cc6bc306f9f60ea338e/users/68f8f69172db440da576472037c7cab0/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:04.031866 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c4327-8bfb-4eaf-bfea-4247fd81ea28 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:04.033142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c8a36-8d5a-4675-8e75-a65344dd62da None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:04.033499 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c8a36-8d5a-4675-8e75-a65344dd62da None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:04.033874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c8a36-8d5a-4675-8e75-a65344dd62da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:04.064142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-8c6c8a36-8d5a-4675-8e75-a65344dd62da None None] MFA Rules not processed for user `68f8f69172db440da576472037c7cab0`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:04.065139 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-8c6c8a36-8d5a-4675-8e75-a65344dd62da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:04.110274 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b31a8-d9e3-4e67-9e93-945c6a5c5d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:04.111215 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b31a8-d9e3-4e67-9e93-945c6a5c5d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:04.111509 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b31a8-d9e3-4e67-9e93-945c6a5c5d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:04.111791 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b31a8-d9e3-4e67-9e93-945c6a5c5d0f admin admin] PATH_INFO: `/v3/projects/37a7983351d145f693a7b56e4dbb926b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:04.113047 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b31a8-d9e3-4e67-9e93-945c6a5c5d0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=37a7983351d145f693a7b56e4dbb926b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:04.115435 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b31a8-d9e3-4e67-9e93-945c6a5c5d0f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:04.137489 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1351/2694] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:04.148553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c8a36-8d5a-4675-8e75-a65344dd62da None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:04.150402 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-8c6c8a36-8d5a-4675-8e75-a65344dd62da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:04.168044 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-163b31a8-d9e3-4e67-9e93-945c6a5c5d0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37a7983351d145f693a7b56e4dbb926b', 'request_id': 'req-163b31a8-d9e3-4e67-9e93-945c6a5c5d0f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:04.174852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-163b31a8-d9e3-4e67-9e93-945c6a5c5d0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37a7983351d145f693a7b56e4dbb926b', 'request_id': 'req-163b31a8-d9e3-4e67-9e93-945c6a5c5d0f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:04.180300 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-163b31a8-d9e3-4e67-9e93-945c6a5c5d0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37a7983351d145f693a7b56e4dbb926b', 'request_id': 'req-163b31a8-d9e3-4e67-9e93-945c6a5c5d0f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:04.195092 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-163b31a8-d9e3-4e67-9e93-945c6a5c5d0f admin admin] The token cache is being invalidate because project 37a7983351d145f693a7b56e4dbb926b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:16:04.195385 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-163b31a8-d9e3-4e67-9e93-945c6a5c5d0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:04.196063 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-163b31a8-d9e3-4e67-9e93-945c6a5c5d0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:04.197689 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1344/2695] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:16:04 2022] DELETE /identity/v3/projects/37a7983351d145f693a7b56e4dbb926b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:04.202367 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04689e-9f86-4de5-bf6f-995c3a36e955 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:04.202699 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04689e-9f86-4de5-bf6f-995c3a36e955 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:04.202980 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04689e-9f86-4de5-bf6f-995c3a36e955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:04.212961 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c8a36-8d5a-4675-8e75-a65344dd62da None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:04.221079 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-cd04689e-9f86-4de5-bf6f-995c3a36e955 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:04.222380 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-cd04689e-9f86-4de5-bf6f-995c3a36e955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:04.259433 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:04.265832 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce833f5-913a-4143-b0ee-0c847b8934c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:04.266569 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce833f5-913a-4143-b0ee-0c847b8934c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:04.266865 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce833f5-913a-4143-b0ee-0c847b8934c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:04.267421 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce833f5-913a-4143-b0ee-0c847b8934c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:04.269629 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-3ce833f5-913a-4143-b0ee-0c847b8934c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:04.285787 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1345/2696] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:16:04.295161 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853cbec-c308-4e62-8b97-a71ea559710f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:04.295449 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853cbec-c308-4e62-8b97-a71ea559710f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:04.295726 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853cbec-c308-4e62-8b97-a71ea559710f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:04.316338 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-9853cbec-c308-4e62-8b97-a71ea559710f None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:04.317475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9853cbec-c308-4e62-8b97-a71ea559710f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:04.329400 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1346/2697] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:16:04.329578 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce833f5-913a-4143-b0ee-0c847b8934c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:04.330794 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853cbec-c308-4e62-8b97-a71ea559710f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:04.330970 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce833f5-913a-4143-b0ee-0c847b8934c6 service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:04.335194 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:04.340489 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853cbec-c308-4e62-8b97-a71ea559710f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:04.341574 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1352/2698] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:16:04.350362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a3010-e3ea-47c3-8c1d-fc96c0f23a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:04.351094 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a3010-e3ea-47c3-8c1d-fc96c0f23a27 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:04.351508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a3010-e3ea-47c3-8c1d-fc96c0f23a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:04.351800 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a3010-e3ea-47c3-8c1d-fc96c0f23a27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:04.352533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a3010-e3ea-47c3-8c1d-fc96c0f23a27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:16:04.352841 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a3010-e3ea-47c3-8c1d-fc96c0f23a27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:04.354953 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a3010-e3ea-47c3-8c1d-fc96c0f23a27 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:04.367138 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1347/2699] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:16:04.371916 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce833f5-913a-4143-b0ee-0c847b8934c6 service cinder] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:04.383846 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce833f5-913a-4143-b0ee-0c847b8934c6 service cinder] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:04.388469 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b2eab-aa5f-473d-98b1-041e752b7f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:04.389131 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b2eab-aa5f-473d-98b1-041e752b7f77 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:04.389420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b2eab-aa5f-473d-98b1-041e752b7f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:04.389698 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b2eab-aa5f-473d-98b1-041e752b7f77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:04.390401 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b2eab-aa5f-473d-98b1-041e752b7f77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:04.392383 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b2eab-aa5f-473d-98b1-041e752b7f77 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:04.422166 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1353/2700] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:16:04 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:16:04.427461 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a3010-e3ea-47c3-8c1d-fc96c0f23a27 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:04.439869 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a3010-e3ea-47c3-8c1d-fc96c0f23a27 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:04.509482 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26443c07-261c-4459-b590-43009f3a4224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:04.510230 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26443c07-261c-4459-b590-43009f3a4224 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:04.510535 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26443c07-261c-4459-b590-43009f3a4224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:04.510816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26443c07-261c-4459-b590-43009f3a4224 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:04.511875 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26443c07-261c-4459-b590-43009f3a4224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:04.513920 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26443c07-261c-4459-b590-43009f3a4224 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:04.539599 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1348/2701] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:16:04 2022] POST /identity/v3/users => generated 284 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:16:04.541807 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b2eab-aa5f-473d-98b1-041e752b7f77 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:04.553080 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b2eab-aa5f-473d-98b1-041e752b7f77 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:04.558740 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6955ec-6178-408f-941d-10a6b84ab889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:04.559444 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6955ec-6178-408f-941d-10a6b84ab889 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:04.559729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6955ec-6178-408f-941d-10a6b84ab889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:04.560074 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6955ec-6178-408f-941d-10a6b84ab889 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:04.561490 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6955ec-6178-408f-941d-10a6b84ab889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:04.565627 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6955ec-6178-408f-941d-10a6b84ab889 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:04.576830 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1354/2702] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:16:04.581124 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26443c07-261c-4459-b590-43009f3a4224 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:04.595714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26443c07-261c-4459-b590-43009f3a4224 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:04.598945 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fbbae-7952-4727-9ef7-deaa73c99621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:04.599627 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fbbae-7952-4727-9ef7-deaa73c99621 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:04.599937 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fbbae-7952-4727-9ef7-deaa73c99621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:04.600215 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fbbae-7952-4727-9ef7-deaa73c99621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:04.600950 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fbbae-7952-4727-9ef7-deaa73c99621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:04.602587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fbbae-7952-4727-9ef7-deaa73c99621 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:04.617471 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1349/2703] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:16:04.621625 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6955ec-6178-408f-941d-10a6b84ab889 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:04.633667 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6955ec-6178-408f-941d-10a6b84ab889 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:04.638555 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adec3c9-8822-47fb-b7dd-0b514f176111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:04.639554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adec3c9-8822-47fb-b7dd-0b514f176111 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:04.640134 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adec3c9-8822-47fb-b7dd-0b514f176111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:04.640248 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adec3c9-8822-47fb-b7dd-0b514f176111 admin admin] PATH_INFO: `/v3/projects/05a2309e272d46f1a6f82d6fbfc50162/users/33a17c63788c4e25a9df8c67b31ab0a4/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:04.662286 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adec3c9-8822-47fb-b7dd-0b514f176111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a2309e272d46f1a6f82d6fbfc50162, user_id=33a17c63788c4e25a9df8c67b31ab0a4, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:04.665266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adec3c9-8822-47fb-b7dd-0b514f176111 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:04.685721 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1355/2704] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:16:04 2022] PUT /identity/v3/projects/05a2309e272d46f1a6f82d6fbfc50162/users/33a17c63788c4e25a9df8c67b31ab0a4/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:16:04.700300 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ec803-8d63-4139-af7a-f3d4001e8d74 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:04.700300 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ec803-8d63-4139-af7a-f3d4001e8d74 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:04.700300 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ec803-8d63-4139-af7a-f3d4001e8d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:04.726049 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-830ec803-8d63-4139-af7a-f3d4001e8d74 None None] MFA Rules not processed for user `33a17c63788c4e25a9df8c67b31ab0a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:04.727661 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-830ec803-8d63-4139-af7a-f3d4001e8d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:04.800796 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1350/2705] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:04.805311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adec3c9-8822-47fb-b7dd-0b514f176111 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:04.870790 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adec3c9-8822-47fb-b7dd-0b514f176111 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:04.876417 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ab0a8-2822-4152-b49f-1c023d457451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:04.877089 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ab0a8-2822-4152-b49f-1c023d457451 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:04.877376 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ab0a8-2822-4152-b49f-1c023d457451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:04.877656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ab0a8-2822-4152-b49f-1c023d457451 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:04.878390 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ab0a8-2822-4152-b49f-1c023d457451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:04.880373 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ab0a8-2822-4152-b49f-1c023d457451 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:04.906918 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1356/2706] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:16:04 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:16:04.910934 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ec803-8d63-4139-af7a-f3d4001e8d74 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:04.922253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ec803-8d63-4139-af7a-f3d4001e8d74 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:04.982769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:04.989915 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e193091-080a-44a9-b7bf-e8e0872f46bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:04.990704 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e193091-080a-44a9-b7bf-e8e0872f46bd admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:04.991168 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e193091-080a-44a9-b7bf-e8e0872f46bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:04.991667 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e193091-080a-44a9-b7bf-e8e0872f46bd admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:04.992540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e193091-080a-44a9-b7bf-e8e0872f46bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:04.994426 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e193091-080a-44a9-b7bf-e8e0872f46bd admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:05.019043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1351/2707] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:16:04 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:16:05.020115 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e193091-080a-44a9-b7bf-e8e0872f46bd admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:05.020593 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f2269-ad34-4d28-ae3d-b52a68c955f2 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:05.020968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f2269-ad34-4d28-ae3d-b52a68c955f2 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:05.021306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f2269-ad34-4d28-ae3d-b52a68c955f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:05.031200 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e193091-080a-44a9-b7bf-e8e0872f46bd admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:05.036985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393c073-beb5-4bb3-8544-64017d6ce730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:05.037429 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393c073-beb5-4bb3-8544-64017d6ce730 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:05.037743 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393c073-beb5-4bb3-8544-64017d6ce730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:05.038030 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393c073-beb5-4bb3-8544-64017d6ce730 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:05.039135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393c073-beb5-4bb3-8544-64017d6ce730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:05.041036 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393c073-beb5-4bb3-8544-64017d6ce730 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:05.041737 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-923f2269-ad34-4d28-ae3d-b52a68c955f2 None None] MFA Rules not processed for user `3507fe4fda41401dbe6019e5ac86e241`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:05.043097 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-923f2269-ad34-4d28-ae3d-b52a68c955f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:05.052836 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1352/2708] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:16:05.057058 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393c073-beb5-4bb3-8544-64017d6ce730 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:05.067743 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393c073-beb5-4bb3-8544-64017d6ce730 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:05.068622 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:05.073344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e6747-65a7-484b-aba1-2a62caf4401a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:05.074264 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e6747-65a7-484b-aba1-2a62caf4401a admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:05.074587 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e6747-65a7-484b-aba1-2a62caf4401a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:05.074906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e6747-65a7-484b-aba1-2a62caf4401a admin admin] PATH_INFO: `/v3/projects/a825e60b0a714ad08cae20fcccea95fe/users/d37114b5f1f54c4eae5c541952fc04eb/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:05.091782 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e6747-65a7-484b-aba1-2a62caf4401a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a825e60b0a714ad08cae20fcccea95fe, user_id=d37114b5f1f54c4eae5c541952fc04eb, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:05.094485 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e6747-65a7-484b-aba1-2a62caf4401a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:05.106174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1357/2709] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:05.108074 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1353/2710] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:16:05 2022] PUT /identity/v3/projects/a825e60b0a714ad08cae20fcccea95fe/users/d37114b5f1f54c4eae5c541952fc04eb/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:16:05.112370 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f2269-ad34-4d28-ae3d-b52a68c955f2 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:05.124739 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f2269-ad34-4d28-ae3d-b52a68c955f2 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:05.184930 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6399b5-5209-43c2-813f-dc97ebd2b2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:05.185599 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6399b5-5209-43c2-813f-dc97ebd2b2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:05.185878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6399b5-5209-43c2-813f-dc97ebd2b2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:05.186161 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6399b5-5209-43c2-813f-dc97ebd2b2a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:05.186915 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6399b5-5209-43c2-813f-dc97ebd2b2a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:05.188500 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6399b5-5209-43c2-813f-dc97ebd2b2a0 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:05.199738 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1358/2711] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:16:05.203961 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e6747-65a7-484b-aba1-2a62caf4401a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:05.217225 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e6747-65a7-484b-aba1-2a62caf4401a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:05.222240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0c181-d4cb-44db-9506-66434d62367a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:05.223202 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0c181-d4cb-44db-9506-66434d62367a admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:05.223485 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0c181-d4cb-44db-9506-66434d62367a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:05.223763 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0c181-d4cb-44db-9506-66434d62367a admin admin] PATH_INFO: `/v3/projects/a825e60b0a714ad08cae20fcccea95fe/users/d37114b5f1f54c4eae5c541952fc04eb/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:05.226003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0c181-d4cb-44db-9506-66434d62367a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a825e60b0a714ad08cae20fcccea95fe, user_id=d37114b5f1f54c4eae5c541952fc04eb, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:05.228639 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0c181-d4cb-44db-9506-66434d62367a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:05.239868 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1354/2712] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:16:05 2022] PUT /identity/v3/projects/a825e60b0a714ad08cae20fcccea95fe/users/d37114b5f1f54c4eae5c541952fc04eb/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:05.250306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb2fcf-9094-443f-afce-e16549326feb None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:05.250691 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb2fcf-9094-443f-afce-e16549326feb None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:05.250970 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb2fcf-9094-443f-afce-e16549326feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:05.280687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-09cb2fcf-9094-443f-afce-e16549326feb None None] MFA Rules not processed for user `d37114b5f1f54c4eae5c541952fc04eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:05.281911 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-09cb2fcf-9094-443f-afce-e16549326feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:05.350859 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0c181-d4cb-44db-9506-66434d62367a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:05.352566 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-49a0c181-d4cb-44db-9506-66434d62367a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:05.356420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1359/2713] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:05 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:05.367174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb2fcf-9094-443f-afce-e16549326feb None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:05.368594 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-09cb2fcf-9094-443f-afce-e16549326feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:05.425257 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0c181-d4cb-44db-9506-66434d62367a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:05.429595 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dda539-3b21-4c6d-bcea-c3621a63a79d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:05.430255 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dda539-3b21-4c6d-bcea-c3621a63a79d service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:05.430575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dda539-3b21-4c6d-bcea-c3621a63a79d service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:05.430850 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dda539-3b21-4c6d-bcea-c3621a63a79d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:05.433633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-92dda539-3b21-4c6d-bcea-c3621a63a79d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:05.436657 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb2fcf-9094-443f-afce-e16549326feb None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:05.440398 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef2881-fee1-4246-acb8-f39dc7f511ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:05.441046 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef2881-fee1-4246-acb8-f39dc7f511ff service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:05.441330 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef2881-fee1-4246-acb8-f39dc7f511ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:05.441596 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef2881-fee1-4246-acb8-f39dc7f511ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:05.445819 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dda539-3b21-4c6d-bcea-c3621a63a79d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:05.447862 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dda539-3b21-4c6d-bcea-c3621a63a79d service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:05.451717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef2881-fee1-4246-acb8-f39dc7f511ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:05.453269 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef2881-fee1-4246-acb8-f39dc7f511ff service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:05.458125 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:05.459366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1355/2714] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:16:05.468351 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1360/2715] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:05 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:16:06.220978 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dda539-3b21-4c6d-bcea-c3621a63a79d service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:06.226119 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-92dda539-3b21-4c6d-bcea-c3621a63a79d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:06.467018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dda539-3b21-4c6d-bcea-c3621a63a79d service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:06.487400 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772f59e-2f52-4218-bada-3c7430abb159 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:06.488267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772f59e-2f52-4218-bada-3c7430abb159 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:06.490366 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772f59e-2f52-4218-bada-3c7430abb159 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:06.490862 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772f59e-2f52-4218-bada-3c7430abb159 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:06.494965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4772f59e-2f52-4218-bada-3c7430abb159 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:06.541035 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772f59e-2f52-4218-bada-3c7430abb159 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:06.543896 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772f59e-2f52-4218-bada-3c7430abb159 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:06.580636 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1356/2716] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:16:07.583531 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef2881-fee1-4246-acb8-f39dc7f511ff service cinder] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:07.693395 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef2881-fee1-4246-acb8-f39dc7f511ff service cinder] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:07.702829 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfe685-96cc-4567-ad0c-e24e145b3aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:07.704998 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfe685-96cc-4567-ad0c-e24e145b3aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:07.706991 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfe685-96cc-4567-ad0c-e24e145b3aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:07.707503 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfe685-96cc-4567-ad0c-e24e145b3aba admin admin] PATH_INFO: `/v3/users/33a17c63788c4e25a9df8c67b31ab0a4` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:07.710325 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfe685-96cc-4567-ad0c-e24e145b3aba admin admin] RBAC: Authorizing `identity:delete_user(user_id=33a17c63788c4e25a9df8c67b31ab0a4)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:07.717567 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfe685-96cc-4567-ad0c-e24e145b3aba admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:07.804540 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-5edfe685-96cc-4567-ad0c-e24e145b3aba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33a17c63788c4e25a9df8c67b31ab0a4'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:07.817403 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-5edfe685-96cc-4567-ad0c-e24e145b3aba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33a17c63788c4e25a9df8c67b31ab0a4'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:07.818385 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-5edfe685-96cc-4567-ad0c-e24e145b3aba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33a17c63788c4e25a9df8c67b31ab0a4'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:07.845654 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-5edfe685-96cc-4567-ad0c-e24e145b3aba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33a17c63788c4e25a9df8c67b31ab0a4'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:07.847649 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-5edfe685-96cc-4567-ad0c-e24e145b3aba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33a17c63788c4e25a9df8c67b31ab0a4'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:07.864856 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1361/2717] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:16:07 2022] DELETE /identity/v3/users/33a17c63788c4e25a9df8c67b31ab0a4 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:07.869839 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357fe5f-34c4-46d3-b21a-0794d68e1d81 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:07.870379 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357fe5f-34c4-46d3-b21a-0794d68e1d81 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:07.870476 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357fe5f-34c4-46d3-b21a-0794d68e1d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:07.889507 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e357fe5f-34c4-46d3-b21a-0794d68e1d81 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:07.890771 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e357fe5f-34c4-46d3-b21a-0794d68e1d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:07.912804 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:07.962001 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1357/2718] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:07.969656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfe685-96cc-4567-ad0c-e24e145b3aba admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:07.971771 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5edfe685-96cc-4567-ad0c-e24e145b3aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:08.003261 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357fe5f-34c4-46d3-b21a-0794d68e1d81 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:08.005256 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e357fe5f-34c4-46d3-b21a-0794d68e1d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:08.022853 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357fe5f-34c4-46d3-b21a-0794d68e1d81 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:08.028422 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc875de2-2fa9-45ec-8dae-37200d8b5894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:08.029578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc875de2-2fa9-45ec-8dae-37200d8b5894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:08.030079 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc875de2-2fa9-45ec-8dae-37200d8b5894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:08.030554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc875de2-2fa9-45ec-8dae-37200d8b5894 admin admin] PATH_INFO: `/v3/users/68f8f69172db440da576472037c7cab0` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:08.032050 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc875de2-2fa9-45ec-8dae-37200d8b5894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68f8f69172db440da576472037c7cab0)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:08.035183 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc875de2-2fa9-45ec-8dae-37200d8b5894 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:08.056718 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfe685-96cc-4567-ad0c-e24e145b3aba admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:08.063218 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa23ad-d692-4e36-9508-727d462bbee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:08.064518 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa23ad-d692-4e36-9508-727d462bbee5 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:08.064816 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa23ad-d692-4e36-9508-727d462bbee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:08.065096 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa23ad-d692-4e36-9508-727d462bbee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:08.077452 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa23ad-d692-4e36-9508-727d462bbee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:08.079383 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa23ad-d692-4e36-9508-727d462bbee5 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:08.091061 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1362/2719] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:16:08.098533 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-cc875de2-2fa9-45ec-8dae-37200d8b5894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68f8f69172db440da576472037c7cab0'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:08.108563 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-cc875de2-2fa9-45ec-8dae-37200d8b5894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68f8f69172db440da576472037c7cab0'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:08.116718 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-cc875de2-2fa9-45ec-8dae-37200d8b5894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68f8f69172db440da576472037c7cab0'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:08.133453 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-cc875de2-2fa9-45ec-8dae-37200d8b5894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68f8f69172db440da576472037c7cab0'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:08.134361 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-cc875de2-2fa9-45ec-8dae-37200d8b5894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68f8f69172db440da576472037c7cab0'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:08.141159 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1358/2720] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:16:08 2022] DELETE /identity/v3/users/68f8f69172db440da576472037c7cab0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:08.146401 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593bd95-bc76-45ce-911b-365f1c466380 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:08.147255 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593bd95-bc76-45ce-911b-365f1c466380 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:08.147255 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593bd95-bc76-45ce-911b-365f1c466380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:08.169701 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-d593bd95-bc76-45ce-911b-365f1c466380 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:08.172078 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-d593bd95-bc76-45ce-911b-365f1c466380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:08.194722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:08.279050 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1363/2721] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:08.294766 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc875de2-2fa9-45ec-8dae-37200d8b5894 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:08.297126 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-cc875de2-2fa9-45ec-8dae-37200d8b5894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:08.378213 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc875de2-2fa9-45ec-8dae-37200d8b5894 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:08.381854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50521f8-8bab-41c9-9aee-60adad5228fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:08.382538 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50521f8-8bab-41c9-9aee-60adad5228fa service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:08.382876 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50521f8-8bab-41c9-9aee-60adad5228fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:08.383159 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50521f8-8bab-41c9-9aee-60adad5228fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:08.393230 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50521f8-8bab-41c9-9aee-60adad5228fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:08.394875 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50521f8-8bab-41c9-9aee-60adad5228fa service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:08.407084 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1359/2722] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:16:08.897648 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593bd95-bc76-45ce-911b-365f1c466380 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:08.899402 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-d593bd95-bc76-45ce-911b-365f1c466380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:08.914555 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593bd95-bc76-45ce-911b-365f1c466380 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:08.921987 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02924a3a-50ad-4e09-97b4-b9a94fa9e7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:08.923325 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02924a3a-50ad-4e09-97b4-b9a94fa9e7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:08.923800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02924a3a-50ad-4e09-97b4-b9a94fa9e7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:08.924261 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02924a3a-50ad-4e09-97b4-b9a94fa9e7ae admin admin] PATH_INFO: `/v3/projects/05a2309e272d46f1a6f82d6fbfc50162` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:08.925894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02924a3a-50ad-4e09-97b4-b9a94fa9e7ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=05a2309e272d46f1a6f82d6fbfc50162)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:08.928402 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02924a3a-50ad-4e09-97b4-b9a94fa9e7ae admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:08.996320 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-02924a3a-50ad-4e09-97b4-b9a94fa9e7ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a2309e272d46f1a6f82d6fbfc50162', 'request_id': 'req-02924a3a-50ad-4e09-97b4-b9a94fa9e7ae'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:09.005680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-02924a3a-50ad-4e09-97b4-b9a94fa9e7ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a2309e272d46f1a6f82d6fbfc50162', 'request_id': 'req-02924a3a-50ad-4e09-97b4-b9a94fa9e7ae'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:09.020145 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50521f8-8bab-41c9-9aee-60adad5228fa service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:09.022607 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f50521f8-8bab-41c9-9aee-60adad5228fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:09.024713 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-02924a3a-50ad-4e09-97b4-b9a94fa9e7ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a2309e272d46f1a6f82d6fbfc50162', 'request_id': 'req-02924a3a-50ad-4e09-97b4-b9a94fa9e7ae'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:09.049435 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-02924a3a-50ad-4e09-97b4-b9a94fa9e7ae admin admin] The token cache is being invalidate because project 05a2309e272d46f1a6f82d6fbfc50162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:16:09.050067 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-02924a3a-50ad-4e09-97b4-b9a94fa9e7ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:09.051082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50521f8-8bab-41c9-9aee-60adad5228fa service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:09.051319 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-02924a3a-50ad-4e09-97b4-b9a94fa9e7ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:09.057354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1364/2723] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:16:08 2022] DELETE /identity/v3/projects/05a2309e272d46f1a6f82d6fbfc50162 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:09.057939 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02924a3a-50ad-4e09-97b4-b9a94fa9e7ae admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:09.059820 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-02924a3a-50ad-4e09-97b4-b9a94fa9e7ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:09.129993 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:09.141312 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02924a3a-50ad-4e09-97b4-b9a94fa9e7ae admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:09.148033 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d7b13-ac5c-4c4a-a06b-61eb11ddb49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:09.148932 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d7b13-ac5c-4c4a-a06b-61eb11ddb49b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:09.149222 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d7b13-ac5c-4c4a-a06b-61eb11ddb49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:09.149558 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d7b13-ac5c-4c4a-a06b-61eb11ddb49b admin admin] PATH_INFO: `/v3/users/d37114b5f1f54c4eae5c541952fc04eb` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:09.150890 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d7b13-ac5c-4c4a-a06b-61eb11ddb49b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d37114b5f1f54c4eae5c541952fc04eb)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:09.154082 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d7b13-ac5c-4c4a-a06b-61eb11ddb49b admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:09.164371 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c1487-5800-4078-9eb9-738405b440d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:09.165573 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c1487-5800-4078-9eb9-738405b440d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:09.166117 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c1487-5800-4078-9eb9-738405b440d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:09.166576 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c1487-5800-4078-9eb9-738405b440d8 admin admin] PATH_INFO: `/v3/projects/83ded1a8474c4cc6bc306f9f60ea338e` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:09.168101 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c1487-5800-4078-9eb9-738405b440d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83ded1a8474c4cc6bc306f9f60ea338e)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:09.170094 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c1487-5800-4078-9eb9-738405b440d8 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:09.234718 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:09.239746 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e06d7b13-ac5c-4c4a-a06b-61eb11ddb49b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd37114b5f1f54c4eae5c541952fc04eb'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:09.258948 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e06d7b13-ac5c-4c4a-a06b-61eb11ddb49b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd37114b5f1f54c4eae5c541952fc04eb'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:09.261914 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e06d7b13-ac5c-4c4a-a06b-61eb11ddb49b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd37114b5f1f54c4eae5c541952fc04eb'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:09.272519 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f27c1487-5800-4078-9eb9-738405b440d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83ded1a8474c4cc6bc306f9f60ea338e', 'request_id': 'req-f27c1487-5800-4078-9eb9-738405b440d8'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:09.284369 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e06d7b13-ac5c-4c4a-a06b-61eb11ddb49b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd37114b5f1f54c4eae5c541952fc04eb'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:09.285851 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e06d7b13-ac5c-4c4a-a06b-61eb11ddb49b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd37114b5f1f54c4eae5c541952fc04eb'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:09.285986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f27c1487-5800-4078-9eb9-738405b440d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83ded1a8474c4cc6bc306f9f60ea338e', 'request_id': 'req-f27c1487-5800-4078-9eb9-738405b440d8'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:09.297732 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f27c1487-5800-4078-9eb9-738405b440d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83ded1a8474c4cc6bc306f9f60ea338e', 'request_id': 'req-f27c1487-5800-4078-9eb9-738405b440d8'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:09.307788 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1365/2724] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:16:09 2022] DELETE /identity/v3/users/d37114b5f1f54c4eae5c541952fc04eb => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:16:09.324470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f27c1487-5800-4078-9eb9-738405b440d8 admin admin] The token cache is being invalidate because project 83ded1a8474c4cc6bc306f9f60ea338e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:16:09.324811 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f27c1487-5800-4078-9eb9-738405b440d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:09.325534 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-f27c1487-5800-4078-9eb9-738405b440d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:09.328298 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1360/2725] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:16:09 2022] DELETE /identity/v3/projects/83ded1a8474c4cc6bc306f9f60ea338e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:09.336710 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efe9b7-6ab6-4e54-bf5d-13a93d31f91f None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:09.337032 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efe9b7-6ab6-4e54-bf5d-13a93d31f91f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:09.337558 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efe9b7-6ab6-4e54-bf5d-13a93d31f91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:09.383782 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-85efe9b7-6ab6-4e54-bf5d-13a93d31f91f None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:09.385742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-85efe9b7-6ab6-4e54-bf5d-13a93d31f91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:09.518545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1366/2726] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:09.528594 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33f19d-b3b1-411f-b6bb-977735240a78 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:09.529183 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33f19d-b3b1-411f-b6bb-977735240a78 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:09.529667 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33f19d-b3b1-411f-b6bb-977735240a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:09.589245 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-0a33f19d-b3b1-411f-b6bb-977735240a78 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:09.591054 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0a33f19d-b3b1-411f-b6bb-977735240a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:09.616134 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1361/2727] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:16:09.624569 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efe9b7-6ab6-4e54-bf5d-13a93d31f91f None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:09.638046 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efe9b7-6ab6-4e54-bf5d-13a93d31f91f None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:09.643932 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31de4fa-359e-4617-b20b-9f241241bc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:09.647037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31de4fa-359e-4617-b20b-9f241241bc34 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:09.647384 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31de4fa-359e-4617-b20b-9f241241bc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:09.647746 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31de4fa-359e-4617-b20b-9f241241bc34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:09.649224 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31de4fa-359e-4617-b20b-9f241241bc34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:16:09.649575 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31de4fa-359e-4617-b20b-9f241241bc34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:09.651308 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31de4fa-359e-4617-b20b-9f241241bc34 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:09.667011 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1367/2728] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:16:09.673578 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33f19d-b3b1-411f-b6bb-977735240a78 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:09.689445 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33f19d-b3b1-411f-b6bb-977735240a78 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:09.702928 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea23d8e-77ff-4bd9-b9d6-69c6a61d50ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:09.704250 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea23d8e-77ff-4bd9-b9d6-69c6a61d50ed admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:09.704664 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea23d8e-77ff-4bd9-b9d6-69c6a61d50ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:09.705428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea23d8e-77ff-4bd9-b9d6-69c6a61d50ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:09.706271 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea23d8e-77ff-4bd9-b9d6-69c6a61d50ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:09.708923 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea23d8e-77ff-4bd9-b9d6-69c6a61d50ed admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:09.791998 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1362/2729] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:16:09 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:16:09.796725 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31de4fa-359e-4617-b20b-9f241241bc34 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:09.813302 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31de4fa-359e-4617-b20b-9f241241bc34 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:09.893782 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bc981-3356-4ccd-b0e7-70eec9e6f165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:09.894473 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bc981-3356-4ccd-b0e7-70eec9e6f165 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:09.895331 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bc981-3356-4ccd-b0e7-70eec9e6f165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:09.895625 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bc981-3356-4ccd-b0e7-70eec9e6f165 admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:09.896342 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3bc981-3356-4ccd-b0e7-70eec9e6f165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:09.898721 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3bc981-3356-4ccd-b0e7-70eec9e6f165 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:09.927115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1368/2730] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:16:09 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:16:09.931202 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea23d8e-77ff-4bd9-b9d6-69c6a61d50ed admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:09.949448 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea23d8e-77ff-4bd9-b9d6-69c6a61d50ed admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:09.961967 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c6b07-80bd-4c93-ac94-4a56dffc92d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:09.964130 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c6b07-80bd-4c93-ac94-4a56dffc92d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:09.964518 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c6b07-80bd-4c93-ac94-4a56dffc92d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:09.964898 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c6b07-80bd-4c93-ac94-4a56dffc92d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:09.966038 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c6b07-80bd-4c93-ac94-4a56dffc92d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:09.969844 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c6b07-80bd-4c93-ac94-4a56dffc92d2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:09.989343 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1363/2731] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:16:09.990642 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bc981-3356-4ccd-b0e7-70eec9e6f165 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:10.003659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bc981-3356-4ccd-b0e7-70eec9e6f165 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:10.010347 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbd7ee-ae38-4e47-b392-6b2190b56447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:10.011221 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbd7ee-ae38-4e47-b392-6b2190b56447 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:10.012608 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbd7ee-ae38-4e47-b392-6b2190b56447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:10.012608 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbd7ee-ae38-4e47-b392-6b2190b56447 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:10.012608 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbd7ee-ae38-4e47-b392-6b2190b56447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:10.015763 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbd7ee-ae38-4e47-b392-6b2190b56447 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:10.036623 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1369/2732] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:16:10.041700 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c6b07-80bd-4c93-ac94-4a56dffc92d2 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:10.056828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c6b07-80bd-4c93-ac94-4a56dffc92d2 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:10.061872 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812db2b-a8fd-4659-9999-3b3c63b7a3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:10.062979 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812db2b-a8fd-4659-9999-3b3c63b7a3bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:10.063540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812db2b-a8fd-4659-9999-3b3c63b7a3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:10.063824 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812db2b-a8fd-4659-9999-3b3c63b7a3bc admin admin] PATH_INFO: `/v3/projects/e28f28aa6f1b4bf6b4befe2b5cfd400e/users/72b9b83860ea43f78c3103ac2eec9a86/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:10.084539 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812db2b-a8fd-4659-9999-3b3c63b7a3bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28f28aa6f1b4bf6b4befe2b5cfd400e, user_id=72b9b83860ea43f78c3103ac2eec9a86, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:10.087393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812db2b-a8fd-4659-9999-3b3c63b7a3bc admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:10.109311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1364/2733] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:16:10 2022] PUT /identity/v3/projects/e28f28aa6f1b4bf6b4befe2b5cfd400e/users/72b9b83860ea43f78c3103ac2eec9a86/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:10.120632 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2138ff2-c69d-4308-b709-4c523dac8901 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:10.121026 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2138ff2-c69d-4308-b709-4c523dac8901 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:10.121402 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2138ff2-c69d-4308-b709-4c523dac8901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:10.152615 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-d2138ff2-c69d-4308-b709-4c523dac8901 None None] MFA Rules not processed for user `72b9b83860ea43f78c3103ac2eec9a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:10.153975 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-d2138ff2-c69d-4308-b709-4c523dac8901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:10.172378 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:10.234806 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1370/2734] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:10.246852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812db2b-a8fd-4659-9999-3b3c63b7a3bc admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:10.248641 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2812db2b-a8fd-4659-9999-3b3c63b7a3bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:10.312308 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812db2b-a8fd-4659-9999-3b3c63b7a3bc admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:10.316252 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011338a0-93ff-4dc0-8b52-64ae01a4f993 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:10.316908 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011338a0-93ff-4dc0-8b52-64ae01a4f993 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:10.317212 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011338a0-93ff-4dc0-8b52-64ae01a4f993 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:10.317494 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011338a0-93ff-4dc0-8b52-64ae01a4f993 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:10.328986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011338a0-93ff-4dc0-8b52-64ae01a4f993 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:10.330554 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011338a0-93ff-4dc0-8b52-64ae01a4f993 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:10.343086 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1365/2735] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:16:10.352793 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2138ff2-c69d-4308-b709-4c523dac8901 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:10.354394 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-d2138ff2-c69d-4308-b709-4c523dac8901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:10.466070 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2138ff2-c69d-4308-b709-4c523dac8901 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:10.471999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f101b4d-8183-4d27-9ec8-1cac10e2814d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:10.472999 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f101b4d-8183-4d27-9ec8-1cac10e2814d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:10.473584 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f101b4d-8183-4d27-9ec8-1cac10e2814d admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:10.473845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f101b4d-8183-4d27-9ec8-1cac10e2814d admin admin] PATH_INFO: `/v3/projects/a825e60b0a714ad08cae20fcccea95fe` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:10.477041 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f101b4d-8183-4d27-9ec8-1cac10e2814d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a825e60b0a714ad08cae20fcccea95fe)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:10.479958 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f101b4d-8183-4d27-9ec8-1cac10e2814d admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:10.575156 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9f101b4d-8183-4d27-9ec8-1cac10e2814d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a825e60b0a714ad08cae20fcccea95fe', 'request_id': 'req-9f101b4d-8183-4d27-9ec8-1cac10e2814d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:10.591936 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9f101b4d-8183-4d27-9ec8-1cac10e2814d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a825e60b0a714ad08cae20fcccea95fe', 'request_id': 'req-9f101b4d-8183-4d27-9ec8-1cac10e2814d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:10.599047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9f101b4d-8183-4d27-9ec8-1cac10e2814d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a825e60b0a714ad08cae20fcccea95fe', 'request_id': 'req-9f101b4d-8183-4d27-9ec8-1cac10e2814d'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:10.617567 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9f101b4d-8183-4d27-9ec8-1cac10e2814d admin admin] The token cache is being invalidate because project a825e60b0a714ad08cae20fcccea95fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:16:10.618689 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9f101b4d-8183-4d27-9ec8-1cac10e2814d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:10.620998 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9f101b4d-8183-4d27-9ec8-1cac10e2814d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:10.625053 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1371/2736] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:16:10 2022] DELETE /identity/v3/projects/a825e60b0a714ad08cae20fcccea95fe => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:10.630441 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a38704-7833-4aec-bd4c-040eb0260452 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:10.631356 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a38704-7833-4aec-bd4c-040eb0260452 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:10.631724 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a38704-7833-4aec-bd4c-040eb0260452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:10.662862 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-34a38704-7833-4aec-bd4c-040eb0260452 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:10.666284 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-34a38704-7833-4aec-bd4c-040eb0260452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:10.672604 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:10.797214 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1366/2737] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:10.806330 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cccad9-9c78-4dbf-825b-f1b11de9fa0c None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:10.806741 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cccad9-9c78-4dbf-825b-f1b11de9fa0c None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:10.807091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cccad9-9c78-4dbf-825b-f1b11de9fa0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:10.841126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-17cccad9-9c78-4dbf-825b-f1b11de9fa0c None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:10.857389 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-17cccad9-9c78-4dbf-825b-f1b11de9fa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:10.881853 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1372/2738] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:10.888851 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a38704-7833-4aec-bd4c-040eb0260452 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:10.904936 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a38704-7833-4aec-bd4c-040eb0260452 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:10.921405 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccccac-9948-4733-ba00-67ec1864b7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:10.922794 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccccac-9948-4733-ba00-67ec1864b7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:10.923346 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccccac-9948-4733-ba00-67ec1864b7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:10.924401 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccccac-9948-4733-ba00-67ec1864b7e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:10.926866 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ccccac-9948-4733-ba00-67ec1864b7e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:16:10.927185 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ccccac-9948-4733-ba00-67ec1864b7e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:10.929072 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ccccac-9948-4733-ba00-67ec1864b7e2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:10.944135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1367/2739] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:16:10.948938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cccad9-9c78-4dbf-825b-f1b11de9fa0c None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:10.958650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cccad9-9c78-4dbf-825b-f1b11de9fa0c None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:10.965935 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c5e06-af9d-434a-a801-9340a360c55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:10.966909 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c5e06-af9d-434a-a801-9340a360c55a admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:10.967882 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c5e06-af9d-434a-a801-9340a360c55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:10.968367 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c5e06-af9d-434a-a801-9340a360c55a admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:10.969302 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c5e06-af9d-434a-a801-9340a360c55a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:10.971618 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c5e06-af9d-434a-a801-9340a360c55a admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:11.036456 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1373/2740] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:16:10 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:16:11.037986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccccac-9948-4733-ba00-67ec1864b7e2 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:11.050457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccccac-9948-4733-ba00-67ec1864b7e2 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:11.125468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938bc95-8fc2-4cbd-b5d6-c355841c3835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:11.126161 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938bc95-8fc2-4cbd-b5d6-c355841c3835 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:11.126450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938bc95-8fc2-4cbd-b5d6-c355841c3835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:11.126773 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938bc95-8fc2-4cbd-b5d6-c355841c3835 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:11.127485 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938bc95-8fc2-4cbd-b5d6-c355841c3835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:11.129744 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938bc95-8fc2-4cbd-b5d6-c355841c3835 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:11.154153 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1368/2741] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:16:11 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:16:11.155375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c5e06-af9d-434a-a801-9340a360c55a admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:11.167277 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c5e06-af9d-434a-a801-9340a360c55a admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:11.172311 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c015a94-feca-4143-9ece-a85e168a7218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:11.173064 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c015a94-feca-4143-9ece-a85e168a7218 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:11.173356 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c015a94-feca-4143-9ece-a85e168a7218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:11.173635 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c015a94-feca-4143-9ece-a85e168a7218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:11.174367 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c015a94-feca-4143-9ece-a85e168a7218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:11.176047 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c015a94-feca-4143-9ece-a85e168a7218 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:11.190628 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1374/2742] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:16:11.192149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938bc95-8fc2-4cbd-b5d6-c355841c3835 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:11.202407 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938bc95-8fc2-4cbd-b5d6-c355841c3835 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:11.207808 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021865c8-76f9-450b-a350-f86f447c3c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:11.208559 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021865c8-76f9-450b-a350-f86f447c3c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:11.208920 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021865c8-76f9-450b-a350-f86f447c3c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:11.209207 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021865c8-76f9-450b-a350-f86f447c3c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:11.209945 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021865c8-76f9-450b-a350-f86f447c3c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:11.211581 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021865c8-76f9-450b-a350-f86f447c3c21 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:11.222472 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1369/2743] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:16:11.227005 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c015a94-feca-4143-9ece-a85e168a7218 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:11.239221 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c015a94-feca-4143-9ece-a85e168a7218 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:11.245292 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c9f6a-79c2-48df-9258-ee18aaa955e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:11.246339 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c9f6a-79c2-48df-9258-ee18aaa955e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:11.246654 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c9f6a-79c2-48df-9258-ee18aaa955e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:11.246978 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c9f6a-79c2-48df-9258-ee18aaa955e7 admin admin] PATH_INFO: `/v3/projects/fdee23fbb5694d9494c1641f69359c8b/users/4a33f3c1f1a149a89cbc00e1455e388a/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:11.250529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:11.265835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c9f6a-79c2-48df-9258-ee18aaa955e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdee23fbb5694d9494c1641f69359c8b, user_id=4a33f3c1f1a149a89cbc00e1455e388a, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:11.268927 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c9f6a-79c2-48df-9258-ee18aaa955e7 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:11.284354 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1375/2744] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:16:11 2022] PUT /identity/v3/projects/fdee23fbb5694d9494c1641f69359c8b/users/4a33f3c1f1a149a89cbc00e1455e388a/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:11.295817 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58915bc-2dd1-4a8a-8fe2-f001addafc9c None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:11.296008 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58915bc-2dd1-4a8a-8fe2-f001addafc9c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:11.296299 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58915bc-2dd1-4a8a-8fe2-f001addafc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:11.325399 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-d58915bc-2dd1-4a8a-8fe2-f001addafc9c None None] MFA Rules not processed for user `4a33f3c1f1a149a89cbc00e1455e388a`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:11.326684 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d58915bc-2dd1-4a8a-8fe2-f001addafc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:11.394243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1370/2745] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:11.398747 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c9f6a-79c2-48df-9258-ee18aaa955e7 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:11.463493 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c9f6a-79c2-48df-9258-ee18aaa955e7 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:11.468287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57b81f-5590-4753-a287-26ed16b6d089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:11.468955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57b81f-5590-4753-a287-26ed16b6d089 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:11.469241 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57b81f-5590-4753-a287-26ed16b6d089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:11.469517 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57b81f-5590-4753-a287-26ed16b6d089 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:11.470214 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57b81f-5590-4753-a287-26ed16b6d089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:11.472158 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57b81f-5590-4753-a287-26ed16b6d089 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:11.498042 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1376/2746] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:16:11 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:16:11.502269 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58915bc-2dd1-4a8a-8fe2-f001addafc9c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:11.514854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58915bc-2dd1-4a8a-8fe2-f001addafc9c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:11.518639 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:11.575905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7684a14-3d3c-4b05-b2c6-3dca1e324cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:11.576496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7684a14-3d3c-4b05-b2c6-3dca1e324cc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:11.576779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7684a14-3d3c-4b05-b2c6-3dca1e324cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:11.577062 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7684a14-3d3c-4b05-b2c6-3dca1e324cc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:11.577774 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7684a14-3d3c-4b05-b2c6-3dca1e324cc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:11.584338 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7684a14-3d3c-4b05-b2c6-3dca1e324cc3 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:11.609854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1371/2747] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:16:11 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:16:11.613924 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57b81f-5590-4753-a287-26ed16b6d089 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:11.625226 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57b81f-5590-4753-a287-26ed16b6d089 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:11.629959 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba823225-47d8-459b-b6f8-50c1d9533e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:11.630655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba823225-47d8-459b-b6f8-50c1d9533e53 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:11.630945 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba823225-47d8-459b-b6f8-50c1d9533e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:11.631223 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba823225-47d8-459b-b6f8-50c1d9533e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:11.631946 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba823225-47d8-459b-b6f8-50c1d9533e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:11.633545 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba823225-47d8-459b-b6f8-50c1d9533e53 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:11.646138 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1377/2748] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:16:11.650457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7684a14-3d3c-4b05-b2c6-3dca1e324cc3 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:11.660793 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7684a14-3d3c-4b05-b2c6-3dca1e324cc3 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:11.666138 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1174794-0085-4de7-b9dd-4cfa62227a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:11.667059 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1174794-0085-4de7-b9dd-4cfa62227a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:11.667343 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1174794-0085-4de7-b9dd-4cfa62227a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:11.667625 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1174794-0085-4de7-b9dd-4cfa62227a82 admin admin] PATH_INFO: `/v3/projects/5baaab59b77f47b9aa9aad6b624f7b53/users/47478bfb7bd8433db6f6acbc1f39dea5/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:11.685085 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1174794-0085-4de7-b9dd-4cfa62227a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5baaab59b77f47b9aa9aad6b624f7b53, user_id=47478bfb7bd8433db6f6acbc1f39dea5, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:11.687805 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1174794-0085-4de7-b9dd-4cfa62227a82 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:11.701080 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1372/2749] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:16:11 2022] PUT /identity/v3/projects/5baaab59b77f47b9aa9aad6b624f7b53/users/47478bfb7bd8433db6f6acbc1f39dea5/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:11.705016 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba823225-47d8-459b-b6f8-50c1d9533e53 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:11.715059 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba823225-47d8-459b-b6f8-50c1d9533e53 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:11.770731 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9840e9b-29cd-48d0-84e2-f1d2090d0eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:11.771398 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9840e9b-29cd-48d0-84e2-f1d2090d0eef admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:11.771687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9840e9b-29cd-48d0-84e2-f1d2090d0eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:11.771965 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9840e9b-29cd-48d0-84e2-f1d2090d0eef admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:11.772685 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9840e9b-29cd-48d0-84e2-f1d2090d0eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:11.774274 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9840e9b-29cd-48d0-84e2-f1d2090d0eef admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:11.783790 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1378/2750] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:16:11.788063 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1174794-0085-4de7-b9dd-4cfa62227a82 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:11.799192 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1174794-0085-4de7-b9dd-4cfa62227a82 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:11.803852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9cb83-5867-4e0e-9567-b7855bee0850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:11.804730 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9cb83-5867-4e0e-9567-b7855bee0850 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:11.805018 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9cb83-5867-4e0e-9567-b7855bee0850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:11.805303 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9cb83-5867-4e0e-9567-b7855bee0850 admin admin] PATH_INFO: `/v3/projects/5baaab59b77f47b9aa9aad6b624f7b53/users/47478bfb7bd8433db6f6acbc1f39dea5/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:11.807957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9cb83-5867-4e0e-9567-b7855bee0850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5baaab59b77f47b9aa9aad6b624f7b53, user_id=47478bfb7bd8433db6f6acbc1f39dea5, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:11.810639 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9cb83-5867-4e0e-9567-b7855bee0850 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:11.820814 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1373/2751] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:16:11 2022] PUT /identity/v3/projects/5baaab59b77f47b9aa9aad6b624f7b53/users/47478bfb7bd8433db6f6acbc1f39dea5/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:11.832081 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508d842-4845-444c-a6b1-92fef9eca792 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:11.832305 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508d842-4845-444c-a6b1-92fef9eca792 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:11.832589 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508d842-4845-444c-a6b1-92fef9eca792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:11.859484 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-3508d842-4845-444c-a6b1-92fef9eca792 None None] MFA Rules not processed for user `47478bfb7bd8433db6f6acbc1f39dea5`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:11.860706 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-3508d842-4845-444c-a6b1-92fef9eca792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:11.907938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:11.944730 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1379/2752] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:11.954972 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9cb83-5867-4e0e-9567-b7855bee0850 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:11.956717 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-24e9cb83-5867-4e0e-9567-b7855bee0850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:12.019391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9cb83-5867-4e0e-9567-b7855bee0850 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:12.023663 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbd2d2-0048-4e00-8cc9-6594e9255d16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:12.024204 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbd2d2-0048-4e00-8cc9-6594e9255d16 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:12.024546 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbd2d2-0048-4e00-8cc9-6594e9255d16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:12.024760 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbd2d2-0048-4e00-8cc9-6594e9255d16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:12.036860 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bbd2d2-0048-4e00-8cc9-6594e9255d16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:12.038326 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bbd2d2-0048-4e00-8cc9-6594e9255d16 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:12.051286 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1374/2753] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:16:12.667860 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508d842-4845-444c-a6b1-92fef9eca792 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:12.731588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508d842-4845-444c-a6b1-92fef9eca792 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:12.736246 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbe6e9-2dab-4319-8aa9-2599979bcc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:12.737579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbe6e9-2dab-4319-8aa9-2599979bcc3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:12.737579 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbe6e9-2dab-4319-8aa9-2599979bcc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:12.737903 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbe6e9-2dab-4319-8aa9-2599979bcc3f admin admin] PATH_INFO: `/v3/users/4a33f3c1f1a149a89cbc00e1455e388a` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:12.738961 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbe6e9-2dab-4319-8aa9-2599979bcc3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a33f3c1f1a149a89cbc00e1455e388a)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:12.740908 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbe6e9-2dab-4319-8aa9-2599979bcc3f admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:12.785815 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-18bbe6e9-2dab-4319-8aa9-2599979bcc3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a33f3c1f1a149a89cbc00e1455e388a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:12.793851 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-18bbe6e9-2dab-4319-8aa9-2599979bcc3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a33f3c1f1a149a89cbc00e1455e388a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:12.794480 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-18bbe6e9-2dab-4319-8aa9-2599979bcc3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a33f3c1f1a149a89cbc00e1455e388a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:12.806245 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-18bbe6e9-2dab-4319-8aa9-2599979bcc3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a33f3c1f1a149a89cbc00e1455e388a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:12.806906 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-18bbe6e9-2dab-4319-8aa9-2599979bcc3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a33f3c1f1a149a89cbc00e1455e388a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:12.818827 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1380/2754] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:16:12 2022] DELETE /identity/v3/users/4a33f3c1f1a149a89cbc00e1455e388a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:12.823905 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a5fe5-322c-4310-8e91-fc736c5edba5 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:12.824311 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a5fe5-322c-4310-8e91-fc736c5edba5 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:12.824700 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a5fe5-322c-4310-8e91-fc736c5edba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:12.842593 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-4d5a5fe5-322c-4310-8e91-fc736c5edba5 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:12.843742 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4d5a5fe5-322c-4310-8e91-fc736c5edba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:12.902826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1375/2755] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:12.912374 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbe6e9-2dab-4319-8aa9-2599979bcc3f admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:12.914107 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-18bbe6e9-2dab-4319-8aa9-2599979bcc3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:12.969406 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbe6e9-2dab-4319-8aa9-2599979bcc3f admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:12.973011 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d988f-1acd-4137-bd5c-cf6ae344841c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:12.973651 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d988f-1acd-4137-bd5c-cf6ae344841c service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:12.973933 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d988f-1acd-4137-bd5c-cf6ae344841c service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:12.974208 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d988f-1acd-4137-bd5c-cf6ae344841c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:12.983751 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d988f-1acd-4137-bd5c-cf6ae344841c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:12.985186 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d988f-1acd-4137-bd5c-cf6ae344841c service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:12.994613 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1381/2756] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:16:13.164455 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a5fe5-322c-4310-8e91-fc736c5edba5 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:13.165910 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4d5a5fe5-322c-4310-8e91-fc736c5edba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:13.173038 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:13.178942 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a5fe5-322c-4310-8e91-fc736c5edba5 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:13.184754 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22523735-86c9-4be8-b2af-d757d39cb1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:13.185622 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22523735-86c9-4be8-b2af-d757d39cb1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:13.185899 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22523735-86c9-4be8-b2af-d757d39cb1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:13.186175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22523735-86c9-4be8-b2af-d757d39cb1ef admin admin] PATH_INFO: `/v3/users/72b9b83860ea43f78c3103ac2eec9a86` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:13.187391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22523735-86c9-4be8-b2af-d757d39cb1ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=72b9b83860ea43f78c3103ac2eec9a86)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:13.189289 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22523735-86c9-4be8-b2af-d757d39cb1ef admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:13.243617 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-22523735-86c9-4be8-b2af-d757d39cb1ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72b9b83860ea43f78c3103ac2eec9a86'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:13.251791 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-22523735-86c9-4be8-b2af-d757d39cb1ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72b9b83860ea43f78c3103ac2eec9a86'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:13.261536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-22523735-86c9-4be8-b2af-d757d39cb1ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72b9b83860ea43f78c3103ac2eec9a86'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:13.276391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-22523735-86c9-4be8-b2af-d757d39cb1ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72b9b83860ea43f78c3103ac2eec9a86'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:13.277349 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-22523735-86c9-4be8-b2af-d757d39cb1ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72b9b83860ea43f78c3103ac2eec9a86'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:13.284433 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1376/2757] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:16:13 2022] DELETE /identity/v3/users/72b9b83860ea43f78c3103ac2eec9a86 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:13.284597 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d988f-1acd-4137-bd5c-cf6ae344841c service neutron] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:13.285836 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-877d988f-1acd-4137-bd5c-cf6ae344841c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:13.288960 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5a964-4dcf-46d1-aedf-20d00615aa8d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:13.289253 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5a964-4dcf-46d1-aedf-20d00615aa8d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:13.289536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5a964-4dcf-46d1-aedf-20d00615aa8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:13.295166 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:13.311564 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d988f-1acd-4137-bd5c-cf6ae344841c service neutron] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:13.311821 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-d5d5a964-4dcf-46d1-aedf-20d00615aa8d None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:13.313041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d5d5a964-4dcf-46d1-aedf-20d00615aa8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:13.383145 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56183a65-716d-49cb-9649-93a668e36fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:13.384144 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56183a65-716d-49cb-9649-93a668e36fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:13.384864 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56183a65-716d-49cb-9649-93a668e36fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:13.385213 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56183a65-716d-49cb-9649-93a668e36fe5 admin admin] PATH_INFO: `/v3/projects/fdee23fbb5694d9494c1641f69359c8b` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:13.386378 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56183a65-716d-49cb-9649-93a668e36fe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdee23fbb5694d9494c1641f69359c8b)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:13.389375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56183a65-716d-49cb-9649-93a668e36fe5 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:13.426402 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1377/2758] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:16:13.435996 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5a964-4dcf-46d1-aedf-20d00615aa8d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:13.437392 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d5d5a964-4dcf-46d1-aedf-20d00615aa8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:13.455401 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-56183a65-716d-49cb-9649-93a668e36fe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdee23fbb5694d9494c1641f69359c8b', 'request_id': 'req-56183a65-716d-49cb-9649-93a668e36fe5'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:13.463283 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-56183a65-716d-49cb-9649-93a668e36fe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdee23fbb5694d9494c1641f69359c8b', 'request_id': 'req-56183a65-716d-49cb-9649-93a668e36fe5'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:13.469333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-56183a65-716d-49cb-9649-93a668e36fe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdee23fbb5694d9494c1641f69359c8b', 'request_id': 'req-56183a65-716d-49cb-9649-93a668e36fe5'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:13.491654 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-56183a65-716d-49cb-9649-93a668e36fe5 admin admin] The token cache is being invalidate because project fdee23fbb5694d9494c1641f69359c8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:16:13.492134 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-56183a65-716d-49cb-9649-93a668e36fe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:13.493539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-56183a65-716d-49cb-9649-93a668e36fe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:13.495769 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1382/2759] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:16:13 2022] DELETE /identity/v3/projects/fdee23fbb5694d9494c1641f69359c8b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:13.499276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56183a65-716d-49cb-9649-93a668e36fe5 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:13.500684 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-56183a65-716d-49cb-9649-93a668e36fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:13.521362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5a964-4dcf-46d1-aedf-20d00615aa8d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:13.552412 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:13.570414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56183a65-716d-49cb-9649-93a668e36fe5 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:13.575835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c278c6-2ac0-4af2-ac33-68d45539daa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:13.576577 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df5711-97da-448b-b181-c41150e8373e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:13.576725 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c278c6-2ac0-4af2-ac33-68d45539daa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:13.576827 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df5711-97da-448b-b181-c41150e8373e service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:13.576976 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c278c6-2ac0-4af2-ac33-68d45539daa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:13.577097 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df5711-97da-448b-b181-c41150e8373e service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:13.577254 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c278c6-2ac0-4af2-ac33-68d45539daa0 admin admin] PATH_INFO: `/v3/users/47478bfb7bd8433db6f6acbc1f39dea5` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:13.577404 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df5711-97da-448b-b181-c41150e8373e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:13.578461 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c278c6-2ac0-4af2-ac33-68d45539daa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47478bfb7bd8433db6f6acbc1f39dea5)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:13.579407 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-53df5711-97da-448b-b181-c41150e8373e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:13.580412 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c278c6-2ac0-4af2-ac33-68d45539daa0 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:13.594413 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df5711-97da-448b-b181-c41150e8373e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:13.595870 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df5711-97da-448b-b181-c41150e8373e service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:13.606843 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1378/2760] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:16:13.627850 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:13.641938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-09c278c6-2ac0-4af2-ac33-68d45539daa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47478bfb7bd8433db6f6acbc1f39dea5'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:13.653519 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-09c278c6-2ac0-4af2-ac33-68d45539daa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47478bfb7bd8433db6f6acbc1f39dea5'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:13.654856 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-09c278c6-2ac0-4af2-ac33-68d45539daa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47478bfb7bd8433db6f6acbc1f39dea5'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:13.672749 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-09c278c6-2ac0-4af2-ac33-68d45539daa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47478bfb7bd8433db6f6acbc1f39dea5'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:13.673540 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-09c278c6-2ac0-4af2-ac33-68d45539daa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47478bfb7bd8433db6f6acbc1f39dea5'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:13.688280 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1383/2761] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:16:13 2022] DELETE /identity/v3/users/47478bfb7bd8433db6f6acbc1f39dea5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:16:14.138828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df5711-97da-448b-b181-c41150e8373e service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:14.140637 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-53df5711-97da-448b-b181-c41150e8373e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:14.165242 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df5711-97da-448b-b181-c41150e8373e service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:14.242240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91a9c3-db22-474a-897f-b8e6fe2bff30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:14.243337 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91a9c3-db22-474a-897f-b8e6fe2bff30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:14.243779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91a9c3-db22-474a-897f-b8e6fe2bff30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:14.244632 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91a9c3-db22-474a-897f-b8e6fe2bff30 admin admin] PATH_INFO: `/v3/projects/e28f28aa6f1b4bf6b4befe2b5cfd400e` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:14.245940 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91a9c3-db22-474a-897f-b8e6fe2bff30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e28f28aa6f1b4bf6b4befe2b5cfd400e)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:14.248325 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91a9c3-db22-474a-897f-b8e6fe2bff30 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:14.314745 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-ad91a9c3-db22-474a-897f-b8e6fe2bff30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e28f28aa6f1b4bf6b4befe2b5cfd400e', 'request_id': 'req-ad91a9c3-db22-474a-897f-b8e6fe2bff30'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:14.334831 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-ad91a9c3-db22-474a-897f-b8e6fe2bff30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e28f28aa6f1b4bf6b4befe2b5cfd400e', 'request_id': 'req-ad91a9c3-db22-474a-897f-b8e6fe2bff30'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:14.354529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c278c6-2ac0-4af2-ac33-68d45539daa0 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:14.355772 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-ad91a9c3-db22-474a-897f-b8e6fe2bff30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e28f28aa6f1b4bf6b4befe2b5cfd400e', 'request_id': 'req-ad91a9c3-db22-474a-897f-b8e6fe2bff30'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:14.356585 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-09c278c6-2ac0-4af2-ac33-68d45539daa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:14.384111 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-ad91a9c3-db22-474a-897f-b8e6fe2bff30 admin admin] The token cache is being invalidate because project e28f28aa6f1b4bf6b4befe2b5cfd400e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:16:14.384491 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-ad91a9c3-db22-474a-897f-b8e6fe2bff30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:14.385115 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c278c6-2ac0-4af2-ac33-68d45539daa0 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:14.385239 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-ad91a9c3-db22-474a-897f-b8e6fe2bff30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:14.387178 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1379/2762] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:16:14 2022] DELETE /identity/v3/projects/e28f28aa6f1b4bf6b4befe2b5cfd400e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:14.564030 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055fd98-ec99-4330-b552-70f26696d410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:14.565322 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055fd98-ec99-4330-b552-70f26696d410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:14.565942 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055fd98-ec99-4330-b552-70f26696d410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:14.566319 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055fd98-ec99-4330-b552-70f26696d410 admin admin] PATH_INFO: `/v3/projects/5baaab59b77f47b9aa9aad6b624f7b53` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:14.568266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055fd98-ec99-4330-b552-70f26696d410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5baaab59b77f47b9aa9aad6b624f7b53)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:14.576723 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055fd98-ec99-4330-b552-70f26696d410 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:14.675946 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2055fd98-ec99-4330-b552-70f26696d410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5baaab59b77f47b9aa9aad6b624f7b53', 'request_id': 'req-2055fd98-ec99-4330-b552-70f26696d410'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:14.684910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2055fd98-ec99-4330-b552-70f26696d410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5baaab59b77f47b9aa9aad6b624f7b53', 'request_id': 'req-2055fd98-ec99-4330-b552-70f26696d410'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:14.692543 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2055fd98-ec99-4330-b552-70f26696d410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5baaab59b77f47b9aa9aad6b624f7b53', 'request_id': 'req-2055fd98-ec99-4330-b552-70f26696d410'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:14.710474 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2055fd98-ec99-4330-b552-70f26696d410 admin admin] The token cache is being invalidate because project 5baaab59b77f47b9aa9aad6b624f7b53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:16:14.710803 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2055fd98-ec99-4330-b552-70f26696d410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:14.711566 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2055fd98-ec99-4330-b552-70f26696d410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:14.719860 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23642525-6c74-49ed-a236-f81602194580 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:14.720249 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23642525-6c74-49ed-a236-f81602194580 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:14.720616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23642525-6c74-49ed-a236-f81602194580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:14.722121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1384/2763] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:16:14 2022] DELETE /identity/v3/projects/5baaab59b77f47b9aa9aad6b624f7b53 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:14.746335 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-23642525-6c74-49ed-a236-f81602194580 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:14.747681 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-23642525-6c74-49ed-a236-f81602194580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:14.829258 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1380/2764] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:14.838200 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7f78c-1301-455f-aa2a-c262a7d85424 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:14.838433 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7f78c-1301-455f-aa2a-c262a7d85424 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:14.838910 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7f78c-1301-455f-aa2a-c262a7d85424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:14.858416 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-08f7f78c-1301-455f-aa2a-c262a7d85424 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:14.859956 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-08f7f78c-1301-455f-aa2a-c262a7d85424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:14.869123 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1385/2765] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:14.873522 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23642525-6c74-49ed-a236-f81602194580 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:14.893734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:14.898244 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23642525-6c74-49ed-a236-f81602194580 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:14.907977 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f0fc5-4e6d-41ed-886d-118257f56d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:14.908846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f0fc5-4e6d-41ed-886d-118257f56d10 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:14.909410 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f0fc5-4e6d-41ed-886d-118257f56d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:14.909965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f0fc5-4e6d-41ed-886d-118257f56d10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:14.910750 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f0fc5-4e6d-41ed-886d-118257f56d10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:16:14.911064 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f0fc5-4e6d-41ed-886d-118257f56d10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:14.912707 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f0fc5-4e6d-41ed-886d-118257f56d10 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:14.933738 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1381/2766] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:16:14.938170 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7f78c-1301-455f-aa2a-c262a7d85424 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:14.948121 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7f78c-1301-455f-aa2a-c262a7d85424 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:14.952725 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f8ddb-e3f7-4bc6-9acd-ce49c62582df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:14.953362 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f8ddb-e3f7-4bc6-9acd-ce49c62582df admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:14.953644 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f8ddb-e3f7-4bc6-9acd-ce49c62582df admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:14.953915 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f8ddb-e3f7-4bc6-9acd-ce49c62582df admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:14.954637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f8ddb-e3f7-4bc6-9acd-ce49c62582df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:14.958417 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f8ddb-e3f7-4bc6-9acd-ce49c62582df admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:14.986546 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1386/2767] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:16:14 2022] POST /identity/v3/projects => generated 361 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:16:14.990786 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f0fc5-4e6d-41ed-886d-118257f56d10 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:15.003141 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f0fc5-4e6d-41ed-886d-118257f56d10 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:15.076055 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72404463-7f59-43af-b8eb-d72c1ffe041a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:15.076748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72404463-7f59-43af-b8eb-d72c1ffe041a admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:15.077038 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72404463-7f59-43af-b8eb-d72c1ffe041a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:15.077317 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72404463-7f59-43af-b8eb-d72c1ffe041a admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:15.078123 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72404463-7f59-43af-b8eb-d72c1ffe041a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:15.080238 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72404463-7f59-43af-b8eb-d72c1ffe041a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:15.103548 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1382/2768] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:16:14 2022] POST /identity/v3/users => generated 281 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:16:15.107429 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f8ddb-e3f7-4bc6-9acd-ce49c62582df admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:15.121341 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f8ddb-e3f7-4bc6-9acd-ce49c62582df admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:15.126436 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd28491-a7b7-44ab-9427-4cb0521380a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:15.127152 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd28491-a7b7-44ab-9427-4cb0521380a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:15.127500 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd28491-a7b7-44ab-9427-4cb0521380a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:15.127791 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd28491-a7b7-44ab-9427-4cb0521380a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:15.128543 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd28491-a7b7-44ab-9427-4cb0521380a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:15.130946 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd28491-a7b7-44ab-9427-4cb0521380a7 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:15.143173 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1387/2769] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:16:15.147422 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72404463-7f59-43af-b8eb-d72c1ffe041a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:15.158540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72404463-7f59-43af-b8eb-d72c1ffe041a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:15.164246 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3b1d2-7b33-4b48-9f09-f6e55e1a4745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:15.164927 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3b1d2-7b33-4b48-9f09-f6e55e1a4745 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:15.165217 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3b1d2-7b33-4b48-9f09-f6e55e1a4745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:15.165522 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3b1d2-7b33-4b48-9f09-f6e55e1a4745 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:15.166826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3b1d2-7b33-4b48-9f09-f6e55e1a4745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:15.168457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3b1d2-7b33-4b48-9f09-f6e55e1a4745 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:15.179286 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1383/2770] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:16:15.183437 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd28491-a7b7-44ab-9427-4cb0521380a7 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:15.188719 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:15.195408 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd28491-a7b7-44ab-9427-4cb0521380a7 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:15.201639 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ad8c7-bb81-438b-97b4-5a39aac10dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:15.202574 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ad8c7-bb81-438b-97b4-5a39aac10dce admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:15.202894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ad8c7-bb81-438b-97b4-5a39aac10dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:15.203283 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ad8c7-bb81-438b-97b4-5a39aac10dce admin admin] PATH_INFO: `/v3/projects/94cee3caa1d14310956b3da40c1f24fa/users/82453b48665b44e681b2f2f6ced74775/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:15.220337 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ad8c7-bb81-438b-97b4-5a39aac10dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=94cee3caa1d14310956b3da40c1f24fa, user_id=82453b48665b44e681b2f2f6ced74775, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:15.223614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ad8c7-bb81-438b-97b4-5a39aac10dce admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:15.240722 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1388/2771] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:16:15 2022] PUT /identity/v3/projects/94cee3caa1d14310956b3da40c1f24fa/users/82453b48665b44e681b2f2f6ced74775/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:16:15.251112 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990c788-968c-4c2f-ab59-a4647e14c80b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:15.251399 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990c788-968c-4c2f-ab59-a4647e14c80b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:15.251681 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990c788-968c-4c2f-ab59-a4647e14c80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:15.281374 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f990c788-968c-4c2f-ab59-a4647e14c80b None None] MFA Rules not processed for user `82453b48665b44e681b2f2f6ced74775`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:15.282633 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f990c788-968c-4c2f-ab59-a4647e14c80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:15.350170 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1384/2772] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:15.382063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ad8c7-bb81-438b-97b4-5a39aac10dce admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:15.383792 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ee3ad8c7-bb81-438b-97b4-5a39aac10dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:15.441901 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ad8c7-bb81-438b-97b4-5a39aac10dce admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:15.445505 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132d537-b300-4e1f-938a-4de089edf4cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:15.446148 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132d537-b300-4e1f-938a-4de089edf4cf service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:15.446430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132d537-b300-4e1f-938a-4de089edf4cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:15.446734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132d537-b300-4e1f-938a-4de089edf4cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:15.455681 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132d537-b300-4e1f-938a-4de089edf4cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:15.457110 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132d537-b300-4e1f-938a-4de089edf4cf service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:15.466471 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1389/2773] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:16:15.480450 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990c788-968c-4c2f-ab59-a4647e14c80b None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:15.543429 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990c788-968c-4c2f-ab59-a4647e14c80b None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:15.548052 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415be43-6620-4a39-a4fa-9736a534cdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:15.548914 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415be43-6620-4a39-a4fa-9736a534cdc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:15.549202 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415be43-6620-4a39-a4fa-9736a534cdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:15.549477 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415be43-6620-4a39-a4fa-9736a534cdc3 admin admin] PATH_INFO: `/v3/users/82453b48665b44e681b2f2f6ced74775` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:15.550701 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415be43-6620-4a39-a4fa-9736a534cdc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82453b48665b44e681b2f2f6ced74775)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:15.552606 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415be43-6620-4a39-a4fa-9736a534cdc3 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:15.554102 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:15.599700 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1415be43-6620-4a39-a4fa-9736a534cdc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82453b48665b44e681b2f2f6ced74775'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:15.607030 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1415be43-6620-4a39-a4fa-9736a534cdc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82453b48665b44e681b2f2f6ced74775'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:15.613883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1415be43-6620-4a39-a4fa-9736a534cdc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82453b48665b44e681b2f2f6ced74775'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:15.625965 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1415be43-6620-4a39-a4fa-9736a534cdc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82453b48665b44e681b2f2f6ced74775'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:15.626734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-1415be43-6620-4a39-a4fa-9736a534cdc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82453b48665b44e681b2f2f6ced74775'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:15.632713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1385/2774] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:16:15 2022] DELETE /identity/v3/users/82453b48665b44e681b2f2f6ced74775 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:15.637740 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5c33e-27b1-4310-b918-d64ba5185b9a None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:15.638063 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5c33e-27b1-4310-b918-d64ba5185b9a None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:15.638343 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5c33e-27b1-4310-b918-d64ba5185b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:15.661020 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-6ed5c33e-27b1-4310-b918-d64ba5185b9a None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:15.662240 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-6ed5c33e-27b1-4310-b918-d64ba5185b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:15.724225 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1390/2775] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:15.733779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415be43-6620-4a39-a4fa-9736a534cdc3 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:15.735260 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1415be43-6620-4a39-a4fa-9736a534cdc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:15.797384 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5c33e-27b1-4310-b918-d64ba5185b9a None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:15.798942 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-6ed5c33e-27b1-4310-b918-d64ba5185b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:15.801216 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415be43-6620-4a39-a4fa-9736a534cdc3 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:15.804895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa5c56-adb7-4b3c-8a00-7ea7318922ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:15.805555 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa5c56-adb7-4b3c-8a00-7ea7318922ce service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:15.805840 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa5c56-adb7-4b3c-8a00-7ea7318922ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:15.806696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa5c56-adb7-4b3c-8a00-7ea7318922ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:15.812139 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5c33e-27b1-4310-b918-d64ba5185b9a None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:15.816417 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa5c56-adb7-4b3c-8a00-7ea7318922ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:15.817716 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e235e8-8698-418c-a3ff-622b7b47ed3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:15.817854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa5c56-adb7-4b3c-8a00-7ea7318922ce service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:15.818609 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e235e8-8698-418c-a3ff-622b7b47ed3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:15.818890 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e235e8-8698-418c-a3ff-622b7b47ed3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:15.819166 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e235e8-8698-418c-a3ff-622b7b47ed3e admin admin] PATH_INFO: `/v3/users/c609589709e7472380df9d89d1b401dd` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:15.820367 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e235e8-8698-418c-a3ff-622b7b47ed3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c609589709e7472380df9d89d1b401dd)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:15.823175 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e235e8-8698-418c-a3ff-622b7b47ed3e admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:15.829740 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1386/2776] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:16:15.873628 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-c8e235e8-8698-418c-a3ff-622b7b47ed3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c609589709e7472380df9d89d1b401dd'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:15.881781 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-c8e235e8-8698-418c-a3ff-622b7b47ed3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c609589709e7472380df9d89d1b401dd'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:15.882700 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-c8e235e8-8698-418c-a3ff-622b7b47ed3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c609589709e7472380df9d89d1b401dd'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:15.896399 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-c8e235e8-8698-418c-a3ff-622b7b47ed3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c609589709e7472380df9d89d1b401dd'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:15.897221 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-c8e235e8-8698-418c-a3ff-622b7b47ed3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c609589709e7472380df9d89d1b401dd'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:15.902188 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:15.913755 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1391/2777] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:16:15 2022] DELETE /identity/v3/users/c609589709e7472380df9d89d1b401dd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:16:15.920180 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cd434-cd81-40b9-9909-7bfe8f47fbde None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:15.921637 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cd434-cd81-40b9-9909-7bfe8f47fbde None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:15.922204 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cd434-cd81-40b9-9909-7bfe8f47fbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:15.947559 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-fc3cd434-cd81-40b9-9909-7bfe8f47fbde None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:15.949590 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-fc3cd434-cd81-40b9-9909-7bfe8f47fbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:16.050134 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1387/2778] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:16.061542 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e235e8-8698-418c-a3ff-622b7b47ed3e admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:16.064407 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-c8e235e8-8698-418c-a3ff-622b7b47ed3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:16.087635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f331a1d-b8a8-4e41-9750-4a9bdf00f258 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:16.088302 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f331a1d-b8a8-4e41-9750-4a9bdf00f258 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:16.089559 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f331a1d-b8a8-4e41-9750-4a9bdf00f258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:16.131883 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-4f331a1d-b8a8-4e41-9750-4a9bdf00f258 None None] MFA Rules not processed for user `f64d942793a5493787c3e5c7815bc134`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:16.133974 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4f331a1d-b8a8-4e41-9750-4a9bdf00f258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:16.161753 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e235e8-8698-418c-a3ff-622b7b47ed3e admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:16.167837 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4ff4f-81d7-474f-b8f4-b0c56574ae34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:16.168521 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4ff4f-81d7-474f-b8f4-b0c56574ae34 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:16.168805 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4ff4f-81d7-474f-b8f4-b0c56574ae34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:16.169091 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4ff4f-81d7-474f-b8f4-b0c56574ae34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:16.172502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:16.184488 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4ff4f-81d7-474f-b8f4-b0c56574ae34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:16.186232 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4ff4f-81d7-474f-b8f4-b0c56574ae34 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:16.198583 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1392/2779] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:16:16.245206 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1388/2780] 10.222.0.79 () {58 vars in 967 bytes} [Thu Jul 14 12:16:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:16.286522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4ff4f-81d7-474f-b8f4-b0c56574ae34 service neutron] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:16.288213 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a8d4ff4f-81d7-474f-b8f4-b0c56574ae34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:16.304190 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4ff4f-81d7-474f-b8f4-b0c56574ae34 service neutron] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:16.309433 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b016f9-dfa0-4579-ac2f-5bbe71cd8401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:16.310100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b016f9-dfa0-4579-ac2f-5bbe71cd8401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:16.310393 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b016f9-dfa0-4579-ac2f-5bbe71cd8401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:16.310704 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b016f9-dfa0-4579-ac2f-5bbe71cd8401 admin admin] PATH_INFO: `/v3/projects/94cee3caa1d14310956b3da40c1f24fa` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:16.312111 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b016f9-dfa0-4579-ac2f-5bbe71cd8401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94cee3caa1d14310956b3da40c1f24fa)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:16.314103 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b016f9-dfa0-4579-ac2f-5bbe71cd8401 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:16.319525 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f331a1d-b8a8-4e41-9750-4a9bdf00f258 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:16.320979 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4f331a1d-b8a8-4e41-9750-4a9bdf00f258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:16.388871 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e6b016f9-dfa0-4579-ac2f-5bbe71cd8401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94cee3caa1d14310956b3da40c1f24fa', 'request_id': 'req-e6b016f9-dfa0-4579-ac2f-5bbe71cd8401'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:16.397631 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e6b016f9-dfa0-4579-ac2f-5bbe71cd8401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94cee3caa1d14310956b3da40c1f24fa', 'request_id': 'req-e6b016f9-dfa0-4579-ac2f-5bbe71cd8401'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:16.407061 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e6b016f9-dfa0-4579-ac2f-5bbe71cd8401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94cee3caa1d14310956b3da40c1f24fa', 'request_id': 'req-e6b016f9-dfa0-4579-ac2f-5bbe71cd8401'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:16.428314 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e6b016f9-dfa0-4579-ac2f-5bbe71cd8401 admin admin] The token cache is being invalidate because project 94cee3caa1d14310956b3da40c1f24fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:16:16.428703 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e6b016f9-dfa0-4579-ac2f-5bbe71cd8401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:16.429306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-e6b016f9-dfa0-4579-ac2f-5bbe71cd8401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:16.431816 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1393/2781] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:16:16 2022] DELETE /identity/v3/projects/94cee3caa1d14310956b3da40c1f24fa => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:16.437597 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f331a1d-b8a8-4e41-9750-4a9bdf00f258 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:16.438627 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408e134-585b-44c0-bfd8-96e1a2894873 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:16.438627 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408e134-585b-44c0-bfd8-96e1a2894873 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:16.438627 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408e134-585b-44c0-bfd8-96e1a2894873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:16.460174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-b408e134-585b-44c0-bfd8-96e1a2894873 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:16.461537 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b408e134-585b-44c0-bfd8-96e1a2894873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:16.512388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bb435-3545-40a4-b539-c5a8dd5fcced service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969ee98dfe644ef2a016860aa1585317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:16.513050 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bb435-3545-40a4-b539-c5a8dd5fcced service swift] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:16.513344 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bb435-3545-40a4-b539-c5a8dd5fcced service swift] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:16.513639 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bb435-3545-40a4-b539-c5a8dd5fcced service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:16.515596 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d64bb435-3545-40a4-b539-c5a8dd5fcced service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:16.558744 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1394/2782] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:16.560518 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2dece-799c-41a7-9160-3aa344fde3ff None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:16.560827 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2dece-799c-41a7-9160-3aa344fde3ff None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:16.561004 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2dece-799c-41a7-9160-3aa344fde3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:16.588706 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-68e2dece-799c-41a7-9160-3aa344fde3ff None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:16.590198 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-68e2dece-799c-41a7-9160-3aa344fde3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:16.597236 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bb435-3545-40a4-b539-c5a8dd5fcced service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:16.598906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bb435-3545-40a4-b539-c5a8dd5fcced service swift] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:16.602368 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1395/2783] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:16:16.603893 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2dece-799c-41a7-9160-3aa344fde3ff None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:16.608377 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1389/2784] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Jul 14 12:16:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 12:16:16.613617 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2dece-799c-41a7-9160-3aa344fde3ff None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:16.620566 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8a0e1-9054-4294-a7f1-07b08affd4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:16.620872 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8a0e1-9054-4294-a7f1-07b08affd4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:16.621282 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8a0e1-9054-4294-a7f1-07b08affd4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:16.621698 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8a0e1-9054-4294-a7f1-07b08affd4f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:16.622661 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8a0e1-9054-4294-a7f1-07b08affd4f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:16:16.622976 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8a0e1-9054-4294-a7f1-07b08affd4f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:16.624935 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8a0e1-9054-4294-a7f1-07b08affd4f1 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:16.634549 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:16.639401 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1396/2785] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:16:16.643612 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bb435-3545-40a4-b539-c5a8dd5fcced service swift] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:16.654695 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bb435-3545-40a4-b539-c5a8dd5fcced service swift] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:16.656346 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8a0e1-9054-4294-a7f1-07b08affd4f1 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:16.658077 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-3fa8a0e1-9054-4294-a7f1-07b08affd4f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:16.663772 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30383528-dbfc-4b21-ad1b-3b7f7b76e286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:16.667060 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30383528-dbfc-4b21-ad1b-3b7f7b76e286 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:16.667295 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30383528-dbfc-4b21-ad1b-3b7f7b76e286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:16.667575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30383528-dbfc-4b21-ad1b-3b7f7b76e286 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:16.668289 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30383528-dbfc-4b21-ad1b-3b7f7b76e286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:16.670216 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30383528-dbfc-4b21-ad1b-3b7f7b76e286 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:16.680857 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:16.685432 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8a0e1-9054-4294-a7f1-07b08affd4f1 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:16.695817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4ac88-ef74-468d-b419-3fb74efd4e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:16.698298 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4ac88-ef74-468d-b419-3fb74efd4e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:16.699364 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4ac88-ef74-468d-b419-3fb74efd4e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:16.699662 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4ac88-ef74-468d-b419-3fb74efd4e77 admin admin] PATH_INFO: `/v3/projects/8e4d4610e10545f9b27ea454771b412b` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:16.701068 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4ac88-ef74-468d-b419-3fb74efd4e77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e4d4610e10545f9b27ea454771b412b)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:16.704025 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4ac88-ef74-468d-b419-3fb74efd4e77 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:16.709424 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1390/2786] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:16:16 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:16:16.718989 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30383528-dbfc-4b21-ad1b-3b7f7b76e286 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:16.768395 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-3eb4ac88-ef74-468d-b419-3fb74efd4e77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e4d4610e10545f9b27ea454771b412b', 'request_id': 'req-3eb4ac88-ef74-468d-b419-3fb74efd4e77'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:16.777244 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-3eb4ac88-ef74-468d-b419-3fb74efd4e77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e4d4610e10545f9b27ea454771b412b', 'request_id': 'req-3eb4ac88-ef74-468d-b419-3fb74efd4e77'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:16.783337 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-3eb4ac88-ef74-468d-b419-3fb74efd4e77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e4d4610e10545f9b27ea454771b412b', 'request_id': 'req-3eb4ac88-ef74-468d-b419-3fb74efd4e77'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:16.797728 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-3eb4ac88-ef74-468d-b419-3fb74efd4e77 admin admin] The token cache is being invalidate because project 8e4d4610e10545f9b27ea454771b412b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:16:16.798020 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-3eb4ac88-ef74-468d-b419-3fb74efd4e77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:16.799251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-3eb4ac88-ef74-468d-b419-3fb74efd4e77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:16.806431 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1397/2787] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:16:16 2022] DELETE /identity/v3/projects/8e4d4610e10545f9b27ea454771b412b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:16:16.806975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30383528-dbfc-4b21-ad1b-3b7f7b76e286 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:16.812045 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47620b-5f19-41f3-9f34-d44e7ceaec08 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:16.812340 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47620b-5f19-41f3-9f34-d44e7ceaec08 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:16.812622 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47620b-5f19-41f3-9f34-d44e7ceaec08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:16.834028 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-5d47620b-5f19-41f3-9f34-d44e7ceaec08 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:16.835305 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5d47620b-5f19-41f3-9f34-d44e7ceaec08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:16.876433 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3881b-e097-4288-9f17-0a1196dd5a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:16.877111 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3881b-e097-4288-9f17-0a1196dd5a89 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:16.877393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3881b-e097-4288-9f17-0a1196dd5a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:16.877730 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3881b-e097-4288-9f17-0a1196dd5a89 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:16.878432 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3881b-e097-4288-9f17-0a1196dd5a89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:16.880388 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3881b-e097-4288-9f17-0a1196dd5a89 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:16.901653 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1391/2788] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:16:16 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:16:16.905907 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3881b-e097-4288-9f17-0a1196dd5a89 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:16.907873 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c2d3881b-e097-4288-9f17-0a1196dd5a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:16.909522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1398/2789] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:16.918190 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60d8d8-8647-47af-9688-106c510889ea None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:16.918531 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60d8d8-8647-47af-9688-106c510889ea None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:16.918815 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60d8d8-8647-47af-9688-106c510889ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:16.925189 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3881b-e097-4288-9f17-0a1196dd5a89 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:16.930846 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77989afb-3a4e-4554-8fb1-e8346f9cb58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:16.931597 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77989afb-3a4e-4554-8fb1-e8346f9cb58a admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:16.931887 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77989afb-3a4e-4554-8fb1-e8346f9cb58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:16.932170 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77989afb-3a4e-4554-8fb1-e8346f9cb58a admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:16.932936 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77989afb-3a4e-4554-8fb1-e8346f9cb58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:16.935138 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77989afb-3a4e-4554-8fb1-e8346f9cb58a admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:16.939348 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-da60d8d8-8647-47af-9688-106c510889ea None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:16.940637 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-da60d8d8-8647-47af-9688-106c510889ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:16.947788 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1392/2790] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:16:16.950421 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1399/2791] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:16:16.951780 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77989afb-3a4e-4554-8fb1-e8346f9cb58a admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:16.954230 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60d8d8-8647-47af-9688-106c510889ea None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:16.962240 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77989afb-3a4e-4554-8fb1-e8346f9cb58a admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:16.964305 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60d8d8-8647-47af-9688-106c510889ea None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:16.967178 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e96d41-b838-4640-9491-adba197f5b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:16.967947 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e96d41-b838-4640-9491-adba197f5b46 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:16.968300 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e96d41-b838-4640-9491-adba197f5b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:16.968651 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e96d41-b838-4640-9491-adba197f5b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:16.969442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e96d41-b838-4640-9491-adba197f5b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:16.969552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a46733-8650-48aa-baa1-e153d0c7716c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:16.970290 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a46733-8650-48aa-baa1-e153d0c7716c admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:16.970744 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a46733-8650-48aa-baa1-e153d0c7716c admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:16.971045 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a46733-8650-48aa-baa1-e153d0c7716c admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:16.971359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e96d41-b838-4640-9491-adba197f5b46 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:16.971787 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a46733-8650-48aa-baa1-e153d0c7716c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:16:16.972123 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a46733-8650-48aa-baa1-e153d0c7716c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:16.974398 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a46733-8650-48aa-baa1-e153d0c7716c admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:16.983396 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1393/2792] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:16:16.988620 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1400/2793] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:16:16.989538 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e96d41-b838-4640-9491-adba197f5b46 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:16.992783 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a46733-8650-48aa-baa1-e153d0c7716c admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:17.004762 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e96d41-b838-4640-9491-adba197f5b46 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:17.013780 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a46733-8650-48aa-baa1-e153d0c7716c admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:17.018614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67441a-8b34-4ab3-9392-883fd9d3a9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:17.019285 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67441a-8b34-4ab3-9392-883fd9d3a9cf admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:17.019574 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67441a-8b34-4ab3-9392-883fd9d3a9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:17.020098 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67441a-8b34-4ab3-9392-883fd9d3a9cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:17.022759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67441a-8b34-4ab3-9392-883fd9d3a9cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:17.022908 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9c66f-08cb-4f2d-a124-1e3a0d2cf0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:17.023823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9c66f-08cb-4f2d-a124-1e3a0d2cf0e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:17.024113 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9c66f-08cb-4f2d-a124-1e3a0d2cf0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:17.024395 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9c66f-08cb-4f2d-a124-1e3a0d2cf0e2 admin admin] PATH_INFO: `/v3/projects/2fcec59a01eb483390f44b7b20b65181/users/d7e203e4bfd645d2a28c2650bc1ae17a/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:17.024774 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67441a-8b34-4ab3-9392-883fd9d3a9cf admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:17.044709 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9c66f-08cb-4f2d-a124-1e3a0d2cf0e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fcec59a01eb483390f44b7b20b65181, user_id=d7e203e4bfd645d2a28c2650bc1ae17a, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:17.048208 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9c66f-08cb-4f2d-a124-1e3a0d2cf0e2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:17.061211 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1401/2794] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:16:16 2022] POST /identity/v3/projects => generated 391 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:16:17.065515 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67441a-8b34-4ab3-9392-883fd9d3a9cf admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:17.066274 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1394/2795] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:16:16 2022] PUT /identity/v3/projects/2fcec59a01eb483390f44b7b20b65181/users/d7e203e4bfd645d2a28c2650bc1ae17a/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:16:17.077893 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3789de-0141-485e-b2cd-9343c83a9881 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:17.078222 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3789de-0141-485e-b2cd-9343c83a9881 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:17.078480 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3789de-0141-485e-b2cd-9343c83a9881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:17.109934 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ea3789de-0141-485e-b2cd-9343c83a9881 None None] MFA Rules not processed for user `d7e203e4bfd645d2a28c2650bc1ae17a`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:17.111230 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ea3789de-0141-485e-b2cd-9343c83a9881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:17.125344 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:17.149650 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:17.150770 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67441a-8b34-4ab3-9392-883fd9d3a9cf admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:17.158016 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2edc64-5ed5-4710-b160-f1a57b41d68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:17.158938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2edc64-5ed5-4710-b160-f1a57b41d68c admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:17.159479 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2edc64-5ed5-4710-b160-f1a57b41d68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:17.159873 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2edc64-5ed5-4710-b160-f1a57b41d68c admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:17.160658 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2edc64-5ed5-4710-b160-f1a57b41d68c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:17.162725 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2edc64-5ed5-4710-b160-f1a57b41d68c admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:17.190583 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1402/2796] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:16:17 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:16:17.194370 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2edc64-5ed5-4710-b160-f1a57b41d68c admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:17.194866 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1395/2797] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:17.206877 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3789de-0141-485e-b2cd-9343c83a9881 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:17.208360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ea3789de-0141-485e-b2cd-9343c83a9881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:17.209360 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2edc64-5ed5-4710-b160-f1a57b41d68c admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:17.215283 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01aa750-463c-49aa-9b80-5ab934f27f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:17.216688 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01aa750-463c-49aa-9b80-5ab934f27f19 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:17.217267 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01aa750-463c-49aa-9b80-5ab934f27f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:17.217558 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01aa750-463c-49aa-9b80-5ab934f27f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:17.218295 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01aa750-463c-49aa-9b80-5ab934f27f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:17.220535 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01aa750-463c-49aa-9b80-5ab934f27f19 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:17.237412 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1403/2798] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:16:17.239008 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01aa750-463c-49aa-9b80-5ab934f27f19 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:17.249572 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01aa750-463c-49aa-9b80-5ab934f27f19 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:17.255481 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6bd79-387b-4591-9b3e-179b82ea278f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:17.256017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6bd79-387b-4591-9b3e-179b82ea278f admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:17.256300 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6bd79-387b-4591-9b3e-179b82ea278f admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:17.256630 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6bd79-387b-4591-9b3e-179b82ea278f admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:17.257297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6bd79-387b-4591-9b3e-179b82ea278f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:17.260192 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6bd79-387b-4591-9b3e-179b82ea278f admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:17.271025 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1404/2799] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:16:17.276219 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6bd79-387b-4591-9b3e-179b82ea278f admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:17.283075 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3789de-0141-485e-b2cd-9343c83a9881 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:17.286606 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6bd79-387b-4591-9b3e-179b82ea278f admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:17.288059 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49710ff-1635-4435-8d79-d08af1a7a080 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:17.289389 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49710ff-1635-4435-8d79-d08af1a7a080 service cinder] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:17.289959 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49710ff-1635-4435-8d79-d08af1a7a080 service cinder] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:17.290637 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49710ff-1635-4435-8d79-d08af1a7a080 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:17.291857 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c9810-3233-444d-affe-2b0def8f6302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:17.292891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c9810-3233-444d-affe-2b0def8f6302 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:17.293378 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c9810-3233-444d-affe-2b0def8f6302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:17.294335 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c9810-3233-444d-affe-2b0def8f6302 admin admin] PATH_INFO: `/v3/projects/c501474058684a619d49e56b387c77ba/users/0586c191372c4116972f9b6d54d855b8/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:17.300913 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49710ff-1635-4435-8d79-d08af1a7a080 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:17.302725 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49710ff-1635-4435-8d79-d08af1a7a080 service cinder] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:17.313674 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1396/2800] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:16:17.318154 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c9810-3233-444d-affe-2b0def8f6302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c501474058684a619d49e56b387c77ba, user_id=0586c191372c4116972f9b6d54d855b8, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:17.320850 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c9810-3233-444d-affe-2b0def8f6302 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:17.342540 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1405/2801] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:16:17 2022] PUT /identity/v3/projects/c501474058684a619d49e56b387c77ba/users/0586c191372c4116972f9b6d54d855b8/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:16:17.348879 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41518b6-008e-4ee7-a8fc-3fb4677b2b0d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:17.349176 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41518b6-008e-4ee7-a8fc-3fb4677b2b0d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:17.349465 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41518b6-008e-4ee7-a8fc-3fb4677b2b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:17.380268 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f41518b6-008e-4ee7-a8fc-3fb4677b2b0d None None] MFA Rules not processed for user `0586c191372c4116972f9b6d54d855b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:17.381167 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f41518b6-008e-4ee7-a8fc-3fb4677b2b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:17.462710 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1397/2802] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:17.473493 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c9810-3233-444d-affe-2b0def8f6302 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:17.475423 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b22c9810-3233-444d-affe-2b0def8f6302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:17.548776 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c9810-3233-444d-affe-2b0def8f6302 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:17.554209 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48579d55-573c-4e84-ac3e-17950cd569f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:17.555316 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48579d55-573c-4e84-ac3e-17950cd569f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:17.556052 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48579d55-573c-4e84-ac3e-17950cd569f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:17.556404 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48579d55-573c-4e84-ac3e-17950cd569f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:17.567660 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48579d55-573c-4e84-ac3e-17950cd569f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:17.569794 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48579d55-573c-4e84-ac3e-17950cd569f8 service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:17.592479 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1406/2803] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:16:22.863169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf09c5e-d20b-4871-9bb1-acae9d99f0ca None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:22.863727 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf09c5e-d20b-4871-9bb1-acae9d99f0ca None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:22.864028 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf09c5e-d20b-4871-9bb1-acae9d99f0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:22.896470 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-dcf09c5e-d20b-4871-9bb1-acae9d99f0ca None None] MFA Rules not processed for user `3507fe4fda41401dbe6019e5ac86e241`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:22.901005 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-dcf09c5e-d20b-4871-9bb1-acae9d99f0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:23.062906 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1398/2804] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:23.668412 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48579d55-573c-4e84-ac3e-17950cd569f8 service cinder] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:23.669845 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-48579d55-573c-4e84-ac3e-17950cd569f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:23.788796 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48579d55-573c-4e84-ac3e-17950cd569f8 service cinder] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:23.795017 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629cec9-3f71-4d44-91b2-5c35668e5070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:23.796032 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629cec9-3f71-4d44-91b2-5c35668e5070 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:23.796293 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629cec9-3f71-4d44-91b2-5c35668e5070 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:23.796674 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629cec9-3f71-4d44-91b2-5c35668e5070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:23.799886 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b629cec9-3f71-4d44-91b2-5c35668e5070 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:23.815250 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629cec9-3f71-4d44-91b2-5c35668e5070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:23.816778 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629cec9-3f71-4d44-91b2-5c35668e5070 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:23.826256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1407/2805] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:16:24.569547 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf09c5e-d20b-4871-9bb1-acae9d99f0ca None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:24.571234 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-dcf09c5e-d20b-4871-9bb1-acae9d99f0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:24.589596 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=100 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:24.657759 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf09c5e-d20b-4871-9bb1-acae9d99f0ca None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:24.663172 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754ceec-00ad-4d1c-8962-499ff81170ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:24.664342 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754ceec-00ad-4d1c-8962-499ff81170ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:24.664639 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754ceec-00ad-4d1c-8962-499ff81170ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:24.664921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754ceec-00ad-4d1c-8962-499ff81170ce admin admin] PATH_INFO: `/v3/users/8066c3b7ce244c27a8c5dae3431a7235` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:24.667083 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754ceec-00ad-4d1c-8962-499ff81170ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=8066c3b7ce244c27a8c5dae3431a7235)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:24.669184 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754ceec-00ad-4d1c-8962-499ff81170ce admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:24.734692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8754ceec-00ad-4d1c-8962-499ff81170ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8066c3b7ce244c27a8c5dae3431a7235'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:24.748267 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8754ceec-00ad-4d1c-8962-499ff81170ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8066c3b7ce244c27a8c5dae3431a7235'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:24.757417 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8754ceec-00ad-4d1c-8962-499ff81170ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8066c3b7ce244c27a8c5dae3431a7235'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:24.777675 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8754ceec-00ad-4d1c-8962-499ff81170ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8066c3b7ce244c27a8c5dae3431a7235'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:24.778655 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-8754ceec-00ad-4d1c-8962-499ff81170ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8066c3b7ce244c27a8c5dae3431a7235'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:24.790106 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1399/2806] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:16:24 2022] DELETE /identity/v3/users/8066c3b7ce244c27a8c5dae3431a7235 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:25.013382 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629cec9-3f71-4d44-91b2-5c35668e5070 service neutron] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:25.025773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629cec9-3f71-4d44-91b2-5c35668e5070 service neutron] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:25.077638 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:25.112440 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930e35d-add1-4784-90e9-c096c0d8ffde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:25.113592 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930e35d-add1-4784-90e9-c096c0d8ffde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:25.113971 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930e35d-add1-4784-90e9-c096c0d8ffde admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:25.114319 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930e35d-add1-4784-90e9-c096c0d8ffde admin admin] PATH_INFO: `/v3/projects/86e0a15cb51d4bdabb4624909143a1da` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:25.115656 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930e35d-add1-4784-90e9-c096c0d8ffde admin admin] RBAC: Authorizing `identity:delete_project(project_id=86e0a15cb51d4bdabb4624909143a1da)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:25.117604 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930e35d-add1-4784-90e9-c096c0d8ffde admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:25.177263 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-7930e35d-add1-4784-90e9-c096c0d8ffde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86e0a15cb51d4bdabb4624909143a1da', 'request_id': 'req-7930e35d-add1-4784-90e9-c096c0d8ffde'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:25.183466 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-7930e35d-add1-4784-90e9-c096c0d8ffde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86e0a15cb51d4bdabb4624909143a1da', 'request_id': 'req-7930e35d-add1-4784-90e9-c096c0d8ffde'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:25.189276 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-7930e35d-add1-4784-90e9-c096c0d8ffde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86e0a15cb51d4bdabb4624909143a1da', 'request_id': 'req-7930e35d-add1-4784-90e9-c096c0d8ffde'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:25.202413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-7930e35d-add1-4784-90e9-c096c0d8ffde admin admin] The token cache is being invalidate because project 86e0a15cb51d4bdabb4624909143a1da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:16:25.202683 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-7930e35d-add1-4784-90e9-c096c0d8ffde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:25.203315 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-7930e35d-add1-4784-90e9-c096c0d8ffde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:25.204860 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1408/2807] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:16:25 2022] DELETE /identity/v3/projects/86e0a15cb51d4bdabb4624909143a1da => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:25.209106 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754ceec-00ad-4d1c-8962-499ff81170ce admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:25.210544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8754ceec-00ad-4d1c-8962-499ff81170ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:25.224290 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754ceec-00ad-4d1c-8962-499ff81170ce admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:25.280442 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eca839-263c-4dff-824f-7c23c8429fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:25.281318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eca839-263c-4dff-824f-7c23c8429fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:25.281608 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eca839-263c-4dff-824f-7c23c8429fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:25.281890 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eca839-263c-4dff-824f-7c23c8429fe2 admin admin] PATH_INFO: `/v3/users/9d82b7d9fc334a0e8145845d7ede186b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:25.283114 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eca839-263c-4dff-824f-7c23c8429fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d82b7d9fc334a0e8145845d7ede186b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:25.285042 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eca839-263c-4dff-824f-7c23c8429fe2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:25.313913 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:25.333158 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-15eca839-263c-4dff-824f-7c23c8429fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d82b7d9fc334a0e8145845d7ede186b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:25.341165 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-15eca839-263c-4dff-824f-7c23c8429fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d82b7d9fc334a0e8145845d7ede186b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:25.348683 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-15eca839-263c-4dff-824f-7c23c8429fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d82b7d9fc334a0e8145845d7ede186b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:25.361666 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-15eca839-263c-4dff-824f-7c23c8429fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d82b7d9fc334a0e8145845d7ede186b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:25.362351 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-15eca839-263c-4dff-824f-7c23c8429fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d82b7d9fc334a0e8145845d7ede186b'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:25.368551 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1400/2808] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:16:25 2022] DELETE /identity/v3/users/9d82b7d9fc334a0e8145845d7ede186b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:25.617002 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930e35d-add1-4784-90e9-c096c0d8ffde admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:25.619113 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-7930e35d-add1-4784-90e9-c096c0d8ffde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:25.685147 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930e35d-add1-4784-90e9-c096c0d8ffde admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:25.778541 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68afcf-8866-4076-a98b-a206db826a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:25.779598 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68afcf-8866-4076-a98b-a206db826a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:25.779887 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68afcf-8866-4076-a98b-a206db826a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:25.780342 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68afcf-8866-4076-a98b-a206db826a8a admin admin] PATH_INFO: `/v3/projects/6ad18761fc0f43b0aa9a1ead439ee444` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:25.781871 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68afcf-8866-4076-a98b-a206db826a8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ad18761fc0f43b0aa9a1ead439ee444)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:25.785495 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68afcf-8866-4076-a98b-a206db826a8a admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:25.837234 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-8d68afcf-8866-4076-a98b-a206db826a8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ad18761fc0f43b0aa9a1ead439ee444', 'request_id': 'req-8d68afcf-8866-4076-a98b-a206db826a8a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:25.843297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-8d68afcf-8866-4076-a98b-a206db826a8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ad18761fc0f43b0aa9a1ead439ee444', 'request_id': 'req-8d68afcf-8866-4076-a98b-a206db826a8a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:25.849248 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-8d68afcf-8866-4076-a98b-a206db826a8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ad18761fc0f43b0aa9a1ead439ee444', 'request_id': 'req-8d68afcf-8866-4076-a98b-a206db826a8a'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:25.850926 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:25.863181 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-8d68afcf-8866-4076-a98b-a206db826a8a admin admin] The token cache is being invalidate because project 6ad18761fc0f43b0aa9a1ead439ee444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:16:25.863634 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-8d68afcf-8866-4076-a98b-a206db826a8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:25.864460 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-8d68afcf-8866-4076-a98b-a206db826a8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:25.866280 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1409/2809] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:16:25 2022] DELETE /identity/v3/projects/6ad18761fc0f43b0aa9a1ead439ee444 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:28.268511 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eca839-263c-4dff-824f-7c23c8429fe2 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:28.269945 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-15eca839-263c-4dff-824f-7c23c8429fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:28.349915 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eca839-263c-4dff-824f-7c23c8429fe2 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:28.407401 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbef828-c623-4e6e-b8b2-f3aef6b2d245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:28.408289 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbef828-c623-4e6e-b8b2-f3aef6b2d245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:28.408575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbef828-c623-4e6e-b8b2-f3aef6b2d245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:28.408860 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbef828-c623-4e6e-b8b2-f3aef6b2d245 admin admin] PATH_INFO: `/v3/users/0586c191372c4116972f9b6d54d855b8` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:28.410118 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbef828-c623-4e6e-b8b2-f3aef6b2d245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0586c191372c4116972f9b6d54d855b8)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:28.412085 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbef828-c623-4e6e-b8b2-f3aef6b2d245 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:28.459593 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:28.461268 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4cbef828-c623-4e6e-b8b2-f3aef6b2d245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0586c191372c4116972f9b6d54d855b8'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:28.469169 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4cbef828-c623-4e6e-b8b2-f3aef6b2d245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0586c191372c4116972f9b6d54d855b8'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:28.478229 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4cbef828-c623-4e6e-b8b2-f3aef6b2d245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0586c191372c4116972f9b6d54d855b8'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:28.489947 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4cbef828-c623-4e6e-b8b2-f3aef6b2d245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0586c191372c4116972f9b6d54d855b8'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:28.490674 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-4cbef828-c623-4e6e-b8b2-f3aef6b2d245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0586c191372c4116972f9b6d54d855b8'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:28.497310 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1401/2810] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:16:28 2022] DELETE /identity/v3/users/0586c191372c4116972f9b6d54d855b8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:28.501567 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d478d-93e7-470c-8511-60cda9e5ddab None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:28.502055 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d478d-93e7-470c-8511-60cda9e5ddab None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:28.502055 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d478d-93e7-470c-8511-60cda9e5ddab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:28.531001 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-e99d478d-93e7-470c-8511-60cda9e5ddab None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:28.532753 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e99d478d-93e7-470c-8511-60cda9e5ddab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:28.594357 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1410/2811] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:28.604243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbef828-c623-4e6e-b8b2-f3aef6b2d245 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:28.605665 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4cbef828-c623-4e6e-b8b2-f3aef6b2d245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:28.682054 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbef828-c623-4e6e-b8b2-f3aef6b2d245 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:28.685720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f764a2-813c-43cc-899b-efc1d77a0c84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:28.686368 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f764a2-813c-43cc-899b-efc1d77a0c84 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:28.686687 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f764a2-813c-43cc-899b-efc1d77a0c84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:28.686970 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f764a2-813c-43cc-899b-efc1d77a0c84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:28.696487 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f764a2-813c-43cc-899b-efc1d77a0c84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:28.698418 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f764a2-813c-43cc-899b-efc1d77a0c84 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:28.708030 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1402/2812] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:16:28.975049 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d478d-93e7-470c-8511-60cda9e5ddab None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:28.976659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e99d478d-93e7-470c-8511-60cda9e5ddab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:29.004502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d478d-93e7-470c-8511-60cda9e5ddab None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:29.009754 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adaa7ee-127d-479f-8eaa-b35ae74491e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:29.010655 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaa7ee-127d-479f-8eaa-b35ae74491e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:29.010938 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaa7ee-127d-479f-8eaa-b35ae74491e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:29.011215 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaa7ee-127d-479f-8eaa-b35ae74491e0 admin admin] PATH_INFO: `/v3/projects/c501474058684a619d49e56b387c77ba` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:29.012415 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adaa7ee-127d-479f-8eaa-b35ae74491e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c501474058684a619d49e56b387c77ba)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:29.014313 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adaa7ee-127d-479f-8eaa-b35ae74491e0 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:29.063995 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1adaa7ee-127d-479f-8eaa-b35ae74491e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c501474058684a619d49e56b387c77ba', 'request_id': 'req-1adaa7ee-127d-479f-8eaa-b35ae74491e0'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:29.070100 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1adaa7ee-127d-479f-8eaa-b35ae74491e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c501474058684a619d49e56b387c77ba', 'request_id': 'req-1adaa7ee-127d-479f-8eaa-b35ae74491e0'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:29.076873 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1adaa7ee-127d-479f-8eaa-b35ae74491e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c501474058684a619d49e56b387c77ba', 'request_id': 'req-1adaa7ee-127d-479f-8eaa-b35ae74491e0'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:29.090592 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1adaa7ee-127d-479f-8eaa-b35ae74491e0 admin admin] The token cache is being invalidate because project c501474058684a619d49e56b387c77ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:16:29.090927 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1adaa7ee-127d-479f-8eaa-b35ae74491e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:29.091552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-1adaa7ee-127d-479f-8eaa-b35ae74491e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:29.093289 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1411/2813] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:16:28 2022] DELETE /identity/v3/projects/c501474058684a619d49e56b387c77ba => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:29.098451 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3781c6-85d9-4e51-ac81-b78c8f23823b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:29.098799 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3781c6-85d9-4e51-ac81-b78c8f23823b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:29.099078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3781c6-85d9-4e51-ac81-b78c8f23823b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:29.146508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-fa3781c6-85d9-4e51-ac81-b78c8f23823b None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:29.147715 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-fa3781c6-85d9-4e51-ac81-b78c8f23823b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:29.208158 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1403/2814] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:29.216484 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b29de-3ac8-4712-b81d-ff799d083118 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:29.216777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b29de-3ac8-4712-b81d-ff799d083118 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:29.217053 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b29de-3ac8-4712-b81d-ff799d083118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:29.238226 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-f20b29de-3ac8-4712-b81d-ff799d083118 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:29.239459 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-f20b29de-3ac8-4712-b81d-ff799d083118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:29.247444 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1412/2815] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:29.251566 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3781c6-85d9-4e51-ac81-b78c8f23823b None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:29.265528 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3781c6-85d9-4e51-ac81-b78c8f23823b None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:29.270351 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bf224-a8dc-4d81-9167-517c04a72778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:29.271043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bf224-a8dc-4d81-9167-517c04a72778 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:29.271327 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bf224-a8dc-4d81-9167-517c04a72778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:29.271594 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bf224-a8dc-4d81-9167-517c04a72778 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:29.272355 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bf224-a8dc-4d81-9167-517c04a72778 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:16:29.272646 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bf224-a8dc-4d81-9167-517c04a72778 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:29.274221 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bf224-a8dc-4d81-9167-517c04a72778 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:29.288857 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1404/2816] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:16:29.293119 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b29de-3ac8-4712-b81d-ff799d083118 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:29.302605 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b29de-3ac8-4712-b81d-ff799d083118 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:29.304496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bf224-a8dc-4d81-9167-517c04a72778 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:29.306696 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-336bf224-a8dc-4d81-9167-517c04a72778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:29.307879 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54dcbc0-c91e-4862-8493-75b75289590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:29.308550 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54dcbc0-c91e-4862-8493-75b75289590e admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:29.308805 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54dcbc0-c91e-4862-8493-75b75289590e admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:29.309106 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54dcbc0-c91e-4862-8493-75b75289590e admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:29.309800 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54dcbc0-c91e-4862-8493-75b75289590e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:29.311751 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54dcbc0-c91e-4862-8493-75b75289590e admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:29.320563 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bf224-a8dc-4d81-9167-517c04a72778 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:29.326459 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bda9b9-3559-4579-b78e-943d73570cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:29.327353 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bda9b9-3559-4579-b78e-943d73570cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:29.327670 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bda9b9-3559-4579-b78e-943d73570cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:29.327980 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bda9b9-3559-4579-b78e-943d73570cf3 admin admin] PATH_INFO: `/v3/users/d7e203e4bfd645d2a28c2650bc1ae17a` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:29.329391 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bda9b9-3559-4579-b78e-943d73570cf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7e203e4bfd645d2a28c2650bc1ae17a)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:29.331399 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bda9b9-3559-4579-b78e-943d73570cf3 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:29.336979 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:29.341351 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1413/2817] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:16:29 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:16:29.342367 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54dcbc0-c91e-4862-8493-75b75289590e admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:29.380880 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-55bda9b9-3559-4579-b78e-943d73570cf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7e203e4bfd645d2a28c2650bc1ae17a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:29.388283 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:INSERT=3,keystone:DELETE=8,keystone:SELECT=89 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:29.388430 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-55bda9b9-3559-4579-b78e-943d73570cf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7e203e4bfd645d2a28c2650bc1ae17a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:29.395457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-55bda9b9-3559-4579-b78e-943d73570cf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7e203e4bfd645d2a28c2650bc1ae17a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:29.407436 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-55bda9b9-3559-4579-b78e-943d73570cf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7e203e4bfd645d2a28c2650bc1ae17a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:29.408127 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-55bda9b9-3559-4579-b78e-943d73570cf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7e203e4bfd645d2a28c2650bc1ae17a'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:29.409384 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54dcbc0-c91e-4862-8493-75b75289590e admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:29.414673 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1405/2818] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:16:29 2022] DELETE /identity/v3/users/d7e203e4bfd645d2a28c2650bc1ae17a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:16:29.414826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a063c-0c42-4268-8432-a9a2129fab9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:29.415611 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a063c-0c42-4268-8432-a9a2129fab9a admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:29.415898 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a063c-0c42-4268-8432-a9a2129fab9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:29.416174 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a063c-0c42-4268-8432-a9a2129fab9a admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:29.416866 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a063c-0c42-4268-8432-a9a2129fab9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:29.418990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a063c-0c42-4268-8432-a9a2129fab9a admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:29.419126 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755432d-cf64-4870-b9f9-dee7b3d4e875 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:29.419365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755432d-cf64-4870-b9f9-dee7b3d4e875 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:29.419657 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755432d-cf64-4870-b9f9-dee7b3d4e875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:29.439011 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-4755432d-cf64-4870-b9f9-dee7b3d4e875 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:29.439990 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1414/2819] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:16:29 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:16:29.440230 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4755432d-cf64-4870-b9f9-dee7b3d4e875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:29.443891 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a063c-0c42-4268-8432-a9a2129fab9a admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:29.445460 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-440a063c-0c42-4268-8432-a9a2129fab9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:29.457758 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a063c-0c42-4268-8432-a9a2129fab9a admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:29.500994 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1406/2820] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:16:29.511212 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755432d-cf64-4870-b9f9-dee7b3d4e875 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:29.512526 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-4755432d-cf64-4870-b9f9-dee7b3d4e875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:29.514604 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37d4cf-0fcd-47d5-9646-5def89258e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:29.515285 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37d4cf-0fcd-47d5-9646-5def89258e81 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:29.515571 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37d4cf-0fcd-47d5-9646-5def89258e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:29.515851 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37d4cf-0fcd-47d5-9646-5def89258e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:29.516584 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37d4cf-0fcd-47d5-9646-5def89258e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:29.518194 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37d4cf-0fcd-47d5-9646-5def89258e81 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:29.530848 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1415/2821] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:16:29.531883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37d4cf-0fcd-47d5-9646-5def89258e81 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:29.542201 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37d4cf-0fcd-47d5-9646-5def89258e81 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:29.546930 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accae68c-6958-4c6a-88c8-e1b0931cbf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:29.547594 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accae68c-6958-4c6a-88c8-e1b0931cbf66 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:29.547882 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accae68c-6958-4c6a-88c8-e1b0931cbf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:29.548161 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accae68c-6958-4c6a-88c8-e1b0931cbf66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:29.550095 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accae68c-6958-4c6a-88c8-e1b0931cbf66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:29.550703 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accae68c-6958-4c6a-88c8-e1b0931cbf66 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:29.562522 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1416/2822] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:16:29.566441 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accae68c-6958-4c6a-88c8-e1b0931cbf66 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:29.576402 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755432d-cf64-4870-b9f9-dee7b3d4e875 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:29.577195 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accae68c-6958-4c6a-88c8-e1b0931cbf66 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:29.580112 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79504839-d41c-4e8e-853d-7f059444d7ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:29.580757 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79504839-d41c-4e8e-853d-7f059444d7ed service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:29.581045 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79504839-d41c-4e8e-853d-7f059444d7ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:29.581321 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79504839-d41c-4e8e-853d-7f059444d7ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:29.581794 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd16c8-ae4b-45fa-bc89-83758ab5be2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:29.582807 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd16c8-ae4b-45fa-bc89-83758ab5be2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:29.583090 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd16c8-ae4b-45fa-bc89-83758ab5be2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:29.583362 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd16c8-ae4b-45fa-bc89-83758ab5be2f admin admin] PATH_INFO: `/v3/projects/56e2b90fb93f4e0dabbed560caaab50f/users/3e5bbc2113c148c3893ef968d36f05c9/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:29.590735 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79504839-d41c-4e8e-853d-7f059444d7ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:29.592158 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79504839-d41c-4e8e-853d-7f059444d7ed service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:29.599343 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd16c8-ae4b-45fa-bc89-83758ab5be2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e2b90fb93f4e0dabbed560caaab50f, user_id=3e5bbc2113c148c3893ef968d36f05c9, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:29.601722 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1407/2823] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:16:29.602211 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd16c8-ae4b-45fa-bc89-83758ab5be2f admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:29.615574 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1417/2824] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:16:29 2022] PUT /identity/v3/projects/56e2b90fb93f4e0dabbed560caaab50f/users/3e5bbc2113c148c3893ef968d36f05c9/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:16:29.620982 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0fb1f-4964-450f-9b6f-aee9c53eb759 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:29.621276 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0fb1f-4964-450f-9b6f-aee9c53eb759 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:29.621557 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0fb1f-4964-450f-9b6f-aee9c53eb759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:29.639920 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ccb0fb1f-4964-450f-9b6f-aee9c53eb759 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:29.641137 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ccb0fb1f-4964-450f-9b6f-aee9c53eb759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:29.669063 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:29.707993 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1408/2825] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:29.717749 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd16c8-ae4b-45fa-bc89-83758ab5be2f admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:29.719467 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-1dcd16c8-ae4b-45fa-bc89-83758ab5be2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:29.788874 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd16c8-ae4b-45fa-bc89-83758ab5be2f admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:29.793332 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fdee7-2798-4317-a4f7-26857f3cb0bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:29.793923 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fdee7-2798-4317-a4f7-26857f3cb0bd service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:29.794207 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fdee7-2798-4317-a4f7-26857f3cb0bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:29.794483 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fdee7-2798-4317-a4f7-26857f3cb0bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:29.803687 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553fdee7-2798-4317-a4f7-26857f3cb0bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:29.805137 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553fdee7-2798-4317-a4f7-26857f3cb0bd service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:29.815773 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1418/2826] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:16:29.887310 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0fb1f-4964-450f-9b6f-aee9c53eb759 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:29.889772 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ccb0fb1f-4964-450f-9b6f-aee9c53eb759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:29.908624 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0fb1f-4964-450f-9b6f-aee9c53eb759 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:29.916049 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca70a0-9774-4661-920b-9d7ae08aa1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:29.917227 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca70a0-9774-4661-920b-9d7ae08aa1eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:29.917585 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca70a0-9774-4661-920b-9d7ae08aa1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:29.918254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca70a0-9774-4661-920b-9d7ae08aa1eb admin admin] PATH_INFO: `/v3/projects/2fcec59a01eb483390f44b7b20b65181` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:29.928984 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca70a0-9774-4661-920b-9d7ae08aa1eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fcec59a01eb483390f44b7b20b65181)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:29.932142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca70a0-9774-4661-920b-9d7ae08aa1eb admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:29.990854 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-e4ca70a0-9774-4661-920b-9d7ae08aa1eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fcec59a01eb483390f44b7b20b65181', 'request_id': 'req-e4ca70a0-9774-4661-920b-9d7ae08aa1eb'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:29.998948 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-e4ca70a0-9774-4661-920b-9d7ae08aa1eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fcec59a01eb483390f44b7b20b65181', 'request_id': 'req-e4ca70a0-9774-4661-920b-9d7ae08aa1eb'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:30.007056 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-e4ca70a0-9774-4661-920b-9d7ae08aa1eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fcec59a01eb483390f44b7b20b65181', 'request_id': 'req-e4ca70a0-9774-4661-920b-9d7ae08aa1eb'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:30.027766 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-e4ca70a0-9774-4661-920b-9d7ae08aa1eb admin admin] The token cache is being invalidate because project 2fcec59a01eb483390f44b7b20b65181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:16:30.028323 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-e4ca70a0-9774-4661-920b-9d7ae08aa1eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:30.029068 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-e4ca70a0-9774-4661-920b-9d7ae08aa1eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:30.031172 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1409/2827] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:16:29 2022] DELETE /identity/v3/projects/2fcec59a01eb483390f44b7b20b65181 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:30.035838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827908e7-37c7-45a3-acc3-3270bfe1018b None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:30.036489 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827908e7-37c7-45a3-acc3-3270bfe1018b None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:30.037857 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827908e7-37c7-45a3-acc3-3270bfe1018b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:30.058483 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-827908e7-37c7-45a3-acc3-3270bfe1018b None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:30.059988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-827908e7-37c7-45a3-acc3-3270bfe1018b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:30.096312 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:30.133227 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1419/2828] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:30.143089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0dfe2-b3b4-436a-8b7d-0657a301220b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:30.143381 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0dfe2-b3b4-436a-8b7d-0657a301220b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:30.143717 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0dfe2-b3b4-436a-8b7d-0657a301220b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:30.164356 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-25c0dfe2-b3b4-436a-8b7d-0657a301220b None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:30.165692 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-25c0dfe2-b3b4-436a-8b7d-0657a301220b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:30.175811 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1410/2829] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:30.184376 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827908e7-37c7-45a3-acc3-3270bfe1018b None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:30.202666 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827908e7-37c7-45a3-acc3-3270bfe1018b None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:30.208462 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a51b71-c9ff-431b-a18c-09673bf6e18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:30.209251 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a51b71-c9ff-431b-a18c-09673bf6e18b admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:30.209760 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a51b71-c9ff-431b-a18c-09673bf6e18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:30.210041 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a51b71-c9ff-431b-a18c-09673bf6e18b admin admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:30.211337 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a51b71-c9ff-431b-a18c-09673bf6e18b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:16:30.211650 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a51b71-c9ff-431b-a18c-09673bf6e18b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:30.213648 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a51b71-c9ff-431b-a18c-09673bf6e18b admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:30.231659 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1420/2830] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:16:30.232734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0dfe2-b3b4-436a-8b7d-0657a301220b None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:30.246907 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0dfe2-b3b4-436a-8b7d-0657a301220b None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:30.252394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e46cd-ccae-4dbd-b82a-85e7f49f4389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:30.253072 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e46cd-ccae-4dbd-b82a-85e7f49f4389 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:30.253635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e46cd-ccae-4dbd-b82a-85e7f49f4389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:30.253635 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e46cd-ccae-4dbd-b82a-85e7f49f4389 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:30.254313 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e46cd-ccae-4dbd-b82a-85e7f49f4389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:30.256473 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e46cd-ccae-4dbd-b82a-85e7f49f4389 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:30.286535 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1411/2831] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:16:30 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:16:30.290835 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a51b71-c9ff-431b-a18c-09673bf6e18b admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:30.302853 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a51b71-c9ff-431b-a18c-09673bf6e18b admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:30.369625 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1349a-8c12-4dc2-9530-00720933ce7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:30.370316 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1349a-8c12-4dc2-9530-00720933ce7f admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:30.370628 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1349a-8c12-4dc2-9530-00720933ce7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:30.370901 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1349a-8c12-4dc2-9530-00720933ce7f admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:30.371614 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1349a-8c12-4dc2-9530-00720933ce7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:30.373514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1349a-8c12-4dc2-9530-00720933ce7f admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:30.393745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1421/2832] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:16:30 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:16:30.397748 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e46cd-ccae-4dbd-b82a-85e7f49f4389 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:30.411613 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e46cd-ccae-4dbd-b82a-85e7f49f4389 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:30.417574 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096b48a-74a5-409f-9dbc-210f990b1d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:30.418243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096b48a-74a5-409f-9dbc-210f990b1d4e admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:30.418243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096b48a-74a5-409f-9dbc-210f990b1d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:30.418541 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096b48a-74a5-409f-9dbc-210f990b1d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:30.419407 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096b48a-74a5-409f-9dbc-210f990b1d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:30.421082 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096b48a-74a5-409f-9dbc-210f990b1d4e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:30.433778 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1412/2833] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:16:30.437949 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1349a-8c12-4dc2-9530-00720933ce7f admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:30.449245 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1349a-8c12-4dc2-9530-00720933ce7f admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:30.454125 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028f702-3ceb-4f4b-92a5-979eed63cc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:30.454931 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028f702-3ceb-4f4b-92a5-979eed63cc13 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:30.455302 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028f702-3ceb-4f4b-92a5-979eed63cc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:30.455638 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028f702-3ceb-4f4b-92a5-979eed63cc13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:30.456905 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028f702-3ceb-4f4b-92a5-979eed63cc13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:30.458894 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028f702-3ceb-4f4b-92a5-979eed63cc13 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:30.474018 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1422/2834] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:16:30.475386 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096b48a-74a5-409f-9dbc-210f990b1d4e admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:30.489224 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096b48a-74a5-409f-9dbc-210f990b1d4e admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:30.494401 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1fc9a-a105-43ef-9cad-93a354cdca06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:30.495547 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1fc9a-a105-43ef-9cad-93a354cdca06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:30.495927 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1fc9a-a105-43ef-9cad-93a354cdca06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:30.496297 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1fc9a-a105-43ef-9cad-93a354cdca06 admin admin] PATH_INFO: `/v3/projects/d22abcd1aa2d49c5b0fa7167e9f396c6/users/b94cd99d32304e7c982a5ec119c52871/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:30.513961 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1fc9a-a105-43ef-9cad-93a354cdca06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d22abcd1aa2d49c5b0fa7167e9f396c6, user_id=b94cd99d32304e7c982a5ec119c52871, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:30.517417 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1fc9a-a105-43ef-9cad-93a354cdca06 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:30.538154 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1413/2835] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:16:30 2022] PUT /identity/v3/projects/d22abcd1aa2d49c5b0fa7167e9f396c6/users/b94cd99d32304e7c982a5ec119c52871/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:30.549729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555d7dc-789c-4888-b3c2-6c2e4a4ee682 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:30.550235 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555d7dc-789c-4888-b3c2-6c2e4a4ee682 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:30.550377 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555d7dc-789c-4888-b3c2-6c2e4a4ee682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:30.584502 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-d555d7dc-789c-4888-b3c2-6c2e4a4ee682 None None] MFA Rules not processed for user `b94cd99d32304e7c982a5ec119c52871`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:30.585741 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-d555d7dc-789c-4888-b3c2-6c2e4a4ee682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:30.663057 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1423/2836] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:30.677919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1fc9a-a105-43ef-9cad-93a354cdca06 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:30.679575 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f5c1fc9a-a105-43ef-9cad-93a354cdca06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:30.740908 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:30.745895 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1fc9a-a105-43ef-9cad-93a354cdca06 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:30.751975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62028603-eaa4-496b-85e4-94543f3495d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6921990ec98492f8f4420f911208b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:30.753017 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62028603-eaa4-496b-85e4-94543f3495d7 service glance] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:30.753695 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62028603-eaa4-496b-85e4-94543f3495d7 service glance] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:30.754247 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62028603-eaa4-496b-85e4-94543f3495d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:30.765016 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62028603-eaa4-496b-85e4-94543f3495d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:30.766752 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62028603-eaa4-496b-85e4-94543f3495d7 service glance] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:30.777753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1414/2837] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:30 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:16:34.444177 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd8028-527d-4776-8aa9-589960348150 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:34.444690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd8028-527d-4776-8aa9-589960348150 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:34.444690 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd8028-527d-4776-8aa9-589960348150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:34.474224 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-f6bd8028-527d-4776-8aa9-589960348150 None None] MFA Rules not processed for user `3e5bbc2113c148c3893ef968d36f05c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:34.475485 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-f6bd8028-527d-4776-8aa9-589960348150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:34.496664 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:34.588951 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1424/2838] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:34.593713 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62028603-eaa4-496b-85e4-94543f3495d7 service glance] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:34.595387 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-62028603-eaa4-496b-85e4-94543f3495d7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:34.670269 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62028603-eaa4-496b-85e4-94543f3495d7 service glance] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:34.677074 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b38053-69a6-4d6f-9e44-d517883627d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:34.677755 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b38053-69a6-4d6f-9e44-d517883627d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:34.678041 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b38053-69a6-4d6f-9e44-d517883627d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:34.678852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b38053-69a6-4d6f-9e44-d517883627d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:34.679625 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b38053-69a6-4d6f-9e44-d517883627d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:34.682078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b38053-69a6-4d6f-9e44-d517883627d8 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:34.753242 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1415/2839] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:16:34 2022] POST /identity/v3/projects => generated 371 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:16:34.757293 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd8028-527d-4776-8aa9-589960348150 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:34.775007 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd8028-527d-4776-8aa9-589960348150 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:34.862230 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6c62a-ceac-477b-ab3e-cbdff4cb71fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:34.863126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6c62a-ceac-477b-ab3e-cbdff4cb71fb admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:34.863486 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6c62a-ceac-477b-ab3e-cbdff4cb71fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:34.863839 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6c62a-ceac-477b-ab3e-cbdff4cb71fb admin admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:34.864751 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e6c62a-ceac-477b-ab3e-cbdff4cb71fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:34.866716 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e6c62a-ceac-477b-ab3e-cbdff4cb71fb admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:34.891552 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1425/2840] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:16:34 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:16:34.897030 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b38053-69a6-4d6f-9e44-d517883627d8 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:34.908975 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b38053-69a6-4d6f-9e44-d517883627d8 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:34.915614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9f65c-6e0f-4611-b12f-e5ce0b193817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:34.916370 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9f65c-6e0f-4611-b12f-e5ce0b193817 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:34.916728 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9f65c-6e0f-4611-b12f-e5ce0b193817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:34.917071 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9f65c-6e0f-4611-b12f-e5ce0b193817 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:34.917876 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9f65c-6e0f-4611-b12f-e5ce0b193817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:34.919810 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9f65c-6e0f-4611-b12f-e5ce0b193817 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:34.932631 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1416/2841] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:16:34.936955 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6c62a-ceac-477b-ab3e-cbdff4cb71fb admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:34.952815 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6c62a-ceac-477b-ab3e-cbdff4cb71fb admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:34.960030 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb248985-3c46-4b7a-a203-cfe3eb5b1986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:34.961106 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb248985-3c46-4b7a-a203-cfe3eb5b1986 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:34.961468 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb248985-3c46-4b7a-a203-cfe3eb5b1986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:34.961849 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb248985-3c46-4b7a-a203-cfe3eb5b1986 admin admin] PATH_INFO: `/v3/projects/4997de68e6b34ee0a19acde6ade1cd15/users/ef01e71686114707bde1537733d1e93f/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:34.983190 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb248985-3c46-4b7a-a203-cfe3eb5b1986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4997de68e6b34ee0a19acde6ade1cd15, user_id=ef01e71686114707bde1537733d1e93f, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:34.989056 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb248985-3c46-4b7a-a203-cfe3eb5b1986 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:35.009767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1426/2842] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:16:34 2022] PUT /identity/v3/projects/4997de68e6b34ee0a19acde6ade1cd15/users/ef01e71686114707bde1537733d1e93f/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:35.013723 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9f65c-6e0f-4611-b12f-e5ce0b193817 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:35.025816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9f65c-6e0f-4611-b12f-e5ce0b193817 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:35.097756 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f938836-1a6c-466d-b03c-b44db52d331b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:35.098597 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f938836-1a6c-466d-b03c-b44db52d331b admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:35.098954 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f938836-1a6c-466d-b03c-b44db52d331b admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:35.099291 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f938836-1a6c-466d-b03c-b44db52d331b admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:35.100037 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f938836-1a6c-466d-b03c-b44db52d331b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:35.101710 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f938836-1a6c-466d-b03c-b44db52d331b admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:35.116454 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1417/2843] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:16:35.117944 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb248985-3c46-4b7a-a203-cfe3eb5b1986 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:35.128697 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb248985-3c46-4b7a-a203-cfe3eb5b1986 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:35.133279 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e06d3-02e3-402f-bc22-3788e3d0c298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:35.134399 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e06d3-02e3-402f-bc22-3788e3d0c298 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:35.134563 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e06d3-02e3-402f-bc22-3788e3d0c298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:35.134787 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e06d3-02e3-402f-bc22-3788e3d0c298 admin admin] PATH_INFO: `/v3/projects/4997de68e6b34ee0a19acde6ade1cd15/users/ef01e71686114707bde1537733d1e93f/roles/eff4f9bbb7064bc1a0f9fc55a05fea51` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:35.136776 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e06d3-02e3-402f-bc22-3788e3d0c298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4997de68e6b34ee0a19acde6ade1cd15, user_id=ef01e71686114707bde1537733d1e93f, role_id=eff4f9bbb7064bc1a0f9fc55a05fea51)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:35.139450 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e06d3-02e3-402f-bc22-3788e3d0c298 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:35.157164 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1427/2844] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:16:35 2022] PUT /identity/v3/projects/4997de68e6b34ee0a19acde6ade1cd15/users/ef01e71686114707bde1537733d1e93f/roles/eff4f9bbb7064bc1a0f9fc55a05fea51 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:40.613699 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fb8fd-5f17-4cfc-a2c8-7d7add756def None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:40.614151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fb8fd-5f17-4cfc-a2c8-7d7add756def None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:40.614151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fb8fd-5f17-4cfc-a2c8-7d7add756def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:40.650769 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-0d4fb8fd-5f17-4cfc-a2c8-7d7add756def None None] MFA Rules not processed for user `ef01e71686114707bde1537733d1e93f`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:40.652309 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0d4fb8fd-5f17-4cfc-a2c8-7d7add756def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:40.725878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad84c91-b132-43d7-aa0f-d376b19a6d82 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:40.726394 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad84c91-b132-43d7-aa0f-d376b19a6d82 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:40.726526 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad84c91-b132-43d7-aa0f-d376b19a6d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:40.735385 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:40.778156 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-1ad84c91-b132-43d7-aa0f-d376b19a6d82 None None] MFA Rules not processed for user `f64d942793a5493787c3e5c7815bc134`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:40.779788 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-1ad84c91-b132-43d7-aa0f-d376b19a6d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:40.790207 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1418/2845] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:40 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:40.808567 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fb8fd-5f17-4cfc-a2c8-7d7add756def None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:40.810352 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0d4fb8fd-5f17-4cfc-a2c8-7d7add756def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:40.864795 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:40.882096 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1428/2846] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Jul 14 12:16:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:16:40.891674 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad84c91-b132-43d7-aa0f-d376b19a6d82 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:40.893232 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-1ad84c91-b132-43d7-aa0f-d376b19a6d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:40.988256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad84c91-b132-43d7-aa0f-d376b19a6d82 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:40.989135 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fb8fd-5f17-4cfc-a2c8-7d7add756def None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:40.995003 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2379219-4dbb-43ec-98ce-0d75a00e14ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969ee98dfe644ef2a016860aa1585317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:40.995883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2379219-4dbb-43ec-98ce-0d75a00e14ff service swift] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:40.996271 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2379219-4dbb-43ec-98ce-0d75a00e14ff service swift] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:40.996669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2379219-4dbb-43ec-98ce-0d75a00e14ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:41.000775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fef6ec-9844-403b-9019-2e1fbd06b797 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:41.001712 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fef6ec-9844-403b-9019-2e1fbd06b797 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:41.002224 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fef6ec-9844-403b-9019-2e1fbd06b797 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:41.002705 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fef6ec-9844-403b-9019-2e1fbd06b797 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:41.011680 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2379219-4dbb-43ec-98ce-0d75a00e14ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:41.015086 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2379219-4dbb-43ec-98ce-0d75a00e14ff service swift] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:41.033923 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1429/2847] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Jul 14 12:16:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 12:16:41.142183 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fef6ec-9844-403b-9019-2e1fbd06b797 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:41.144167 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fef6ec-9844-403b-9019-2e1fbd06b797 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:41.165931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1419/2848] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:16:42.419282 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588be567-d5af-413a-be2b-b0c77035bfe1 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:42.419768 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588be567-d5af-413a-be2b-b0c77035bfe1 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:42.419868 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588be567-d5af-413a-be2b-b0c77035bfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:42.438264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-588be567-d5af-413a-be2b-b0c77035bfe1 None None] MFA Rules not processed for user `3e5bbc2113c148c3893ef968d36f05c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:42.439741 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-588be567-d5af-413a-be2b-b0c77035bfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:42.447498 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1430/2849] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:51.149990 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=71 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:52.432142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=35 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:53.975272 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fef6ec-9844-403b-9019-2e1fbd06b797 service nova] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:54.055836 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fef6ec-9844-403b-9019-2e1fbd06b797 service nova] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:54.062254 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cfdb8-2045-4b16-b7d6-e5f5d60ec27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:54.062944 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cfdb8-2045-4b16-b7d6-e5f5d60ec27c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:54.063631 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cfdb8-2045-4b16-b7d6-e5f5d60ec27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:54.063631 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cfdb8-2045-4b16-b7d6-e5f5d60ec27c admin admin] PATH_INFO: `/v3/users/b94cd99d32304e7c982a5ec119c52871` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:54.064836 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cfdb8-2045-4b16-b7d6-e5f5d60ec27c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b94cd99d32304e7c982a5ec119c52871)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:54.066973 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cfdb8-2045-4b16-b7d6-e5f5d60ec27c admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:54.123687 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-797cfdb8-2045-4b16-b7d6-e5f5d60ec27c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b94cd99d32304e7c982a5ec119c52871'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:54.135619 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-797cfdb8-2045-4b16-b7d6-e5f5d60ec27c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b94cd99d32304e7c982a5ec119c52871'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:54.143508 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-797cfdb8-2045-4b16-b7d6-e5f5d60ec27c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b94cd99d32304e7c982a5ec119c52871'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:54.157210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-797cfdb8-2045-4b16-b7d6-e5f5d60ec27c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b94cd99d32304e7c982a5ec119c52871'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:54.158113 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-797cfdb8-2045-4b16-b7d6-e5f5d60ec27c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b94cd99d32304e7c982a5ec119c52871'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:54.164632 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1420/2850] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:16:53 2022] DELETE /identity/v3/users/b94cd99d32304e7c982a5ec119c52871 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:54.169058 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34555d-2ec0-43a4-ba56-d25972ae9d6f None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:54.169689 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34555d-2ec0-43a4-ba56-d25972ae9d6f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:54.169689 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34555d-2ec0-43a4-ba56-d25972ae9d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:54.192717 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-ed34555d-2ec0-43a4-ba56-d25972ae9d6f None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:54.194107 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ed34555d-2ec0-43a4-ba56-d25972ae9d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:54.260697 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1431/2851] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:16:54.270151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cfdb8-2045-4b16-b7d6-e5f5d60ec27c admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:54.271639 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-797cfdb8-2045-4b16-b7d6-e5f5d60ec27c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:54.362435 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cfdb8-2045-4b16-b7d6-e5f5d60ec27c admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:54.366461 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee52225-f2c2-4ad7-b124-af7bb9b3c9b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:54.367284 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee52225-f2c2-4ad7-b124-af7bb9b3c9b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:54.368095 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee52225-f2c2-4ad7-b124-af7bb9b3c9b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:54.368384 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee52225-f2c2-4ad7-b124-af7bb9b3c9b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:54.379485 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee52225-f2c2-4ad7-b124-af7bb9b3c9b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:54.381824 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee52225-f2c2-4ad7-b124-af7bb9b3c9b1 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:54.394529 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1421/2852] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:16:54.698729 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34555d-2ec0-43a4-ba56-d25972ae9d6f None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:54.700852 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ed34555d-2ec0-43a4-ba56-d25972ae9d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:54.717103 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34555d-2ec0-43a4-ba56-d25972ae9d6f None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:54.723420 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc26e59-b15c-4a25-aa50-534e158b2fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:54.724480 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc26e59-b15c-4a25-aa50-534e158b2fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:54.724775 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc26e59-b15c-4a25-aa50-534e158b2fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:54.725055 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc26e59-b15c-4a25-aa50-534e158b2fca admin admin] PATH_INFO: `/v3/projects/d22abcd1aa2d49c5b0fa7167e9f396c6` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:54.726288 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc26e59-b15c-4a25-aa50-534e158b2fca admin admin] RBAC: Authorizing `identity:delete_project(project_id=d22abcd1aa2d49c5b0fa7167e9f396c6)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:54.729130 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc26e59-b15c-4a25-aa50-534e158b2fca admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:54.790967 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9dc26e59-b15c-4a25-aa50-534e158b2fca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd22abcd1aa2d49c5b0fa7167e9f396c6', 'request_id': 'req-9dc26e59-b15c-4a25-aa50-534e158b2fca'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:54.798514 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9dc26e59-b15c-4a25-aa50-534e158b2fca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd22abcd1aa2d49c5b0fa7167e9f396c6', 'request_id': 'req-9dc26e59-b15c-4a25-aa50-534e158b2fca'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:54.804427 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9dc26e59-b15c-4a25-aa50-534e158b2fca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd22abcd1aa2d49c5b0fa7167e9f396c6', 'request_id': 'req-9dc26e59-b15c-4a25-aa50-534e158b2fca'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:54.820160 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9dc26e59-b15c-4a25-aa50-534e158b2fca admin admin] The token cache is being invalidate because project d22abcd1aa2d49c5b0fa7167e9f396c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:16:54.820826 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9dc26e59-b15c-4a25-aa50-534e158b2fca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:54.821915 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9dc26e59-b15c-4a25-aa50-534e158b2fca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:16:54.823764 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1432/2853] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:16:54 2022] DELETE /identity/v3/projects/d22abcd1aa2d49c5b0fa7167e9f396c6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:16:54.828546 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b3294-bcaf-4695-b7b2-edebc1a7f951 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:54.828873 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b3294-bcaf-4695-b7b2-edebc1a7f951 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:54.829144 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b3294-bcaf-4695-b7b2-edebc1a7f951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:54.835634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:54.853364 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-877b3294-bcaf-4695-b7b2-edebc1a7f951 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:54.854770 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-877b3294-bcaf-4695-b7b2-edebc1a7f951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:54.929744 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1422/2854] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:54.939092 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1ad6b-323d-49ab-b034-ae6319f996b5 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:54.939455 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1ad6b-323d-49ab-b034-ae6319f996b5 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:54.939684 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1ad6b-323d-49ab-b034-ae6319f996b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:54.961479 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-a5c1ad6b-323d-49ab-b034-ae6319f996b5 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:54.963037 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a5c1ad6b-323d-49ab-b034-ae6319f996b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:54.972261 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1433/2855] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:54.977030 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b3294-bcaf-4695-b7b2-edebc1a7f951 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:54.990345 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b3294-bcaf-4695-b7b2-edebc1a7f951 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:54.996271 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3e952-00de-4f84-b322-14b8fdfaf87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:54.996944 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3e952-00de-4f84-b322-14b8fdfaf87f admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:54.997233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3e952-00de-4f84-b322-14b8fdfaf87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:54.997513 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3e952-00de-4f84-b322-14b8fdfaf87f admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:54.998248 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3e952-00de-4f84-b322-14b8fdfaf87f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:16:54.999138 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3e952-00de-4f84-b322-14b8fdfaf87f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:55.000822 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3e952-00de-4f84-b322-14b8fdfaf87f admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:55.014952 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1423/2856] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:16:55.019334 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1ad6b-323d-49ab-b034-ae6319f996b5 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:55.028748 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1ad6b-323d-49ab-b034-ae6319f996b5 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:55.033430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e7f3d-d647-4aa3-a653-85205e1fa067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:55.034075 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e7f3d-d647-4aa3-a653-85205e1fa067 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:55.034357 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e7f3d-d647-4aa3-a653-85205e1fa067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:55.034742 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e7f3d-d647-4aa3-a653-85205e1fa067 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:55.035479 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e7f3d-d647-4aa3-a653-85205e1fa067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:55.037418 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e7f3d-d647-4aa3-a653-85205e1fa067 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:55.077948 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1434/2857] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:16:55 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:16:55.079055 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3e952-00de-4f84-b322-14b8fdfaf87f admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:55.089916 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3e952-00de-4f84-b322-14b8fdfaf87f admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:55.162640 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c036c9-21db-4a31-9ff7-1db7bd79352e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:55.163603 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c036c9-21db-4a31-9ff7-1db7bd79352e admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:55.163861 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c036c9-21db-4a31-9ff7-1db7bd79352e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:55.164133 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c036c9-21db-4a31-9ff7-1db7bd79352e admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:55.164878 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c036c9-21db-4a31-9ff7-1db7bd79352e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:55.166816 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c036c9-21db-4a31-9ff7-1db7bd79352e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:55.191747 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1424/2858] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:16:55 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:16:55.197122 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e7f3d-d647-4aa3-a653-85205e1fa067 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:55.210371 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e7f3d-d647-4aa3-a653-85205e1fa067 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:55.216919 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bf885-4ced-42d5-a8fa-69378d2f32e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:55.217843 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bf885-4ced-42d5-a8fa-69378d2f32e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:55.218200 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bf885-4ced-42d5-a8fa-69378d2f32e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:55.218616 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bf885-4ced-42d5-a8fa-69378d2f32e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:55.219408 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bf885-4ced-42d5-a8fa-69378d2f32e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:55.221143 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bf885-4ced-42d5-a8fa-69378d2f32e8 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:55.234836 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1435/2859] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:16:55.238944 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c036c9-21db-4a31-9ff7-1db7bd79352e admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:55.249585 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c036c9-21db-4a31-9ff7-1db7bd79352e admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:55.254823 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc6c5d-5316-47bb-a824-9e9c578af124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:55.255496 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc6c5d-5316-47bb-a824-9e9c578af124 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:55.256409 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc6c5d-5316-47bb-a824-9e9c578af124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:55.256734 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc6c5d-5316-47bb-a824-9e9c578af124 admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:55.257447 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc6c5d-5316-47bb-a824-9e9c578af124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:55.259766 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc6c5d-5316-47bb-a824-9e9c578af124 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:55.270589 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1425/2860] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:16:55.275507 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bf885-4ced-42d5-a8fa-69378d2f32e8 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:55.287310 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bf885-4ced-42d5-a8fa-69378d2f32e8 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:55.293249 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a098d-3d48-418f-bb23-9225712fbf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:55.294265 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a098d-3d48-418f-bb23-9225712fbf22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:55.294588 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a098d-3d48-418f-bb23-9225712fbf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:55.294877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a098d-3d48-418f-bb23-9225712fbf22 admin admin] PATH_INFO: `/v3/projects/09bc5b53d88d4f9cacada1930c74eff2/users/58e2de64bc0e4a909c7b52622bc04a5f/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:55.310156 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a098d-3d48-418f-bb23-9225712fbf22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09bc5b53d88d4f9cacada1930c74eff2, user_id=58e2de64bc0e4a909c7b52622bc04a5f, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:55.312871 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a098d-3d48-418f-bb23-9225712fbf22 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:55.328932 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1436/2861] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:16:55 2022] PUT /identity/v3/projects/09bc5b53d88d4f9cacada1930c74eff2/users/58e2de64bc0e4a909c7b52622bc04a5f/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:16:55.393341 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec9516-dce0-4d30-b54c-21db24d804dd None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:55.393634 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec9516-dce0-4d30-b54c-21db24d804dd None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:55.393951 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec9516-dce0-4d30-b54c-21db24d804dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:55.426852 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e3ec9516-dce0-4d30-b54c-21db24d804dd None None] MFA Rules not processed for user `58e2de64bc0e4a909c7b52622bc04a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:16:55.429825 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e3ec9516-dce0-4d30-b54c-21db24d804dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:55.495328 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:55.502779 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1426/2862] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:16:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:16:55.514909 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a098d-3d48-418f-bb23-9225712fbf22 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:16:55.516679 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-789a098d-3d48-418f-bb23-9225712fbf22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:16:55.543795 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:55.609301 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a098d-3d48-418f-bb23-9225712fbf22 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:16:55.613346 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890afb3-ee07-4e60-9bfe-b95934f0be90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:16:55.614084 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890afb3-ee07-4e60-9bfe-b95934f0be90 service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:16:55.614430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890afb3-ee07-4e60-9bfe-b95934f0be90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:16:55.614817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890afb3-ee07-4e60-9bfe-b95934f0be90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:16:55.625279 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890afb3-ee07-4e60-9bfe-b95934f0be90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:16:55.626886 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890afb3-ee07-4e60-9bfe-b95934f0be90 service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:16:55.637207 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1437/2863] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:16:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:17:05.506705 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:17:05.632450 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=26 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:17:05.972304 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec9516-dce0-4d30-b54c-21db24d804dd None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:17:06.050149 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec9516-dce0-4d30-b54c-21db24d804dd None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:17:06.055241 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e89c0-ad08-48f7-a1d3-dc3f1bb033bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:17:06.056120 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e89c0-ad08-48f7-a1d3-dc3f1bb033bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:06.056405 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e89c0-ad08-48f7-a1d3-dc3f1bb033bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:06.056683 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e89c0-ad08-48f7-a1d3-dc3f1bb033bb admin admin] PATH_INFO: `/v3/users/58e2de64bc0e4a909c7b52622bc04a5f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:06.057882 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e89c0-ad08-48f7-a1d3-dc3f1bb033bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=58e2de64bc0e4a909c7b52622bc04a5f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:17:06.060936 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e89c0-ad08-48f7-a1d3-dc3f1bb033bb admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:17:06.119985 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-9b6e89c0-ad08-48f7-a1d3-dc3f1bb033bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58e2de64bc0e4a909c7b52622bc04a5f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:06.128864 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-9b6e89c0-ad08-48f7-a1d3-dc3f1bb033bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58e2de64bc0e4a909c7b52622bc04a5f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:06.137957 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-9b6e89c0-ad08-48f7-a1d3-dc3f1bb033bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58e2de64bc0e4a909c7b52622bc04a5f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:06.152921 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-9b6e89c0-ad08-48f7-a1d3-dc3f1bb033bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58e2de64bc0e4a909c7b52622bc04a5f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:06.153794 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-9b6e89c0-ad08-48f7-a1d3-dc3f1bb033bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58e2de64bc0e4a909c7b52622bc04a5f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:06.159801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1427/2864] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:17:05 2022] DELETE /identity/v3/users/58e2de64bc0e4a909c7b52622bc04a5f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:17:06.166256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb25e5-6b60-4fa1-9db7-203fdd8a9087 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:06.166747 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb25e5-6b60-4fa1-9db7-203fdd8a9087 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:06.167140 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb25e5-6b60-4fa1-9db7-203fdd8a9087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:06.210180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-97fb25e5-6b60-4fa1-9db7-203fdd8a9087 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:17:06.211965 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-97fb25e5-6b60-4fa1-9db7-203fdd8a9087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:17:06.284601 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1438/2865] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:17:06.295086 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e89c0-ad08-48f7-a1d3-dc3f1bb033bb admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:17:06.296513 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9b6e89c0-ad08-48f7-a1d3-dc3f1bb033bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:17:06.358777 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e89c0-ad08-48f7-a1d3-dc3f1bb033bb admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:17:06.362452 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb84ef-3bea-47d7-adb5-3a9aee8882e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:17:06.363125 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb84ef-3bea-47d7-adb5-3a9aee8882e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:06.363411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb84ef-3bea-47d7-adb5-3a9aee8882e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:06.363683 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb84ef-3bea-47d7-adb5-3a9aee8882e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:06.372893 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb84ef-3bea-47d7-adb5-3a9aee8882e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:17:06.374368 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb84ef-3bea-47d7-adb5-3a9aee8882e4 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:17:06.385719 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1428/2866] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:17:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:17:06.670907 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb25e5-6b60-4fa1-9db7-203fdd8a9087 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:17:06.672734 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-97fb25e5-6b60-4fa1-9db7-203fdd8a9087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:17:06.673730 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb84ef-3bea-47d7-adb5-3a9aee8882e4 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:17:06.676038 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9fbb84ef-3bea-47d7-adb5-3a9aee8882e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:17:06.690282 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb84ef-3bea-47d7-adb5-3a9aee8882e4 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:17:06.697540 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736b84a-0f54-4ace-a5d3-1417ea07070e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:17:06.698614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736b84a-0f54-4ace-a5d3-1417ea07070e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:06.699033 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736b84a-0f54-4ace-a5d3-1417ea07070e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:06.699588 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736b84a-0f54-4ace-a5d3-1417ea07070e admin admin] PATH_INFO: `/v3/projects/09bc5b53d88d4f9cacada1930c74eff2` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:06.700861 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736b84a-0f54-4ace-a5d3-1417ea07070e admin admin] RBAC: Authorizing `identity:delete_project(project_id=09bc5b53d88d4f9cacada1930c74eff2)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:17:06.702801 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736b84a-0f54-4ace-a5d3-1417ea07070e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:17:06.720714 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:17:06.758736 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-3736b84a-0f54-4ace-a5d3-1417ea07070e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09bc5b53d88d4f9cacada1930c74eff2', 'request_id': 'req-3736b84a-0f54-4ace-a5d3-1417ea07070e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:06.764938 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-3736b84a-0f54-4ace-a5d3-1417ea07070e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09bc5b53d88d4f9cacada1930c74eff2', 'request_id': 'req-3736b84a-0f54-4ace-a5d3-1417ea07070e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:06.770804 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-3736b84a-0f54-4ace-a5d3-1417ea07070e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09bc5b53d88d4f9cacada1930c74eff2', 'request_id': 'req-3736b84a-0f54-4ace-a5d3-1417ea07070e'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:06.777101 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb25e5-6b60-4fa1-9db7-203fdd8a9087 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:17:06.783608 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-3736b84a-0f54-4ace-a5d3-1417ea07070e admin admin] The token cache is being invalidate because project 09bc5b53d88d4f9cacada1930c74eff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:17:06.783986 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-3736b84a-0f54-4ace-a5d3-1417ea07070e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:06.784697 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-3736b84a-0f54-4ace-a5d3-1417ea07070e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:06.786180 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1429/2867] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:17:06 2022] DELETE /identity/v3/projects/09bc5b53d88d4f9cacada1930c74eff2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:17:06.841387 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7599a-3037-442f-a540-8908e8205e54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6070c6b901f4e2ebe621a3e42dd2d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:17:06.842057 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7599a-3037-442f-a540-8908e8205e54 service placement] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:06.842342 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7599a-3037-442f-a540-8908e8205e54 service placement] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:06.842653 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7599a-3037-442f-a540-8908e8205e54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:06.844507 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-f4e7599a-3037-442f-a540-8908e8205e54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:17:06.856877 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7599a-3037-442f-a540-8908e8205e54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:17:06.858538 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7599a-3037-442f-a540-8908e8205e54 service placement] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:17:06.870576 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1439/2868] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:17:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:17:07.034365 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6cea9-2336-49c6-bb87-1bffeca107ce None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:07.034688 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6cea9-2336-49c6-bb87-1bffeca107ce None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:07.035029 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6cea9-2336-49c6-bb87-1bffeca107ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:07.056514 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-63b6cea9-2336-49c6-bb87-1bffeca107ce None None] MFA Rules not processed for user `f64d942793a5493787c3e5c7815bc134`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:17:07.057720 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-63b6cea9-2336-49c6-bb87-1bffeca107ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:17:07.113669 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1430/2869] 10.222.0.79 () {58 vars in 967 bytes} [Thu Jul 14 12:17:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:17:07.125714 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7599a-3037-442f-a540-8908e8205e54 service placement] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:17:07.127126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-f4e7599a-3037-442f-a540-8908e8205e54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:17:07.142205 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=100 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:17:07.199266 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7599a-3037-442f-a540-8908e8205e54 service placement] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:17:07.204226 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ab0cb-e251-42fb-a108-a08c0d696e7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969ee98dfe644ef2a016860aa1585317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:17:07.204875 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ab0cb-e251-42fb-a108-a08c0d696e7a service swift] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:07.205162 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ab0cb-e251-42fb-a108-a08c0d696e7a service swift] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:07.205444 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ab0cb-e251-42fb-a108-a08c0d696e7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:07.214032 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ab0cb-e251-42fb-a108-a08c0d696e7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:17:07.215670 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ab0cb-e251-42fb-a108-a08c0d696e7a service swift] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:17:07.223737 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1440/2870] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Jul 14 12:17:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 12:17:09.207038 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6cea9-2336-49c6-bb87-1bffeca107ce None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:17:09.210174 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-63b6cea9-2336-49c6-bb87-1bffeca107ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:17:09.279404 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6cea9-2336-49c6-bb87-1bffeca107ce None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:17:09.283898 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0ec21-f7a1-4b8a-b952-b3deb3a79f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:17:09.284770 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0ec21-f7a1-4b8a-b952-b3deb3a79f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:09.285053 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0ec21-f7a1-4b8a-b952-b3deb3a79f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:09.285328 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0ec21-f7a1-4b8a-b952-b3deb3a79f60 admin admin] PATH_INFO: `/v3/users/3507fe4fda41401dbe6019e5ac86e241` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:09.286641 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0ec21-f7a1-4b8a-b952-b3deb3a79f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3507fe4fda41401dbe6019e5ac86e241)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:17:09.288826 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0ec21-f7a1-4b8a-b952-b3deb3a79f60 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:17:09.339393 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-76a0ec21-f7a1-4b8a-b952-b3deb3a79f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3507fe4fda41401dbe6019e5ac86e241'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:09.343186 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:17:09.347988 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-76a0ec21-f7a1-4b8a-b952-b3deb3a79f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3507fe4fda41401dbe6019e5ac86e241'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:09.357051 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-76a0ec21-f7a1-4b8a-b952-b3deb3a79f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3507fe4fda41401dbe6019e5ac86e241'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:09.374263 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-76a0ec21-f7a1-4b8a-b952-b3deb3a79f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3507fe4fda41401dbe6019e5ac86e241'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:09.375133 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-76a0ec21-f7a1-4b8a-b952-b3deb3a79f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3507fe4fda41401dbe6019e5ac86e241'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:09.381399 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1431/2871] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:17:09 2022] DELETE /identity/v3/users/3507fe4fda41401dbe6019e5ac86e241 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:17:09.557195 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ab0cb-e251-42fb-a108-a08c0d696e7a service swift] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:17:09.577506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ab0cb-e251-42fb-a108-a08c0d696e7a service swift] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:17:09.637474 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1ead4-e2e6-4d57-ab68-89c5eca58080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:17:09.638241 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1ead4-e2e6-4d57-ab68-89c5eca58080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:09.638553 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1ead4-e2e6-4d57-ab68-89c5eca58080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:09.638833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1ead4-e2e6-4d57-ab68-89c5eca58080 admin admin] PATH_INFO: `/v3/projects/7787878875b74437b2f061d0e0b1cdab` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:09.640045 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1ead4-e2e6-4d57-ab68-89c5eca58080 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7787878875b74437b2f061d0e0b1cdab)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:17:09.642162 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1ead4-e2e6-4d57-ab68-89c5eca58080 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:17:09.692318 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-88d1ead4-e2e6-4d57-ab68-89c5eca58080 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7787878875b74437b2f061d0e0b1cdab', 'request_id': 'req-88d1ead4-e2e6-4d57-ab68-89c5eca58080'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:09.699318 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-88d1ead4-e2e6-4d57-ab68-89c5eca58080 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7787878875b74437b2f061d0e0b1cdab', 'request_id': 'req-88d1ead4-e2e6-4d57-ab68-89c5eca58080'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:09.705698 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-88d1ead4-e2e6-4d57-ab68-89c5eca58080 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7787878875b74437b2f061d0e0b1cdab', 'request_id': 'req-88d1ead4-e2e6-4d57-ab68-89c5eca58080'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:09.718704 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-88d1ead4-e2e6-4d57-ab68-89c5eca58080 admin admin] The token cache is being invalidate because project 7787878875b74437b2f061d0e0b1cdab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:17:09.719002 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-88d1ead4-e2e6-4d57-ab68-89c5eca58080 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:09.719648 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-88d1ead4-e2e6-4d57-ab68-89c5eca58080 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:09.721265 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1441/2872] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:17:09 2022] DELETE /identity/v3/projects/7787878875b74437b2f061d0e0b1cdab => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:17:09.727127 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd226ae-18bb-4e61-9371-02b151ef73f8 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:09.727497 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd226ae-18bb-4e61-9371-02b151ef73f8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:09.727784 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd226ae-18bb-4e61-9371-02b151ef73f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:09.746412 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-fbd226ae-18bb-4e61-9371-02b151ef73f8 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:17:09.747632 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-fbd226ae-18bb-4e61-9371-02b151ef73f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:17:09.805931 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1432/2873] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:17:09.865386 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4338fd0-48a0-4f58-9f72-8a51d37551b6 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:09.865683 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4338fd0-48a0-4f58-9f72-8a51d37551b6 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:09.865964 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4338fd0-48a0-4f58-9f72-8a51d37551b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:09.885349 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-d4338fd0-48a0-4f58-9f72-8a51d37551b6 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:17:09.886619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-d4338fd0-48a0-4f58-9f72-8a51d37551b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:17:09.894847 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1442/2874] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:17:09.899031 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd226ae-18bb-4e61-9371-02b151ef73f8 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:17:09.908668 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd226ae-18bb-4e61-9371-02b151ef73f8 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:17:09.913486 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220bef77-4f6e-40f3-9524-21cd46060fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:17:09.914131 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bef77-4f6e-40f3-9524-21cd46060fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:09.914412 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bef77-4f6e-40f3-9524-21cd46060fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:09.914750 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bef77-4f6e-40f3-9524-21cd46060fc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:09.915468 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220bef77-4f6e-40f3-9524-21cd46060fc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:17:09.915770 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220bef77-4f6e-40f3-9524-21cd46060fc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:17:09.917347 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220bef77-4f6e-40f3-9524-21cd46060fc9 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:17:09.928613 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1433/2875] 10.222.0.79 () {58 vars in 1152 bytes} [Thu Jul 14 12:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:17:09.933333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4338fd0-48a0-4f58-9f72-8a51d37551b6 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:17:09.942518 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4338fd0-48a0-4f58-9f72-8a51d37551b6 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:17:09.947901 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e27d7c-582a-43e1-bcfd-c55b756d0e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:17:09.948606 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e27d7c-582a-43e1-bcfd-c55b756d0e14 admin admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:09.948899 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e27d7c-582a-43e1-bcfd-c55b756d0e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:09.949211 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e27d7c-582a-43e1-bcfd-c55b756d0e14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:09.949897 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e27d7c-582a-43e1-bcfd-c55b756d0e14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:17:09.951838 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e27d7c-582a-43e1-bcfd-c55b756d0e14 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:17:09.976695 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1443/2876] 10.222.0.79 () {60 vars in 1152 bytes} [Thu Jul 14 12:17:09 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:17:09.980732 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220bef77-4f6e-40f3-9524-21cd46060fc9 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:17:09.990398 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220bef77-4f6e-40f3-9524-21cd46060fc9 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:17:10.047814 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81ecaa-d19a-4110-a94f-d3c088dec1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:17:10.048492 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81ecaa-d19a-4110-a94f-d3c088dec1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:10.048782 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81ecaa-d19a-4110-a94f-d3c088dec1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:10.049065 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81ecaa-d19a-4110-a94f-d3c088dec1c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:10.049787 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81ecaa-d19a-4110-a94f-d3c088dec1c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:17:10.051754 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81ecaa-d19a-4110-a94f-d3c088dec1c2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:17:10.072318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1434/2877] 10.222.0.79 () {60 vars in 1143 bytes} [Thu Jul 14 12:17:09 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:17:10.076572 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e27d7c-582a-43e1-bcfd-c55b756d0e14 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:17:10.083191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:17:10.087473 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e27d7c-582a-43e1-bcfd-c55b756d0e14 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:17:10.093529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df404a4b-c8ad-462a-a40a-fc32cbc7c750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:17:10.094217 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df404a4b-c8ad-462a-a40a-fc32cbc7c750 admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:10.094523 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df404a4b-c8ad-462a-a40a-fc32cbc7c750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:10.094810 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df404a4b-c8ad-462a-a40a-fc32cbc7c750 admin admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:10.095539 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df404a4b-c8ad-462a-a40a-fc32cbc7c750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:17:10.097134 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df404a4b-c8ad-462a-a40a-fc32cbc7c750 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:17:10.107682 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1444/2878] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:17:10.111476 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81ecaa-d19a-4110-a94f-d3c088dec1c2 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:17:10.121799 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81ecaa-d19a-4110-a94f-d3c088dec1c2 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:17:10.126359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406c49a-2121-4fbf-9d51-850d1c35ed5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:17:10.127043 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406c49a-2121-4fbf-9d51-850d1c35ed5e admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:10.127331 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406c49a-2121-4fbf-9d51-850d1c35ed5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:10.127614 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406c49a-2121-4fbf-9d51-850d1c35ed5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:10.128339 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406c49a-2121-4fbf-9d51-850d1c35ed5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:17:10.129919 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406c49a-2121-4fbf-9d51-850d1c35ed5e admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:17:10.140353 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1435/2879] 10.222.0.79 () {58 vars in 1121 bytes} [Thu Jul 14 12:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:17:10.144707 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df404a4b-c8ad-462a-a40a-fc32cbc7c750 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:17:10.154941 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df404a4b-c8ad-462a-a40a-fc32cbc7c750 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:17:10.159534 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f51fd-1e77-46e1-8df6-7906598dac99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:17:10.160404 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f51fd-1e77-46e1-8df6-7906598dac99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:10.160689 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f51fd-1e77-46e1-8df6-7906598dac99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:10.160968 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f51fd-1e77-46e1-8df6-7906598dac99 admin admin] PATH_INFO: `/v3/projects/e30c76cb62d643a091abef13fb82b487/users/ac738d49a5ae43ecb16fbde07da2607f/roles/9a3a3371dd4d4405b2e4604acc314d43` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:10.176126 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f51fd-1e77-46e1-8df6-7906598dac99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e30c76cb62d643a091abef13fb82b487, user_id=ac738d49a5ae43ecb16fbde07da2607f, role_id=9a3a3371dd4d4405b2e4604acc314d43)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:17:10.178798 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f51fd-1e77-46e1-8df6-7906598dac99 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:17:10.191984 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1445/2880] 10.222.0.79 () {60 vars in 1482 bytes} [Thu Jul 14 12:17:10 2022] PUT /identity/v3/projects/e30c76cb62d643a091abef13fb82b487/users/ac738d49a5ae43ecb16fbde07da2607f/roles/9a3a3371dd4d4405b2e4604acc314d43 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:17:10.201616 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdf448-5e32-4b1e-9b6f-34b39c3849d1 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:10.202155 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdf448-5e32-4b1e-9b6f-34b39c3849d1 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:10.205438 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdf448-5e32-4b1e-9b6f-34b39c3849d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:10.229278 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-88fdf448-5e32-4b1e-9b6f-34b39c3849d1 None None] MFA Rules not processed for user `ac738d49a5ae43ecb16fbde07da2607f`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:17:10.230483 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-88fdf448-5e32-4b1e-9b6f-34b39c3849d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:17:10.255808 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:17:10.297003 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1436/2881] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:17:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:17:10.308264 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f51fd-1e77-46e1-8df6-7906598dac99 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:17:10.309935 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-820f51fd-1e77-46e1-8df6-7906598dac99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:17:10.365978 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f51fd-1e77-46e1-8df6-7906598dac99 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:17:10.370199 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effa0cc-8012-464f-9c4c-fb9c2de27235 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7deede571e7d42408c2fb86665eccfe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:17:10.370883 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effa0cc-8012-464f-9c4c-fb9c2de27235 service cinder] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:10.371164 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effa0cc-8012-464f-9c4c-fb9c2de27235 service cinder] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:10.371437 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effa0cc-8012-464f-9c4c-fb9c2de27235 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:10.379811 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effa0cc-8012-464f-9c4c-fb9c2de27235 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:17:10.381246 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effa0cc-8012-464f-9c4c-fb9c2de27235 service cinder] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:17:10.390169 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1446/2882] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:17:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:17:11.740885 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976fccb-47bc-4c74-a1fd-9caae1355656 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:11.741435 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976fccb-47bc-4c74-a1fd-9caae1355656 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:11.741435 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976fccb-47bc-4c74-a1fd-9caae1355656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:11.759309 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-9976fccb-47bc-4c74-a1fd-9caae1355656 None None] MFA Rules not processed for user `ac738d49a5ae43ecb16fbde07da2607f`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:17:11.760513 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9976fccb-47bc-4c74-a1fd-9caae1355656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:17:11.767342 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1437/2883] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:17:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:17:17.324065 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effa0cc-8012-464f-9c4c-fb9c2de27235 service cinder] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:17:17.325586 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-8effa0cc-8012-464f-9c4c-fb9c2de27235 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:17:17.381565 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effa0cc-8012-464f-9c4c-fb9c2de27235 service cinder] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:17:17.385096 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc21b5b-acb0-4e0a-92ee-70bf2999889b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:17:17.385739 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc21b5b-acb0-4e0a-92ee-70bf2999889b service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:17.386021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc21b5b-acb0-4e0a-92ee-70bf2999889b service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:17.386301 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc21b5b-acb0-4e0a-92ee-70bf2999889b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:17.388067 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-cfc21b5b-acb0-4e0a-92ee-70bf2999889b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:17:17.450105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc21b5b-acb0-4e0a-92ee-70bf2999889b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:17:17.451817 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc21b5b-acb0-4e0a-92ee-70bf2999889b service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:17:17.461807 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1447/2884] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:17:17 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:17:21.754346 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=19 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:17:25.682424 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390bee4-67d5-40f2-ac7c-916d81e3dd9b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:25.683021 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390bee4-67d5-40f2-ac7c-916d81e3dd9b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:25.683021 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390bee4-67d5-40f2-ac7c-916d81e3dd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:25.700182 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3390bee4-67d5-40f2-ac7c-916d81e3dd9b None None] MFA Rules not processed for user `f64d942793a5493787c3e5c7815bc134`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:17:25.701359 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3390bee4-67d5-40f2-ac7c-916d81e3dd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:17:25.755232 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1438/2885] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Jul 14 12:17:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:17:25.777334 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc21b5b-acb0-4e0a-92ee-70bf2999889b service neutron] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:17:25.778744 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-cfc21b5b-acb0-4e0a-92ee-70bf2999889b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:17:25.806426 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:17:25.849554 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc21b5b-acb0-4e0a-92ee-70bf2999889b service neutron] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:17:25.855180 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f66521-4aa3-49aa-8a0b-139ee80ef585 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969ee98dfe644ef2a016860aa1585317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:17:25.855852 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f66521-4aa3-49aa-8a0b-139ee80ef585 service swift] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:25.856137 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f66521-4aa3-49aa-8a0b-139ee80ef585 service swift] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:25.856413 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f66521-4aa3-49aa-8a0b-139ee80ef585 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:25.864546 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f66521-4aa3-49aa-8a0b-139ee80ef585 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:17:25.866139 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f66521-4aa3-49aa-8a0b-139ee80ef585 service swift] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:17:25.874297 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1448/2886] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Jul 14 12:17:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 12:17:26.368464 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d029bf-4980-492a-b43e-3e5234375d33 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:26.368753 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d029bf-4980-492a-b43e-3e5234375d33 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:26.369031 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d029bf-4980-492a-b43e-3e5234375d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:26.386784 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f1d029bf-4980-492a-b43e-3e5234375d33 None None] MFA Rules not processed for user `f64d942793a5493787c3e5c7815bc134`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:17:26.387959 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f1d029bf-4980-492a-b43e-3e5234375d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:17:26.394929 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1439/2887] 10.222.0.79 () {58 vars in 967 bytes} [Thu Jul 14 12:17:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:17:26.406469 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f66521-4aa3-49aa-8a0b-139ee80ef585 service swift] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:17:26.417216 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f66521-4aa3-49aa-8a0b-139ee80ef585 service swift] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:17:26.422435 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364adf2-14e0-4766-bf7d-2635693f8c73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969ee98dfe644ef2a016860aa1585317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:17:26.423226 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364adf2-14e0-4766-bf7d-2635693f8c73 service swift] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:26.423513 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364adf2-14e0-4766-bf7d-2635693f8c73 service swift] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:26.423794 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364adf2-14e0-4766-bf7d-2635693f8c73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:26.432519 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364adf2-14e0-4766-bf7d-2635693f8c73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:17:26.434058 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364adf2-14e0-4766-bf7d-2635693f8c73 service swift] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:17:26.442094 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1449/2888] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Jul 14 12:17:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 12:17:26.625218 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde594c-957e-4e3b-9f6e-ca4a3ab37310 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:26.625512 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde594c-957e-4e3b-9f6e-ca4a3ab37310 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:26.625795 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde594c-957e-4e3b-9f6e-ca4a3ab37310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:26.643645 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6bde594c-957e-4e3b-9f6e-ca4a3ab37310 None None] MFA Rules not processed for user `f64d942793a5493787c3e5c7815bc134`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:17:26.644829 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6bde594c-957e-4e3b-9f6e-ca4a3ab37310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:17:26.652445 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1440/2889] 10.222.0.79 () {58 vars in 1009 bytes} [Thu Jul 14 12:17:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:17:26.664721 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364adf2-14e0-4766-bf7d-2635693f8c73 service swift] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:17:26.675482 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364adf2-14e0-4766-bf7d-2635693f8c73 service swift] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:17:26.680580 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0908657-7417-4e1f-89b9-84defbe54871 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969ee98dfe644ef2a016860aa1585317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:17:26.681214 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0908657-7417-4e1f-89b9-84defbe54871 service swift] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:26.681499 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0908657-7417-4e1f-89b9-84defbe54871 service swift] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:26.681777 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0908657-7417-4e1f-89b9-84defbe54871 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:26.689705 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0908657-7417-4e1f-89b9-84defbe54871 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:17:26.691321 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0908657-7417-4e1f-89b9-84defbe54871 service swift] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:17:26.699703 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1450/2890] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Jul 14 12:17:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 12:17:27.015536 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b9db9-9e8b-405a-896a-56a1d9f0671b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:27.016002 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b9db9-9e8b-405a-896a-56a1d9f0671b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:27.016107 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b9db9-9e8b-405a-896a-56a1d9f0671b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:27.033151 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-b07b9db9-9e8b-405a-896a-56a1d9f0671b None None] MFA Rules not processed for user `f64d942793a5493787c3e5c7815bc134`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:17:27.034322 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b07b9db9-9e8b-405a-896a-56a1d9f0671b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:17:27.041771 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1441/2891] 10.222.0.79 () {58 vars in 967 bytes} [Thu Jul 14 12:17:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:17:27.053562 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0908657-7417-4e1f-89b9-84defbe54871 service swift] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:17:27.064531 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0908657-7417-4e1f-89b9-84defbe54871 service swift] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:17:27.069477 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1981a-1a68-4970-9e4e-f28d8c1fdee4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '969ee98dfe644ef2a016860aa1585317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:17:27.070102 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1981a-1a68-4970-9e4e-f28d8c1fdee4 service swift] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:27.070383 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1981a-1a68-4970-9e4e-f28d8c1fdee4 service swift] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:27.070759 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1981a-1a68-4970-9e4e-f28d8c1fdee4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:27.079106 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1981a-1a68-4970-9e4e-f28d8c1fdee4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:17:27.080669 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1981a-1a68-4970-9e4e-f28d8c1fdee4 service swift] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:17:27.088503 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1451/2892] 10.222.0.79 () {60 vars in 1384 bytes} [Thu Jul 14 12:17:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 12:17:29.097403 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b9db9-9e8b-405a-896a-56a1d9f0671b None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:17:29.159223 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b9db9-9e8b-405a-896a-56a1d9f0671b None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:17:29.163935 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b75e6-8c5f-41b6-afab-d44d3b74a458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:17:29.165321 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b75e6-8c5f-41b6-afab-d44d3b74a458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:29.165601 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b75e6-8c5f-41b6-afab-d44d3b74a458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:29.165870 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b75e6-8c5f-41b6-afab-d44d3b74a458 admin admin] PATH_INFO: `/v3/users/ac738d49a5ae43ecb16fbde07da2607f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:29.167072 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b75e6-8c5f-41b6-afab-d44d3b74a458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac738d49a5ae43ecb16fbde07da2607f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:17:29.168972 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b75e6-8c5f-41b6-afab-d44d3b74a458 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:17:29.214338 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-030b75e6-8c5f-41b6-afab-d44d3b74a458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac738d49a5ae43ecb16fbde07da2607f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:29.221544 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-030b75e6-8c5f-41b6-afab-d44d3b74a458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac738d49a5ae43ecb16fbde07da2607f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:29.229116 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-030b75e6-8c5f-41b6-afab-d44d3b74a458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac738d49a5ae43ecb16fbde07da2607f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:29.240703 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-030b75e6-8c5f-41b6-afab-d44d3b74a458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac738d49a5ae43ecb16fbde07da2607f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:29.241327 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-030b75e6-8c5f-41b6-afab-d44d3b74a458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac738d49a5ae43ecb16fbde07da2607f'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:29.247660 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1442/2893] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:17:29 2022] DELETE /identity/v3/users/ac738d49a5ae43ecb16fbde07da2607f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:17:29.252075 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39147fa-390f-441c-8cd1-b6cf7a5c9789 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:29.252572 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39147fa-390f-441c-8cd1-b6cf7a5c9789 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:29.252691 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39147fa-390f-441c-8cd1-b6cf7a5c9789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:29.270026 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-d39147fa-390f-441c-8cd1-b6cf7a5c9789 None None] MFA Rules not processed for user `4f4a8278e3e04f37a60d10d95e900321`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:17:29.271243 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-d39147fa-390f-441c-8cd1-b6cf7a5c9789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:17:29.327789 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1452/2894] 10.222.0.79 () {58 vars in 957 bytes} [Thu Jul 14 12:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:17:29.337874 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b75e6-8c5f-41b6-afab-d44d3b74a458 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:17:29.339286 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-030b75e6-8c5f-41b6-afab-d44d3b74a458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:17:29.345908 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:17:29.396505 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b75e6-8c5f-41b6-afab-d44d3b74a458 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:17:29.400160 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93fa7c-cdf6-467c-9d68-fad548ac53c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:17:29.400802 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93fa7c-cdf6-467c-9d68-fad548ac53c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:29.401104 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93fa7c-cdf6-467c-9d68-fad548ac53c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:29.401369 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93fa7c-cdf6-467c-9d68-fad548ac53c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:29.410318 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93fa7c-cdf6-467c-9d68-fad548ac53c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:17:29.411775 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93fa7c-cdf6-467c-9d68-fad548ac53c8 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:17:29.421572 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1443/2895] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:17:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:17:29.595378 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39147fa-390f-441c-8cd1-b6cf7a5c9789 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:17:29.596929 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-d39147fa-390f-441c-8cd1-b6cf7a5c9789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:17:29.613414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39147fa-390f-441c-8cd1-b6cf7a5c9789 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:17:29.618884 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8225df-44a5-4e4d-b38d-8571017eb9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:17:29.619842 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8225df-44a5-4e4d-b38d-8571017eb9d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:17:29.620166 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8225df-44a5-4e4d-b38d-8571017eb9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:17:29.620445 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8225df-44a5-4e4d-b38d-8571017eb9d7 admin admin] PATH_INFO: `/v3/projects/e30c76cb62d643a091abef13fb82b487` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:17:29.621712 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8225df-44a5-4e4d-b38d-8571017eb9d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e30c76cb62d643a091abef13fb82b487)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:17:29.623632 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8225df-44a5-4e4d-b38d-8571017eb9d7 admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:17:29.669306 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0b8225df-44a5-4e4d-b38d-8571017eb9d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e30c76cb62d643a091abef13fb82b487', 'request_id': 'req-0b8225df-44a5-4e4d-b38d-8571017eb9d7'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:29.675242 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0b8225df-44a5-4e4d-b38d-8571017eb9d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e30c76cb62d643a091abef13fb82b487', 'request_id': 'req-0b8225df-44a5-4e4d-b38d-8571017eb9d7'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:29.681318 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0b8225df-44a5-4e4d-b38d-8571017eb9d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e30c76cb62d643a091abef13fb82b487', 'request_id': 'req-0b8225df-44a5-4e4d-b38d-8571017eb9d7'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:29.684901 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:17:29.695858 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0b8225df-44a5-4e4d-b38d-8571017eb9d7 admin admin] The token cache is being invalidate because project e30c76cb62d643a091abef13fb82b487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80165) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:17:29.696228 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0b8225df-44a5-4e4d-b38d-8571017eb9d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:29.696842 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-0b8225df-44a5-4e4d-b38d-8571017eb9d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:17:29.698375 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1453/2896] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:17:29 2022] DELETE /identity/v3/projects/e30c76cb62d643a091abef13fb82b487 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:17:39.417375 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=24 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:17:39.695057 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=2 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:19:14.901248 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93fa7c-cdf6-467c-9d68-fad548ac53c8 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:19:14.909970 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93fa7c-cdf6-467c-9d68-fad548ac53c8 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:19:14.957362 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c96fe2-7836-4d96-abb1-bc1588a18ae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:19:14.958007 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c96fe2-7836-4d96-abb1-bc1588a18ae3 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:19:14.958299 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c96fe2-7836-4d96-abb1-bc1588a18ae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:19:14.958609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c96fe2-7836-4d96-abb1-bc1588a18ae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:19:14.960382 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-84c96fe2-7836-4d96-abb1-bc1588a18ae3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:19:15.029815 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c96fe2-7836-4d96-abb1-bc1588a18ae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:19:15.031221 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c96fe2-7836-4d96-abb1-bc1588a18ae3 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:19:15.042209 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1444/2897] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:19:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:19:16.217753 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8225df-44a5-4e4d-b38d-8571017eb9d7 admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:19:16.219212 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-0b8225df-44a5-4e4d-b38d-8571017eb9d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:19:16.231703 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8225df-44a5-4e4d-b38d-8571017eb9d7 admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:19:16.235226 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1441887-8bc6-4981-8ec6-3b79f8979a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:19:16.235860 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1441887-8bc6-4981-8ec6-3b79f8979a6f service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:19:16.236141 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1441887-8bc6-4981-8ec6-3b79f8979a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:19:16.236414 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1441887-8bc6-4981-8ec6-3b79f8979a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:19:16.238077 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-c1441887-8bc6-4981-8ec6-3b79f8979a6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:19:16.251600 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1441887-8bc6-4981-8ec6-3b79f8979a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:19:16.253012 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1441887-8bc6-4981-8ec6-3b79f8979a6f service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:19:16.263962 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1454/2898] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:19:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:19:25.037371 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=54 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:19:25.134380 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c96fe2-7836-4d96-abb1-bc1588a18ae3 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:19:25.135837 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-84c96fe2-7836-4d96-abb1-bc1588a18ae3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:19:25.146457 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c96fe2-7836-4d96-abb1-bc1588a18ae3 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:19:25.150239 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8c9ba-d42c-45cd-bde9-49678e3e0b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:19:25.151129 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8c9ba-d42c-45cd-bde9-49678e3e0b37 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:19:25.151411 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8c9ba-d42c-45cd-bde9-49678e3e0b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:19:25.151685 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8c9ba-d42c-45cd-bde9-49678e3e0b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:19:25.153394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d2f8c9ba-d42c-45cd-bde9-49678e3e0b37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:19:25.163350 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8c9ba-d42c-45cd-bde9-49678e3e0b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:19:25.164770 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8c9ba-d42c-45cd-bde9-49678e3e0b37 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:19:25.173481 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1445/2899] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:19:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:19:26.259149 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=6 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:19:28.175878 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5105a4-5adf-452c-8a1a-9b2e8f4b53e3 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:19:28.176530 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5105a4-5adf-452c-8a1a-9b2e8f4b53e3 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:19:28.176530 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5105a4-5adf-452c-8a1a-9b2e8f4b53e3 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:19:28.178021 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1455/2900] 10.222.0.79 () {54 vars in 921 bytes} [Thu Jul 14 12:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:19:28.184607 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10c8ee-64a5-4745-8cbd-c6a0207cd5e9 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:19:28.185077 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10c8ee-64a5-4745-8cbd-c6a0207cd5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:19:28.185187 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10c8ee-64a5-4745-8cbd-c6a0207cd5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:19:28.221147 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-5b10c8ee-64a5-4745-8cbd-c6a0207cd5e9 None None] MFA Rules not processed for user `2fedd4e015384379bf41c2e01ecc0a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:19:28.222358 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5b10c8ee-64a5-4745-8cbd-c6a0207cd5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:19:28.229416 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1446/2901] 10.222.0.79 () {58 vars in 1018 bytes} [Thu Jul 14 12:19:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 12:19:28.241023 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5105a4-5adf-452c-8a1a-9b2e8f4b53e3 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:19:28.253509 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5105a4-5adf-452c-8a1a-9b2e8f4b53e3 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:19:28.257022 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ccf07-b22e-4e27-a1c9-877f154c3cdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:19:28.257767 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ccf07-b22e-4e27-a1c9-877f154c3cdc service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:19:28.258052 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ccf07-b22e-4e27-a1c9-877f154c3cdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:19:28.258334 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ccf07-b22e-4e27-a1c9-877f154c3cdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:19:28.265619 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ccf07-b22e-4e27-a1c9-877f154c3cdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:19:28.267206 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ccf07-b22e-4e27-a1c9-877f154c3cdc service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:19:28.275210 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1456/2902] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:19:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:19:28.361176 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dc5dc-d377-410f-b4dd-348a769573c8 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:19:28.361471 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dc5dc-d377-410f-b4dd-348a769573c8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:19:28.361752 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dc5dc-d377-410f-b4dd-348a769573c8 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:19:28.363233 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1447/2903] 10.222.0.79 () {54 vars in 921 bytes} [Thu Jul 14 12:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:19:28.368270 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd38f6-ff5f-48fb-a0eb-7aba8a395c17 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:19:28.368618 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd38f6-ff5f-48fb-a0eb-7aba8a395c17 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:19:28.368905 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd38f6-ff5f-48fb-a0eb-7aba8a395c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:19:28.404359 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-ffdd38f6-ff5f-48fb-a0eb-7aba8a395c17 None None] MFA Rules not processed for user `e41a4d3a822c403fad048764a0edf209`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:19:28.405564 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ffdd38f6-ff5f-48fb-a0eb-7aba8a395c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:19:28.414988 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1457/2904] 10.222.0.79 () {58 vars in 1018 bytes} [Thu Jul 14 12:19:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 12:19:28.425782 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477dc5dc-d377-410f-b4dd-348a769573c8 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:19:28.437367 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477dc5dc-d377-410f-b4dd-348a769573c8 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:19:28.440873 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf44c59-dc7f-4ba7-b674-95969fb6e0e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fedd4e015384379bf41c2e01ecc0a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:19:28.441503 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf44c59-dc7f-4ba7-b674-95969fb6e0e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:19:28.441786 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf44c59-dc7f-4ba7-b674-95969fb6e0e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:19:28.442061 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf44c59-dc7f-4ba7-b674-95969fb6e0e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:19:28.452022 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf44c59-dc7f-4ba7-b674-95969fb6e0e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:19:28.453428 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf44c59-dc7f-4ba7-b674-95969fb6e0e6 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:19:28.464502 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1448/2905] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:19:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:19:30.943529 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd38f6-ff5f-48fb-a0eb-7aba8a395c17 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:19:30.944948 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ffdd38f6-ff5f-48fb-a0eb-7aba8a395c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:19:30.960439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd38f6-ff5f-48fb-a0eb-7aba8a395c17 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:19:30.966819 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35028a0-3c66-4697-ba83-58ee12c2d2e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:19:30.967459 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35028a0-3c66-4697-ba83-58ee12c2d2e0 service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:19:30.967743 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35028a0-3c66-4697-ba83-58ee12c2d2e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:19:30.968018 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35028a0-3c66-4697-ba83-58ee12c2d2e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:19:30.969881 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b35028a0-3c66-4697-ba83-58ee12c2d2e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:19:30.984111 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35028a0-3c66-4697-ba83-58ee12c2d2e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:19:30.985732 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35028a0-3c66-4697-ba83-58ee12c2d2e0 service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:19:30.997384 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1458/2906] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:19:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:19:38.459475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=21 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:19:40.992578 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=21 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:20:51.457089 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf44c59-dc7f-4ba7-b674-95969fb6e0e6 service neutron] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:20:51.458998 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1bf44c59-dc7f-4ba7-b674-95969fb6e0e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:20:51.474207 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf44c59-dc7f-4ba7-b674-95969fb6e0e6 service neutron] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:20:51.479685 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25a226-e9a0-478a-a7c5-59f6c27bd2d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e41a4d3a822c403fad048764a0edf209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:20:51.480543 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25a226-e9a0-478a-a7c5-59f6c27bd2d8 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:20:51.480853 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25a226-e9a0-478a-a7c5-59f6c27bd2d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:20:51.481173 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25a226-e9a0-478a-a7c5-59f6c27bd2d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:20:51.483101 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-de25a226-e9a0-478a-a7c5-59f6c27bd2d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:20:51.496042 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25a226-e9a0-478a-a7c5-59f6c27bd2d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:20:51.497609 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25a226-e9a0-478a-a7c5-59f6c27bd2d8 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:20:51.508964 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1449/2907] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:20:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:20:56.030881 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35028a0-3c66-4697-ba83-58ee12c2d2e0 service nova] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:20:56.033443 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b35028a0-3c66-4697-ba83-58ee12c2d2e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:20:56.128860 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35028a0-3c66-4697-ba83-58ee12c2d2e0 service nova] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:20:56.134250 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3f77d-3d17-4815-bdaa-498c3822039e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6070c6b901f4e2ebe621a3e42dd2d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:20:56.135137 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3f77d-3d17-4815-bdaa-498c3822039e service placement] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:20:56.138281 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3f77d-3d17-4815-bdaa-498c3822039e service placement] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:20:56.138281 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3f77d-3d17-4815-bdaa-498c3822039e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:20:56.139901 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-fba3f77d-3d17-4815-bdaa-498c3822039e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:20:56.152602 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3f77d-3d17-4815-bdaa-498c3822039e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:20:56.154259 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3f77d-3d17-4815-bdaa-498c3822039e service placement] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:20:56.165942 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1459/2908] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:20:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 12:20:59.090360 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25a226-e9a0-478a-a7c5-59f6c27bd2d8 service nova] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:20:59.103705 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25a226-e9a0-478a-a7c5-59f6c27bd2d8 service nova] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:20:59.109178 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2c809-090d-4b7b-9481-5fb54b67040f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6070c6b901f4e2ebe621a3e42dd2d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:20:59.109828 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2c809-090d-4b7b-9481-5fb54b67040f service placement] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:20:59.110114 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2c809-090d-4b7b-9481-5fb54b67040f service placement] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:20:59.110394 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2c809-090d-4b7b-9481-5fb54b67040f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:20:59.112210 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-5bc2c809-090d-4b7b-9481-5fb54b67040f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:20:59.135078 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2c809-090d-4b7b-9481-5fb54b67040f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:20:59.138142 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2c809-090d-4b7b-9481-5fb54b67040f service placement] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:20:59.156287 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3f77d-3d17-4815-bdaa-498c3822039e service placement] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:20:59.158244 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1450/2909] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:20:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:20:59.159345 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-fba3f77d-3d17-4815-bdaa-498c3822039e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:20:59.227616 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3f77d-3d17-4815-bdaa-498c3822039e service placement] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:20:59.232103 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1e893-a7e8-44e9-bd30-9b8057aff9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:20:59.232970 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1e893-a7e8-44e9-bd30-9b8057aff9ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:20:59.233256 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1e893-a7e8-44e9-bd30-9b8057aff9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:20:59.233536 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1e893-a7e8-44e9-bd30-9b8057aff9ba admin admin] PATH_INFO: `/v3/users/3e5bbc2113c148c3893ef968d36f05c9` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:20:59.235409 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1e893-a7e8-44e9-bd30-9b8057aff9ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e5bbc2113c148c3893ef968d36f05c9)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:20:59.237333 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1e893-a7e8-44e9-bd30-9b8057aff9ba admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:20:59.281105 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2ef1e893-a7e8-44e9-bd30-9b8057aff9ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e5bbc2113c148c3893ef968d36f05c9'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:20:59.289019 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2ef1e893-a7e8-44e9-bd30-9b8057aff9ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e5bbc2113c148c3893ef968d36f05c9'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:20:59.289586 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2ef1e893-a7e8-44e9-bd30-9b8057aff9ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e5bbc2113c148c3893ef968d36f05c9'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:20:59.301833 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2ef1e893-a7e8-44e9-bd30-9b8057aff9ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e5bbc2113c148c3893ef968d36f05c9'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:20:59.302458 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-2ef1e893-a7e8-44e9-bd30-9b8057aff9ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e5bbc2113c148c3893ef968d36f05c9'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:20:59.315011 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1460/2910] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:20:59 2022] DELETE /identity/v3/users/3e5bbc2113c148c3893ef968d36f05c9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:20:59.488658 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2c809-090d-4b7b-9481-5fb54b67040f service placement] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:20:59.500227 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2c809-090d-4b7b-9481-5fb54b67040f service placement] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:20:59.559968 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cee98-a724-46b4-9d5e-eb6ad2675da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:20:59.560832 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cee98-a724-46b4-9d5e-eb6ad2675da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:20:59.561113 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cee98-a724-46b4-9d5e-eb6ad2675da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:20:59.561387 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cee98-a724-46b4-9d5e-eb6ad2675da5 admin admin] PATH_INFO: `/v3/projects/56e2b90fb93f4e0dabbed560caaab50f` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:20:59.562600 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45cee98-a724-46b4-9d5e-eb6ad2675da5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56e2b90fb93f4e0dabbed560caaab50f)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:20:59.565162 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45cee98-a724-46b4-9d5e-eb6ad2675da5 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:20:59.610175 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b45cee98-a724-46b4-9d5e-eb6ad2675da5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56e2b90fb93f4e0dabbed560caaab50f', 'request_id': 'req-b45cee98-a724-46b4-9d5e-eb6ad2675da5'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:20:59.616203 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b45cee98-a724-46b4-9d5e-eb6ad2675da5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56e2b90fb93f4e0dabbed560caaab50f', 'request_id': 'req-b45cee98-a724-46b4-9d5e-eb6ad2675da5'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:20:59.621797 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b45cee98-a724-46b4-9d5e-eb6ad2675da5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56e2b90fb93f4e0dabbed560caaab50f', 'request_id': 'req-b45cee98-a724-46b4-9d5e-eb6ad2675da5'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:20:59.634159 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b45cee98-a724-46b4-9d5e-eb6ad2675da5 admin admin] The token cache is being invalidate because project 56e2b90fb93f4e0dabbed560caaab50f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:20:59.634478 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b45cee98-a724-46b4-9d5e-eb6ad2675da5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:20:59.635118 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-b45cee98-a724-46b4-9d5e-eb6ad2675da5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:20:59.636631 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1451/2911] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:20:59 2022] DELETE /identity/v3/projects/56e2b90fb93f4e0dabbed560caaab50f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:20:59.640648 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1e893-a7e8-44e9-bd30-9b8057aff9ba admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:20:59.642602 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-2ef1e893-a7e8-44e9-bd30-9b8057aff9ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:20:59.656198 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1e893-a7e8-44e9-bd30-9b8057aff9ba admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:20:59.661439 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:20:59.713602 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711e3ac-84c3-44d5-83a1-32e94b761a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:20:59.714465 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711e3ac-84c3-44d5-83a1-32e94b761a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:20:59.714779 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711e3ac-84c3-44d5-83a1-32e94b761a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:20:59.715053 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711e3ac-84c3-44d5-83a1-32e94b761a8d admin admin] PATH_INFO: `/v3/users/ef01e71686114707bde1537733d1e93f` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:20:59.716261 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711e3ac-84c3-44d5-83a1-32e94b761a8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef01e71686114707bde1537733d1e93f)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:20:59.718191 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711e3ac-84c3-44d5-83a1-32e94b761a8d admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:20:59.764142 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9711e3ac-84c3-44d5-83a1-32e94b761a8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef01e71686114707bde1537733d1e93f'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:20:59.771506 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9711e3ac-84c3-44d5-83a1-32e94b761a8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef01e71686114707bde1537733d1e93f'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:20:59.772166 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9711e3ac-84c3-44d5-83a1-32e94b761a8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef01e71686114707bde1537733d1e93f'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:20:59.783745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9711e3ac-84c3-44d5-83a1-32e94b761a8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef01e71686114707bde1537733d1e93f'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:20:59.784430 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.notifications [None req-9711e3ac-84c3-44d5-83a1-32e94b761a8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef01e71686114707bde1537733d1e93f'} {{(pid=80165) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:20:59.796745 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1461/2912] 10.222.0.79 () {58 vars in 1223 bytes} [Thu Jul 14 12:20:59 2022] DELETE /identity/v3/users/ef01e71686114707bde1537733d1e93f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:20:59.969758 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cee98-a724-46b4-9d5e-eb6ad2675da5 admin admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:20:59.971212 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b45cee98-a724-46b4-9d5e-eb6ad2675da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:20:59.985164 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cee98-a724-46b4-9d5e-eb6ad2675da5 admin admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:21:00.041672 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3138b06-2446-4f09-9155-311d150e8c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f4a8278e3e04f37a60d10d95e900321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fccb5bf2b21430990bb49d29dadf01f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:21:00.042543 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3138b06-2446-4f09-9155-311d150e8c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:21:00.042832 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3138b06-2446-4f09-9155-311d150e8c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:21:00.043105 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3138b06-2446-4f09-9155-311d150e8c51 admin admin] PATH_INFO: `/v3/projects/4997de68e6b34ee0a19acde6ade1cd15` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:21:00.044268 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3138b06-2446-4f09-9155-311d150e8c51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4997de68e6b34ee0a19acde6ade1cd15)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:21:00.046146 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3138b06-2446-4f09-9155-311d150e8c51 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:21:00.052243 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:00.094368 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d3138b06-2446-4f09-9155-311d150e8c51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4997de68e6b34ee0a19acde6ade1cd15', 'request_id': 'req-d3138b06-2446-4f09-9155-311d150e8c51'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:21:00.100408 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d3138b06-2446-4f09-9155-311d150e8c51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4997de68e6b34ee0a19acde6ade1cd15', 'request_id': 'req-d3138b06-2446-4f09-9155-311d150e8c51'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:21:00.105900 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d3138b06-2446-4f09-9155-311d150e8c51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4997de68e6b34ee0a19acde6ade1cd15', 'request_id': 'req-d3138b06-2446-4f09-9155-311d150e8c51'} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:21:00.118406 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d3138b06-2446-4f09-9155-311d150e8c51 admin admin] The token cache is being invalidate because project 4997de68e6b34ee0a19acde6ade1cd15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 12:21:00.118725 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d3138b06-2446-4f09-9155-311d150e8c51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:21:00.119343 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG keystone.notifications [None req-d3138b06-2446-4f09-9155-311d150e8c51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 12:21:00.120878 dv-cinder-848900-3-smb devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1452/2913] 10.222.0.79 () {58 vars in 1232 bytes} [Thu Jul 14 12:20:59 2022] DELETE /identity/v3/projects/4997de68e6b34ee0a19acde6ade1cd15 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:21:09.793284 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:10.115475 dv-cinder-848900-3-smb devstack@keystone.service[80164]: DEBUG dbcounter [-] [80164] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:22:49.118134 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711e3ac-84c3-44d5-83a1-32e94b761a8d admin admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:22:49.119558 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-9711e3ac-84c3-44d5-83a1-32e94b761a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:22:49.187679 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711e3ac-84c3-44d5-83a1-32e94b761a8d admin admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:22:49.245045 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d084afa-316a-4cd8-8aa9-bee0d1dc6585 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6070c6b901f4e2ebe621a3e42dd2d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f531bc924b41faa64743923afac319', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:22:49.245686 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d084afa-316a-4cd8-8aa9-bee0d1dc6585 service placement] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:22:49.245969 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d084afa-316a-4cd8-8aa9-bee0d1dc6585 service placement] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:22:49.246245 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d084afa-316a-4cd8-8aa9-bee0d1dc6585 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:22:49.248040 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-8d084afa-316a-4cd8-8aa9-bee0d1dc6585 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:22:49.259006 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d084afa-316a-4cd8-8aa9-bee0d1dc6585 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:22:49.260574 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d084afa-316a-4cd8-8aa9-bee0d1dc6585 service placement] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:22:49.270262 dv-cinder-848900-3-smb devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1462/2914] 10.222.0.79 () {60 vars in 1365 bytes} [Thu Jul 14 12:22:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 12:22:59.266039 dv-cinder-848900-3-smb devstack@keystone.service[80165]: DEBUG dbcounter [-] [80165] Writing DB stats keystone:SELECT=58 {{(pid=80165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}